• 解决kylin报错:java.lang.ArrayIndexOutOfBoundsException: -1


    报错信息:

    2017-06-26 14:17:30,167 INFO  [pool-9-thread-3] cli.DictionaryGeneratorCLI:57 : Building snapshot of ENERGON_DM.DM_DIAGNOSIS_FACT_SGYY_ROOT_SET_FLAG
    2017-06-26 14:17:31,484 ERROR [pool-9-thread-3] common.HadoopShellExecutable:65 : error execute HadoopShellExecutable{id=8188ef71-3bc6-4b9a-b87d-5559e3ea6b4a-03, name=Bu
    ild Dimension Dictionary, state=RUNNING}
    java.lang.ArrayIndexOutOfBoundsException: -1
            at org.apache.kylin.dict.lookup.SnapshotTable.takeSnapshot(SnapshotTable.java:89)
            at org.apache.kylin.dict.lookup.SnapshotManager.buildSnapshot(SnapshotManager.java:132)
            at org.apache.kylin.cube.CubeManager.buildSnapshotTable(CubeManager.java:270)
            at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:58)
            at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:41)
            at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:54)
            at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
            at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
            at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
            at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
            at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
            at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
            at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
            at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
            at java.lang.Thread.run(Thread.java:745)
    解决:
    meta中/table/下存在同名但大小写不同的两个table的meta, 这个meta文件里column的id起始为0,正常情况应该为1. kylin内部把表的meta存到一个hashmap里,key为大写的表名,不论原来是否为大写。在这个情况中小写的meta的内容把大写的meta内容覆盖了,查ID的时候有一个操作是把id值 - 1。如果原始的ID为0,-1之后就变成-1,然后就抛出上面的异常。
     

    org.apache.kylin.dict.lookup.SnapshotTable:

    org.apache.kylin.metadata.model.ColumnDesc:

    问题meta:

    ps: 类org.apache.kylin.metadata.model.ColumnDesc对应table中的一个column:

    v.s.
  • 相关阅读:
    Mysql数据备份命令
    git命令大全
    git 安装及普通命令
    git学习资料
    php 魔术方法 和 魔术常量
    react事件处理(绑定)
    java父类、子类构造函数调用过程
    java字符串String的intern()方法,举例说明
    java关键字static使用的“坑”(准备、初始化)
    java虚拟机
  • 原文地址:https://www.cnblogs.com/aprilrain/p/7118799.html
Copyright © 2020-2023  润新知