美文网首页大数据
【Hive】ERROR exec.DDLTask: java.l

【Hive】ERROR exec.DDLTask: java.l

作者: sparkle123 | 来源:发表于2018-06-23 22:14 被阅读0次

    1/在$HADOOP_HOME/lib/native下面放了2.5.0-native-snappy.tar.gz,这是HDFS存储压缩所需的本地lib包。
    cd ~/app/hadoop-2.5.0-cdh5.3.6/lib/native/

    2/执行命令hadoop checknative

    18/06/23 07:23:36 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    Native library checking:
    hadoop:  true
    zlib:    true
    snappy:  true
    lz4:     true
    bzip2:   true
    openssl: false
    

    3/但是, hive命令进入hive的命令行,执行show tables之类的操作时,报如下错误:

    ERROR exec.DDLTask: java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCrc32.nativeComputeChunkedSumsByteArray(II[BI[BIILjava/lang/String;JZ)V
    

    4/原因:由于放入的lib包版本问题,暂时先把它们删除吧。
    再次进入hive中,执行命令OK。

    5/执行hive -hiveconf hive.root.logger=DEBUG,console,发现还是有错误。
    暂时没有去解决,但是不影响功能。

    InvalidObjectException(message:Role admin already exists.)
            at org.apache.hadoop.hive.metastore.ObjectStore.addRole(ObjectStore.java:3051)
            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
            at java.lang.reflect.Method.invoke(Method.java:606)
            at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:108)
            at com.sun.proxy.$Proxy5.addRole(Unknown Source)
            at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultRoles(HiveMetaStore.java:555)
            at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:409)
            at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.<init>(HiveMetaStore.java:367)
            at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:55)
            at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:60)
            at org.apache.hadoop.hive.metastore.HiveMetaStore.newHMSHandler(HiveMetaStore.java:4994)
            at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:175)
            at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
            at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
            at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
            at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
            at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1424)
            at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:63)
            at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:73)
            at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2625)
            at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2644)
            at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:365)
            at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689)
            at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:633)
            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
            at java.lang.reflect.Method.invoke(Method.java:606)
            at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
    18/06/23 07:31:08 [main]: INFO metastore.HiveMetaStore: Added admin role in metastore
    18/06/23 07:31:08 [main]: DEBUG metastore.ObjectStore: Open transaction: count = 1, isActive = true at:
            org.apache.hadoop.hive.metastore.ObjectStore.addRole(ObjectStore.java:3048)
    18/06/23 07:31:08 [main]: DEBUG metastore.ObjectStore: Open transaction: count = 2, isActive = true at:
            org.apache.hadoop.hive.metastore.ObjectStore.getMRole(ObjectStore.java:3327)
    18/06/23 07:31:08 [main]: DEBUG metastore.ObjectStore: Commit transaction: count = 1, isactive true at:
            org.apache.hadoop.hive.metastore.ObjectStore.getMRole(ObjectStore.java:3333)
    18/06/23 07:31:08 [main]: DEBUG metastore.ObjectStore: Rollback transaction, isActive: true at:
            org.apache.hadoop.hive.metastore.ObjectStore.addRole(ObjectStore.java:3061)
    18/06/23 07:31:08 [main]: DEBUG metastore.HiveMetaStore: public role already exists
    InvalidObjectException(message:Role public already exists.)
            at org.apache.hadoop.hive.metastore.ObjectStore.addRole(ObjectStore.java:3051)
            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
            at java.lang.reflect.Method.invoke(Method.java:606)
            at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:108)
            at com.sun.proxy.$Proxy5.addRole(Unknown Source)
            at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultRoles(HiveMetaStore.java:564)
            at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:409)
            at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.<init>(HiveMetaStore.java:367)
            at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:55)
            at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:60)
            at org.apache.hadoop.hive.metastore.HiveMetaStore.newHMSHandler(HiveMetaStore.java:4994)
            at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:175)
            at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
            at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
            at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
            at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
            at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1424)
            at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:63)
            at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:73)
            at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2625)
            at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2644)
            at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:365)
            at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689)
            at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:633)
            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
            at java.lang.reflect.Method.invoke(Method.java:606)
            at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
    
    

    相关文章

      网友评论

        本文标题:【Hive】ERROR exec.DDLTask: java.l

        本文链接:https://www.haomeiwen.com/subject/oxbdyftx.html