讲hdfs中的数据导入到hbase中通过importtsv

作者: wudl | 来源:发表于2021-06-14 23:38 被阅读0次

讲hdfs中的数据导入到hbase中通过importtsv
尚硅谷大数据技术之Sqoop
四、Hbase数据导入
HBase数据导入-ImportTsv
Hive 大表数据导入 HBase
Hbase设计原则
Hbase教程：通过BulkLoad快速将海量数据导入到Hbas
Sqoop基础（二）导入，导出，创建job
HBase数据的删除和更新
个人总结-Sqoop

1. 通过importtsv 命令将hdfs 数据导入到hbase 中

命令：

HADOOP_HOME=/export/servers/hadoop
HBASE_HOME=/export/servers/hbase
HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase mapredcp`:${HBASE_HOME}/conf ${HADOOP_HOME}/bin/yarn jar ${HBASE_HOME}/lib/hbase-server-1.2.0-cdh5.14.0.jar \
importtsv \
-Dimporttsv.columns=HBASE_ROW_KEY,detail:log_id,detail:remote_ip,detail:site_global_ticket,detail:site_global_session,detail:global_user_id,detail:cookie_text,detail:user_agent,detail:ref_url,detail:loc_url,detail:log_time \
tbl_logs \
/user/hive/warehouse/tags_dat.db/tbl_logs


执行如下
[root@bigdata-cdh01 ~]# HADOOP_HOME=/export/servers/hadoop
[root@bigdata-cdh01 ~]# HBASE_HOME=/export/servers/hbase
[root@bigdata-cdh01 ~]# HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase mapredcp`:${HBASE_HOME}/conf ${HADOOP_HOME}/bin/yarn jar ${HBASE_HOME}/lib/hbase-server-1.2.0-cdh5.14.0.jar \
> importtsv \
> -Dimporttsv.columns=HBASE_ROW_KEY,detail:log_id,detail:remote_ip,detail:site_global_ticket,detail:site_global_session,detail:global_user_id,detail:cookie_text,detail:user_agent,detail:ref_url,detail:loc_url,detail:log_time \
> tbl_logs \
> /user/hive/warehouse/tags_dat.db/tbl_logs

[root@bigdata-cdh01 ~]# HADOOP_HOME=/export/servers/hadoop
[root@bigdata-cdh01 ~]# HBASE_HOME=/export/servers/hbase
[root@bigdata-cdh01 ~]# HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase mapredcp`:${HBASE_HOME}/conf ${HADOOP_HOME}/bin/yarn jar ${HBASE_HOME}/lib/hbase-server-1.2.0-cdh5.14.0.jar \
> importtsv \
> -Dimporttsv.columns=HBASE_ROW_KEY,detail:log_id,detail:remote_ip,detail:site_global_ticket,detail:site_global_session,detail:global_user_id,detail:cookie_text,detail:user_agent,detail:ref_url,detail:loc_url,detail:log_time \
> tbl_logs \
> /user/hive/warehouse/tags_dat.db/tbl_logs
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/export/servers/hbase-1.2.0-cdh5.14.0/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
21/06/14 23:01:29 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x7cbee484 connecting to ZooKeeper ensemble=bigdata-cdh01.itcast.cn:2181
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-cdh5.14.0--1, built on 01/06/2018 21:24 GMT
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Client environment:host.name=bigdata-cdh01.itcast.cn
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Client environment:java.version=1.8.0_141
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Client environment:java.home=/export/servers/jdk1.8.0_141/jre
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/export/servers/hadoop-2.6.0-cdh5.14.0/etc/hadoop:/export/servers/hadoop-2.6.0-cdh5.14.0/etc/hadoop:/export/servers/hadoop-2.6.0-cdh5.14.0/etc/hadoop:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-collections-3.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-httpclient-3.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/activation-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/curator-client-2.7.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/httpcore-4.2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-codec-1.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-beanutils-1.9.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/netty-3.10.5.Final.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/guava-11.0.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jersey-core-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/htrace-core4-4.0.1-incubating.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-el-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/zookeeper-3.4.5-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/junit-4.11.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-lang-2.6.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jsp-api-2.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/hadoop-auth-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/hadoop-annotations-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/paranamer-2.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jetty-util-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/log4j-1.2.17.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/xmlenc-0.52.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jersey-json-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/xz-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/gson-2.2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jetty-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-logging-1.1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jsr305-3.0.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jettison-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/httpclient-4.2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/stax-api-1.0-2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/curator-framework-2.7.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-cli-1.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jsch-0.1.42.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-io-2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/asm-3.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/avro-1.7.6-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/logredactor-1.0.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jets3t-0.9.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-digester-1.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/hamcrest-core-1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-net-3.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jersey-server-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/servlet-api-2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-configuration-1.6.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/hadoop-common-2.6.0-cdh5.14.0-tests.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/hadoop-nfs-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/hadoop-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/netty-3.10.5.Final.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/htrace-core4-4.0.1-incubating.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-el-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jetty-util-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jetty-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-io-2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/asm-3.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/hadoop-hdfs-nfs-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/hadoop-hdfs-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/hadoop-hdfs-2.6.0-cdh5.14.0-tests.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/activation-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-codec-1.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guava-11.0.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-core-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/javax.inject-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/zookeeper-3.4.5-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-lang-2.6.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-client-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-xc-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jetty-util-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/log4j-1.2.17.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-json-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/xz-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jetty-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jettison-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guice-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-cli-1.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-io-2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/asm-3.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jline-2.11.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-server-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/servlet-api-2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-jaxrs-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-client-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-api-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-registry-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/netty-3.10.5.Final.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/junit-4.11.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/avro-1.7.6-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-nativetask-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.14.0-tests.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.6.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-client-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-server-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-prefix-tree-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/htrace-core-3.2.0-incubating.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-common-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/zookeeper-3.4.5-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/guava-12.0.1.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-hadoop-compat-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/netty-all-4.0.23.Final.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-protocol-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/protobuf-java-2.5.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/metrics-core-2.2.0.jar:/export/servers/hbase/conf:/export/servers/hadoop/contrib/capacity-scheduler/*.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-client-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-api-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-registry-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/activation-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-codec-1.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guava-11.0.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-core-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/javax.inject-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/zookeeper-3.4.5-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-lang-2.6.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-client-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-xc-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jetty-util-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/log4j-1.2.17.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-json-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/xz-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jetty-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jettison-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guice-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-cli-1.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-io-2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/asm-3.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jline-2.11.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-server-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/servlet-api-2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-jaxrs-1.8.8.jar
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/export/servers/hadoop-2.6.0-cdh5.14.0/lib/native
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-696.el6.x86_64
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Client environment:user.name=root
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Client environment:user.home=/root
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Client environment:user.dir=/root
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=bigdata-cdh01.itcast.cn:2181 sessionTimeout=90000 watcher=hconnection-0x7cbee4840x0, quorum=bigdata-cdh01.itcast.cn:2181, baseZNode=/hbase
21/06/14 23:01:29 INFO zookeeper.ClientCnxn: Opening socket connection to server bigdata-cdh01.itcast.cn/192.168.1.140:2181. Will not attempt to authenticate using SASL (unknown error)
21/06/14 23:01:29 INFO zookeeper.ClientCnxn: Socket connection established, initiating session, client: /192.168.1.140:59426, server: bigdata-cdh01.itcast.cn/192.168.1.140:2181
21/06/14 23:01:29 INFO zookeeper.ClientCnxn: Session establishment complete on server bigdata-cdh01.itcast.cn/192.168.1.140:2181, sessionid = 0x17a0ab8f8d5000b, negotiated timeout = 40000
21/06/14 23:01:29 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
21/06/14 23:01:29 INFO client.ConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x17a0ab8f8d5000b
21/06/14 23:01:29 INFO zookeeper.ZooKeeper: Session: 0x17a0ab8f8d5000b closed
21/06/14 23:01:29 INFO zookeeper.ClientCnxn: EventThread shut down
21/06/14 23:01:30 INFO client.RMProxy: Connecting to ResourceManager at bigdata-cdh01.itcast.cn/192.168.1.140:8032
21/06/14 23:01:30 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
21/06/14 23:01:30 INFO input.FileInputFormat: Total input paths to process : 20
21/06/14 23:01:30 INFO mapreduce.JobSubmitter: number of splits:20
21/06/14 23:01:30 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
21/06/14 23:01:30 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1623677312744_0008
21/06/14 23:01:30 INFO impl.YarnClientImpl: Submitted application application_1623677312744_0008
21/06/14 23:01:30 INFO mapreduce.Job: The url to track the job: http://bigdata-cdh01.itcast.cn:8088/proxy/application_1623677312744_0008/
21/06/14 23:01:30 INFO mapreduce.Job: Running job: job_1623677312744_0008
21/06/14 23:01:34 INFO mapreduce.Job: Job job_1623677312744_0008 running in uber mode : false
21/06/14 23:01:34 INFO mapreduce.Job:  map 0% reduce 0%
21/06/14 23:01:51 INFO mapreduce.Job:  map 5% reduce 0%
21/06/14 23:02:05 INFO mapreduce.Job:  map 10% reduce 0%
21/06/14 23:02:16 INFO mapreduce.Job:  map 12% reduce 0%
21/06/14 23:02:18 INFO mapreduce.Job:  map 14% reduce 0%
21/06/14 23:02:19 INFO mapreduce.Job:  map 16% reduce 0%
21/06/14 23:02:21 INFO mapreduce.Job:  map 17% reduce 0%
21/06/14 23:02:25 INFO mapreduce.Job:  map 18% reduce 0%
21/06/14 23:02:31 INFO mapreduce.Job:  map 19% reduce 0%
21/06/14 23:02:32 INFO mapreduce.Job:  map 20% reduce 0%
21/06/14 23:02:37 INFO mapreduce.Job:  map 21% reduce 0%
21/06/14 23:02:38 INFO mapreduce.Job:  map 22% reduce 0%
21/06/14 23:02:42 INFO mapreduce.Job:  map 23% reduce 0%
21/06/14 23:02:43 INFO mapreduce.Job:  map 24% reduce 0%
21/06/14 23:02:44 INFO mapreduce.Job:  map 25% reduce 0%
21/06/14 23:02:49 INFO mapreduce.Job:  map 27% reduce 0%
21/06/14 23:02:50 INFO mapreduce.Job:  map 28% reduce 0%
21/06/14 23:02:51 INFO mapreduce.Job:  map 29% reduce 0%
21/06/14 23:02:53 INFO mapreduce.Job:  map 33% reduce 0%
21/06/14 23:02:54 INFO mapreduce.Job:  map 40% reduce 0%
21/06/14 23:02:59 INFO mapreduce.Job:  map 45% reduce 0%
21/06/14 23:03:04 INFO mapreduce.Job:  map 50% reduce 0%
21/06/14 23:03:07 INFO mapreduce.Job:  map 55% reduce 0%
21/06/14 23:03:08 INFO mapreduce.Job:  map 65% reduce 0%
21/06/14 23:03:09 INFO mapreduce.Job:  map 70% reduce 0%
21/06/14 23:03:13 INFO mapreduce.Job:  map 75% reduce 0%
21/06/14 23:03:24 INFO mapreduce.Job:  map 80% reduce 0%
21/06/14 23:03:31 INFO mapreduce.Job:  map 81% reduce 0%
21/06/14 23:03:32 INFO mapreduce.Job:  map 83% reduce 0%
21/06/14 23:03:34 INFO mapreduce.Job:  map 86% reduce 0%
21/06/14 23:03:41 INFO mapreduce.Job:  map 88% reduce 0%
21/06/14 23:03:42 INFO mapreduce.Job:  map 95% reduce 0%
21/06/14 23:03:44 INFO mapreduce.Job:  map 98% reduce 0%
21/06/14 23:03:45 INFO mapreduce.Job:  map 100% reduce 0%
21/06/14 23:03:45 INFO mapreduce.Job: Job job_1623677312744_0008 completed successfully
21/06/14 23:03:45 INFO mapreduce.Job: Counters: 32
    File System Counters
        FILE: Number of bytes read=0
        FILE: Number of bytes written=3607610
        FILE: Number of read operations=0
        FILE: Number of large read operations=0
        FILE: Number of write operations=0
        HDFS: Number of bytes read=588287243
        HDFS: Number of bytes written=0
        HDFS: Number of read operations=40
        HDFS: Number of large read operations=0
        HDFS: Number of write operations=0
    Job Counters 
        Killed map tasks=2
        Launched map tasks=21
        Data-local map tasks=21
        Total time spent by all maps in occupied slots (ms)=697546
        Total time spent by all reduces in occupied slots (ms)=0
        Total time spent by all map tasks (ms)=697546
        Total vcore-milliseconds taken by all map tasks=697546
        Total megabyte-milliseconds taken by all map tasks=714287104
    Map-Reduce Framework
        Map input records=376983
        Map output records=376982
        Input split bytes=3080
        Spilled Records=0
        Failed Shuffles=0
        Merged Map outputs=0
        GC time elapsed (ms)=68217
        CPU time spent (ms)=525450
        Physical memory (bytes) snapshot=7431569408
        Virtual memory (bytes) snapshot=56232243200
        Total committed heap usage (bytes)=6881804288
    ImportTsv
        Bad Lines=1
    File Input Format Counters 
        Bytes Read=588284163
    File Output Format Counters 
        Bytes Written=0
[root@bigdata-cdh01 ~]#

将hdfs文件转变为hfile 文件
缺点：

1、ROWKEY不能是组合主键，只能是某一个字段。
2、当表中列很多时，书写-Dimporttsv.columns值时很麻烦，容易出错。

我

在这里插入图片描述

生成hfile 文件命令：

HADOOP_HOME=/export/servers/hadoop
HBASE_HOME=/export/servers/hbase
HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase mapredcp`:${HBASE_HOME}/conf ${HADOOP_HOME}/bin/yarn jar ${HBASE_HOME}/lib/hbase-server-1.2.0-cdh5.14.0.jar \
importtsv \
-Dimporttsv.bulk.output=hdfs://192.168.1.140:8020/datas/output_hfile/tbl_logs \
-Dimporttsv.columns=HBASE_ROW_KEY,detail:log_id,detail:remote_ip,detail:site_global_ticket,detail:site_global_session,detail:global_user_id,detail:cookie_text,detail:user_agent,detail:ref_url,detail:loc_url,detail:log_time \
tbl_logs \
/user/hive/warehouse/tags_dat.db/tbl_logs

整体执行效果：

[root@bigdata-cdh01 ~]# HADOOP_HOME=/export/servers/hadoop
[root@bigdata-cdh01 ~]# HBASE_HOME=/export/servers/hbase
[root@bigdata-cdh01 ~]# HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase mapredcp`:${HBASE_HOME}/conf ${HADOOP_HOME}/bin/yarn jar ${HBASE_HOME}/lib/hbase-server-1.2.0-cdh5.14.0.jar \
> importtsv \
> -Dimporttsv.bulk.output=hdfs://192.168.1.140:8020/datas/output_hfile/tbl_logs \
> -Dimporttsv.columns=HBASE_ROW_KEY,detail:log_id,detail:remote_ip,detail:site_global_ticket,detail:site_global_session,detail:global_user_id,detail:cookie_text,detail:user_agent,detail:ref_url,detail:loc_url,detail:log_time \
> tbl_logs \
> /user/hive/warehouse/tags_dat.db/tbl_logs
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/export/servers/hbase-1.2.0-cdh5.14.0/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
21/06/14 23:20:52 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x7cbee484 connecting to ZooKeeper ensemble=bigdata-cdh01.itcast.cn:2181
21/06/14 23:20:52 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-cdh5.14.0--1, built on 01/06/2018 21:24 GMT
21/06/14 23:20:52 INFO zookeeper.ZooKeeper: Client environment:host.name=bigdata-cdh01.itcast.cn
21/06/14 23:20:52 INFO zookeeper.ZooKeeper: Client environment:java.version=1.8.0_141
21/06/14 23:20:52 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
21/06/14 23:20:52 INFO zookeeper.ZooKeeper: Client environment:java.home=/export/servers/jdk1.8.0_141/jre
21/06/14 23:20:52 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/export/servers/hadoop-2.6.0-cdh5.14.0/etc/hadoop:/export/servers/hadoop-2.6.0-cdh5.14.0/etc/hadoop:/export/servers/hadoop-2.6.0-cdh5.14.0/etc/hadoop:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-collections-3.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-httpclient-3.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/activation-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/curator-client-2.7.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/httpcore-4.2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-codec-1.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-beanutils-1.9.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/netty-3.10.5.Final.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/guava-11.0.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jersey-core-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/htrace-core4-4.0.1-incubating.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-el-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/zookeeper-3.4.5-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/junit-4.11.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-lang-2.6.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jsp-api-2.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/hadoop-auth-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/hadoop-annotations-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/paranamer-2.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jetty-util-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/log4j-1.2.17.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/xmlenc-0.52.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jersey-json-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/xz-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/gson-2.2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jetty-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-logging-1.1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jsr305-3.0.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jettison-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/httpclient-4.2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/stax-api-1.0-2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/curator-framework-2.7.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-cli-1.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jsch-0.1.42.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-io-2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/asm-3.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/avro-1.7.6-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/logredactor-1.0.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jets3t-0.9.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-digester-1.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/hamcrest-core-1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-net-3.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jersey-server-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/servlet-api-2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-configuration-1.6.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/hadoop-common-2.6.0-cdh5.14.0-tests.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/hadoop-nfs-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/hadoop-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/netty-3.10.5.Final.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/htrace-core4-4.0.1-incubating.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-el-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jetty-util-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jetty-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-io-2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/asm-3.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/hadoop-hdfs-nfs-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/hadoop-hdfs-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/hadoop-hdfs-2.6.0-cdh5.14.0-tests.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/activation-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-codec-1.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guava-11.0.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-core-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/javax.inject-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/zookeeper-3.4.5-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-lang-2.6.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-client-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-xc-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jetty-util-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/log4j-1.2.17.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-json-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/xz-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jetty-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jettison-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guice-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-cli-1.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-io-2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/asm-3.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jline-2.11.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-server-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/servlet-api-2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-jaxrs-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-client-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-api-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-registry-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/netty-3.10.5.Final.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/junit-4.11.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/avro-1.7.6-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-nativetask-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.14.0-tests.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.6.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-client-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-server-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-prefix-tree-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/htrace-core-3.2.0-incubating.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-common-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/zookeeper-3.4.5-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/guava-12.0.1.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-hadoop-compat-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/netty-all-4.0.23.Final.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-protocol-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/protobuf-java-2.5.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/metrics-core-2.2.0.jar:/export/servers/hbase/conf:/export/servers/hadoop/contrib/capacity-scheduler/*.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-client-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-api-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-registry-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/activation-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-codec-1.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guava-11.0.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-core-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/javax.inject-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/zookeeper-3.4.5-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-lang-2.6.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-client-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-xc-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jetty-util-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/log4j-1.2.17.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-json-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/xz-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jetty-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jettison-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guice-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-cli-1.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-io-2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/asm-3.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jline-2.11.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-server-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/servlet-api-2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-jaxrs-1.8.8.jar
21/06/14 23:20:52 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/export/servers/hadoop-2.6.0-cdh5.14.0/lib/native
21/06/14 23:20:52 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
21/06/14 23:20:52 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
21/06/14 23:20:52 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
21/06/14 23:20:52 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
21/06/14 23:20:52 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-696.el6.x86_64
21/06/14 23:20:52 INFO zookeeper.ZooKeeper: Client environment:user.name=root
21/06/14 23:20:52 INFO zookeeper.ZooKeeper: Client environment:user.home=/root
21/06/14 23:20:52 INFO zookeeper.ZooKeeper: Client environment:user.dir=/root
21/06/14 23:20:52 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=bigdata-cdh01.itcast.cn:2181 sessionTimeout=90000 watcher=hconnection-0x7cbee4840x0, quorum=bigdata-cdh01.itcast.cn:2181, baseZNode=/hbase
21/06/14 23:20:52 INFO zookeeper.ClientCnxn: Opening socket connection to server bigdata-cdh01.itcast.cn/192.168.1.140:2181. Will not attempt to authenticate using SASL (unknown error)
21/06/14 23:20:52 INFO zookeeper.ClientCnxn: Socket connection established, initiating session, client: /192.168.1.140:60160, server: bigdata-cdh01.itcast.cn/192.168.1.140:2181
21/06/14 23:20:52 INFO zookeeper.ClientCnxn: Session establishment complete on server bigdata-cdh01.itcast.cn/192.168.1.140:2181, sessionid = 0x17a0ab8f8d50034, negotiated timeout = 40000
21/06/14 23:20:53 INFO Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available
21/06/14 23:20:53 INFO mapreduce.HFileOutputFormat2: Looking up current regions for table tbl_logs
21/06/14 23:20:53 INFO mapreduce.HFileOutputFormat2: Configuring 2 reduce partitions to match current region count
21/06/14 23:20:53 INFO mapreduce.HFileOutputFormat2: Writing partition information to /user/root/hbase-staging/partitions_738a2430-d343-4820-a5b2-b99c786b562f
21/06/14 23:20:53 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library
21/06/14 23:20:53 INFO compress.CodecPool: Got brand-new compressor [.deflate]
21/06/14 23:20:53 INFO mapreduce.HFileOutputFormat2: Incremental table tbl_logs output configured.
21/06/14 23:20:53 INFO client.ConnectionManager$HConnectionImplementation: Closing master protocol: MasterService
21/06/14 23:20:53 INFO client.ConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x17a0ab8f8d50034
21/06/14 23:20:53 INFO zookeeper.ClientCnxn: EventThread shut down
21/06/14 23:20:53 INFO zookeeper.ZooKeeper: Session: 0x17a0ab8f8d50034 closed
21/06/14 23:20:53 INFO client.RMProxy: Connecting to ResourceManager at bigdata-cdh01.itcast.cn/192.168.1.140:8032
21/06/14 23:20:54 INFO input.FileInputFormat: Total input paths to process : 20
21/06/14 23:20:54 INFO mapreduce.JobSubmitter: number of splits:20
21/06/14 23:20:54 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
21/06/14 23:20:54 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1623677312744_0009
21/06/14 23:20:55 INFO impl.YarnClientImpl: Submitted application application_1623677312744_0009
21/06/14 23:20:55 INFO mapreduce.Job: The url to track the job: http://bigdata-cdh01.itcast.cn:8088/proxy/application_1623677312744_0009/
21/06/14 23:20:55 INFO mapreduce.Job: Running job: job_1623677312744_0009
21/06/14 23:21:00 INFO mapreduce.Job: Job job_1623677312744_0009 running in uber mode : false
21/06/14 23:21:00 INFO mapreduce.Job:  map 0% reduce 0%
21/06/14 23:21:05 INFO mapreduce.Job:  map 5% reduce 0%
21/06/14 23:21:07 INFO mapreduce.Job:  map 10% reduce 0%
21/06/14 23:21:10 INFO mapreduce.Job:  map 15% reduce 0%
21/06/14 23:21:26 INFO mapreduce.Job:  map 18% reduce 0%
21/06/14 23:21:28 INFO mapreduce.Job:  map 20% reduce 0%
21/06/14 23:21:29 INFO mapreduce.Job:  map 25% reduce 0%
21/06/14 23:21:31 INFO mapreduce.Job:  map 30% reduce 0%
21/06/14 23:21:33 INFO mapreduce.Job:  map 35% reduce 0%
21/06/14 23:21:34 INFO mapreduce.Job:  map 40% reduce 0%
21/06/14 23:21:35 INFO mapreduce.Job:  map 45% reduce 0%
21/06/14 23:21:41 INFO mapreduce.Job:  map 55% reduce 0%
21/06/14 23:21:46 INFO mapreduce.Job:  map 60% reduce 0%
21/06/14 23:21:48 INFO mapreduce.Job:  map 65% reduce 0%
21/06/14 23:21:49 INFO mapreduce.Job:  map 65% reduce 11%
21/06/14 23:21:53 INFO mapreduce.Job:  map 65% reduce 22%
21/06/14 23:21:58 INFO mapreduce.Job:  map 70% reduce 22%
21/06/14 23:21:59 INFO mapreduce.Job:  map 75% reduce 22%
21/06/14 23:22:01 INFO mapreduce.Job:  map 80% reduce 22%
21/06/14 23:22:02 INFO mapreduce.Job:  map 80% reduce 25%
21/06/14 23:22:03 INFO mapreduce.Job:  map 85% reduce 25%
21/06/14 23:22:04 INFO mapreduce.Job:  map 90% reduce 25%
21/06/14 23:22:05 INFO mapreduce.Job:  map 95% reduce 28%
21/06/14 23:22:07 INFO mapreduce.Job:  map 100% reduce 28%
21/06/14 23:22:08 INFO mapreduce.Job:  map 100% reduce 49%
21/06/14 23:22:11 INFO mapreduce.Job:  map 100% reduce 88%
21/06/14 23:22:15 INFO mapreduce.Job:  map 100% reduce 100%
21/06/14 23:22:15 INFO mapreduce.Job: Job job_1623677312744_0009 completed successfully
21/06/14 23:22:15 INFO mapreduce.Job: Counters: 51
    File System Counters
        FILE: Number of bytes read=691637161
        FILE: Number of bytes written=1387314630
        FILE: Number of read operations=0
        FILE: Number of large read operations=0
        FILE: Number of write operations=0
        HDFS: Number of bytes read=588290823
        HDFS: Number of bytes written=747948798
        HDFS: Number of read operations=110
        HDFS: Number of large read operations=0
        HDFS: Number of write operations=6
    Job Counters 
        Killed map tasks=1
        Launched map tasks=20
        Launched reduce tasks=2
        Data-local map tasks=20
        Total time spent by all maps in occupied slots (ms)=278451
        Total time spent by all reduces in occupied slots (ms)=79375
        Total time spent by all map tasks (ms)=278451
        Total time spent by all reduce tasks (ms)=79375
        Total vcore-milliseconds taken by all map tasks=278451
        Total vcore-milliseconds taken by all reduce tasks=79375
        Total megabyte-milliseconds taken by all map tasks=285133824
        Total megabyte-milliseconds taken by all reduce tasks=81280000
    Map-Reduce Framework
        Map input records=376983
        Map output records=376982
        Map output bytes=690129215
        Map output materialized bytes=691637383
        Input split bytes=3080
        Combine input records=376982
        Combine output records=376982
        Reduce input groups=376982
        Reduce shuffle bytes=691637383
        Reduce input records=376982
        Reduce output records=3769820
        Spilled Records=753964
        Shuffled Maps =40
        Failed Shuffles=0
        Merged Map outputs=40
        GC time elapsed (ms)=27016
        CPU time spent (ms)=275100
        Physical memory (bytes) snapshot=12720193536
        Virtual memory (bytes) snapshot=61996007424
        Total committed heap usage (bytes)=11068768256
    ImportTsv
        Bad Lines=1
    Shuffle Errors
        BAD_ID=0
        CONNECTION=0
        IO_ERROR=0
        WRONG_LENGTH=0
        WRONG_MAP=0
        WRONG_REDUCE=0
    File Input Format Counters 
        Bytes Read=588284163
    File Output Format Counters 
        Bytes Written=747948798
[root@bigdata-cdh01 ~]#

将HFILE文件加载到表中

HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase mapredcp`:${HBASE_HOME}/conf ${HADOOP_HOME}/bin/yarn jar ${HBASE_HOME}/lib/hbase-server-1.2.0-cdh5.14.0.jar \
completebulkload \
hdfs://192.168.1.140:8020/datas/output_hfile/tbl_logs \
tbl_logs

执行结果

[root@bigdata-cdh01 ~]# HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase mapredcp`:${HBASE_HOME}/conf ${HADOOP_HOME}/bin/yarn jar ${HBASE_HOME}/lib/hbase-server-1.2.0-cdh5.14.0.jar \
> completebulkload \
> hdfs://192.168.1.140:8020/datas/output_hfile/tbl_logs \
> tbl_logs
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/export/servers/hbase-1.2.0-cdh5.14.0/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
21/06/14 23:30:54 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x4da855dd connecting to ZooKeeper ensemble=bigdata-cdh01.itcast.cn:2181
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-cdh5.14.0--1, built on 01/06/2018 21:24 GMT
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Client environment:host.name=bigdata-cdh01.itcast.cn
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Client environment:java.version=1.8.0_141
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Client environment:java.home=/export/servers/jdk1.8.0_141/jre
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/export/servers/hadoop-2.6.0-cdh5.14.0/etc/hadoop:/export/servers/hadoop-2.6.0-cdh5.14.0/etc/hadoop:/export/servers/hadoop-2.6.0-cdh5.14.0/etc/hadoop:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-collections-3.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-httpclient-3.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/activation-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/curator-client-2.7.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/httpcore-4.2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-codec-1.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-beanutils-1.9.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/netty-3.10.5.Final.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/guava-11.0.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jersey-core-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/htrace-core4-4.0.1-incubating.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-el-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/zookeeper-3.4.5-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/junit-4.11.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-lang-2.6.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jsp-api-2.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/hadoop-auth-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/hadoop-annotations-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/paranamer-2.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jetty-util-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/log4j-1.2.17.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/xmlenc-0.52.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jersey-json-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/xz-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/gson-2.2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jetty-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-logging-1.1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jsr305-3.0.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jettison-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/httpclient-4.2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/stax-api-1.0-2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/curator-framework-2.7.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-cli-1.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jsch-0.1.42.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-io-2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/asm-3.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/avro-1.7.6-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/logredactor-1.0.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jets3t-0.9.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-digester-1.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/hamcrest-core-1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-net-3.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jersey-server-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/servlet-api-2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/lib/commons-configuration-1.6.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/hadoop-common-2.6.0-cdh5.14.0-tests.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/hadoop-nfs-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/common/hadoop-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/netty-3.10.5.Final.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/htrace-core4-4.0.1-incubating.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-el-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jetty-util-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jetty-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/commons-io-2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/asm-3.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/hadoop-hdfs-nfs-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/hadoop-hdfs-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/hdfs/hadoop-hdfs-2.6.0-cdh5.14.0-tests.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/activation-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-codec-1.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guava-11.0.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-core-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/javax.inject-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/zookeeper-3.4.5-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-lang-2.6.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-client-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-xc-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jetty-util-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/log4j-1.2.17.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-json-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/xz-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jetty-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jettison-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guice-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-cli-1.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-io-2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/asm-3.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jline-2.11.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-server-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/servlet-api-2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-jaxrs-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-client-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-api-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-registry-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/netty-3.10.5.Final.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/junit-4.11.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/avro-1.7.6-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-nativetask-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.14.0-tests.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.6.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-client-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-server-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-prefix-tree-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/htrace-core-3.2.0-incubating.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-common-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/zookeeper-3.4.5-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/guava-12.0.1.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-hadoop-compat-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/netty-all-4.0.23.Final.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/hbase-protocol-1.2.0-cdh5.14.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/protobuf-java-2.5.0.jar:/export/servers/hbase-1.2.0-cdh5.14.0/lib/metrics-core-2.2.0.jar:/export/servers/hbase/conf:/export/servers/hadoop/contrib/capacity-scheduler/*.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-common-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-client-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-api-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/hadoop-yarn-registry-2.6.0-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/activation-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-codec-1.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guava-11.0.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-core-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/javax.inject-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/zookeeper-3.4.5-cdh5.14.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-lang-2.6.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-client-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-xc-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jetty-util-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/log4j-1.2.17.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-json-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/xz-1.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jetty-6.1.26.cloudera.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jettison-1.1.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guice-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-cli-1.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/commons-io-2.4.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/asm-3.2.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jline-2.11.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jersey-server-1.9.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/servlet-api-2.5.jar:/export/servers/hadoop-2.6.0-cdh5.14.0/share/hadoop/yarn/lib/jackson-jaxrs-1.8.8.jar
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/export/servers/hadoop-2.6.0-cdh5.14.0/lib/native
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-696.el6.x86_64
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Client environment:user.name=root
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Client environment:user.home=/root
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Client environment:user.dir=/root
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=bigdata-cdh01.itcast.cn:2181 sessionTimeout=90000 watcher=hconnection-0x4da855dd0x0, quorum=bigdata-cdh01.itcast.cn:2181, baseZNode=/hbase
21/06/14 23:30:54 INFO zookeeper.ClientCnxn: Opening socket connection to server bigdata-cdh01.itcast.cn/192.168.1.140:2181. Will not attempt to authenticate using SASL (unknown error)
21/06/14 23:30:54 INFO zookeeper.ClientCnxn: Socket connection established, initiating session, client: /192.168.1.140:60714, server: bigdata-cdh01.itcast.cn/192.168.1.140:2181
21/06/14 23:30:54 INFO zookeeper.ClientCnxn: Session establishment complete on server bigdata-cdh01.itcast.cn/192.168.1.140:2181, sessionid = 0x17a0ab8f8d50049, negotiated timeout = 40000
21/06/14 23:30:54 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x5e8c34a0 connecting to ZooKeeper ensemble=bigdata-cdh01.itcast.cn:2181
21/06/14 23:30:54 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=bigdata-cdh01.itcast.cn:2181 sessionTimeout=90000 watcher=hconnection-0x5e8c34a00x0, quorum=bigdata-cdh01.itcast.cn:2181, baseZNode=/hbase
21/06/14 23:30:54 INFO zookeeper.ClientCnxn: Opening socket connection to server bigdata-cdh01.itcast.cn/192.168.1.140:2181. Will not attempt to authenticate using SASL (unknown error)
21/06/14 23:30:54 INFO zookeeper.ClientCnxn: Socket connection established, initiating session, client: /192.168.1.140:60718, server: bigdata-cdh01.itcast.cn/192.168.1.140:2181
21/06/14 23:30:54 INFO zookeeper.ClientCnxn: Session establishment complete on server bigdata-cdh01.itcast.cn/192.168.1.140:2181, sessionid = 0x17a0ab8f8d5004a, negotiated timeout = 40000
21/06/14 23:30:54 WARN mapreduce.LoadIncrementalHFiles: Skipping non-directory hdfs://192.168.1.140:8020/datas/output_hfile/tbl_logs/_SUCCESS
21/06/14 23:30:54 INFO Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available
21/06/14 23:30:55 INFO hfile.CacheConfig: CacheConfig:disabled
21/06/14 23:30:55 INFO hfile.CacheConfig: CacheConfig:disabled
21/06/14 23:30:55 INFO mapreduce.LoadIncrementalHFiles: Trying to load hfile=hdfs://192.168.1.140:8020/datas/output_hfile/tbl_logs/detail/c5523833ee604c60a87e58f272db9f6f first=189394 last=99999
21/06/14 23:30:55 INFO mapreduce.LoadIncrementalHFiles: Trying to load hfile=hdfs://192.168.1.140:8020/datas/output_hfile/tbl_logs/detail/bae006c824af49f0aa3788e8fea95e42 first=1 last=189393
21/06/14 23:30:56 INFO client.ConnectionManager$HConnectionImplementation: Closing master protocol: MasterService
21/06/14 23:30:56 INFO client.ConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x17a0ab8f8d5004a
21/06/14 23:30:56 INFO zookeeper.ZooKeeper: Session: 0x17a0ab8f8d5004a closed
21/06/14 23:30:56 INFO zookeeper.ClientCnxn: EventThread shut down
[root@bigdata-cdh01 ~]#

讲hdfs中的数据导入到hbase中通过importtsv
1. 通过importtsv 命令将hdfs 数据导入到hbase 中命令：将hdfs文件转变为hfile 文...
尚硅谷大数据技术之Sqoop
5.2.5 命令&参数：import将关系型数据库中的数据导入到HDFS（包括Hive，HBase）中，如果导入的...
四、Hbase数据导入
1、利用ImportTsv将csv文件导入到HBase 2、步骤：
HBase数据导入-ImportTsv
ImportTsv进行数据导入有两种方式： ImportTsv介绍将数据导入HBase，通常HBase用户会使用...
Hive 大表数据导入 HBase
本文简单介绍 HBase 的数据导入工具 ImportTSV 。通过一次将 hive 大表导入 HBase 的实战...
Hbase设计原则
Hbase存储架构 Hbase通过元数据信息来管理,数据都是通过ReginServer存储在HDFS上 Hbase...
Hbase教程：通过BulkLoad快速将海量数据导入到Hbas
本文将针对这个问题介绍如何通过Hbase的BulkLoad方法来快速将海量数据导入到Hbase中。在第一次建立H...
Sqoop基础（二）导入，导出，创建job
全量将mysql数据导入到HDFS中。其中--target-dir 可以用来指定导出数据存放至HDFS的目录。 ...
HBase数据的删除和更新
当删除HBase中的数据，HBase会删除存储在HDFS上的数据，而Hadoop的Sequence File是一个...
个人总结-Sqoop
一、从rdbms导入到hdfs中 1、一 import（从rdbms导入到hdfs中）可选参数默认使用as-t...

讲hdfs中的数据导入到hbase中通过importtsv

1. 通过importtsv 命令将hdfs 数据导入到hbase 中

相关文章

讲hdfs中的数据导入到hbase中通过importtsv

尚硅谷大数据技术之Sqoop

四、Hbase数据导入

HBase数据导入-ImportTsv

Hive 大表数据导入 HBase

Hbase设计原则

Hbase教程：通过BulkLoad快速将海量数据导入到Hbas

Sqoop基础（二）导入，导出，创建job

HBase数据的删除和更新

个人总结-Sqoop

网友评论

延伸阅读

深度阅读

栏目导航

热点阅读