本篇也是呈接上前的博文来的,从日期上也看得出,是同一天哈。疫情期间,楼下核酸检测,又逢下队排队,所以测试下大数据是很合适的。
一, hive搭建
仍然是如下URL:
https://www.jianshu.com/p/f69268fa14dd
二,首次下载及运行docker
docker run --name hue -d -p 8888:8888 gethue/hue
三,取出hue.ini,然后编辑一下hive的地址端口
如果有自定义的,自行修改。thrift版本不对,下降为7,如果要操作hdfs的yarn的,也要开放并修改端口。(这点我没有作)
# Settings to configure Beeswax with Hive
###########################################################################
[beeswax]
# Host where HiveServer2 is running.
# If Kerberos security is enabled, use fully-qualified domain name (FQDN).
## hive_server_host=localhost
hive_server_host=192.168.1.111
# Binary thrift port for HiveServer2.
## hive_server_port=10000
# Http thrift port for HiveServer2.
## hive_server_http_port=10001
# Host where LLAP is running
## llap_server_host = localhost
# LLAP binary thrift port
## llap_server_port = 10500
# LLAP HTTP Thrift port
## llap_server_thrift_port = 10501
# Alternatively, use Service Discovery for LLAP (Hive Server Interactive) and/or Hiveserver2, this will override server and thrift port
# Whether to use Service Discovery for LLAP
## hive_discovery_llap = true
四,第二次运行hue的docker,加载目录映射。
docker run --name hue -d -p 8888:8888 -v /root/hue/hue.ini:/usr/share/hue/desktop/conf/hue.ini gethue/hue
查看开放的端口
[root@127 hue]# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
097f2ace56cc gethue/hue "./startup.sh" 54 minutes ago Up 54 minutes 0.0.0.0:8888->8888/tcp, :::8888->8888/tcp hue
7c97d9bcb2da bde2020/hive:2.3.2-postgresql-metastore "entrypoint.sh /opt/…" 2 hours ago Up 2 hours 10000/tcp, 0.0.0.0:9083->9083/tcp, :::9083->9083/tcp, 10002/tcp docker-hive_hive-metastore_1
37cfb912841f shawnzhu/prestodb:0.181 "./bin/launcher run" 2 hours ago Up 2 hours 0.0.0.0:8080->8080/tcp, :::8080->8080/tcp docker-hive_presto-coordinator_1
58571bd72d33 bde2020/hive:2.3.2-postgresql-metastore "entrypoint.sh /bin/…" 2 hours ago Up 2 hours 0.0.0.0:10000->10000/tcp, :::10000->10000/tcp, 10002/tcp docker-hive_hive-server_1
47a14affaa1e bde2020/hive-metastore-postgresql:2.3.0 "/docker-entrypoint.…" 2 hours ago Up 2 hours 5432/tcp docker-hive_hive-metastore-postgresql_1
dda59b4646c6 bde2020/hadoop-datanode:2.0.0-hadoop2.7.4-java8 "/entrypoint.sh /run…" 2 hours ago Up 2 hours (healthy) 0.0.0.0:50075->50075/tcp, :::50075->50075/tcp docker-hive_datanode_1
db174842a937 bde2020/hadoop-namenode:2.0.0-hadoop2.7.4-java8 "/entrypoint.sh /run…" 2 hours ago Up 2 hours (healthy) 0.0.0.0:50070->50070/tcp, :::50070->50070/tcp docker-hive_namenode_1
五,WEB端测试

网友评论