CDH大数据安装手册--cdh安装

作者: SmartNewSexy | 来源:发表于2019-01-14 11:15 被阅读0次

Cloudera Manager安装

以下步骤在1号机(host1)上进行。

--安装cm自带oracle-j2sdk

sudo yum install -y oracle-j2sdk1.7

--安装Cloudera Manager

sudo yum install -y cloudera-manager-daemons cloudera-manager-server

--配置Cloudera Manager数据库。注意，cm数据库在mysql配置时已建立。数据库名和用户名均为cm，密码为<参考前面密码>。msql所在服务器hostname为mysql-host。

/usr/share/cmf/schema/scm_prepare_database.sh mysql -h mysql-host -P 3306 cm cm password

参考结果：

[root@ha-node1 cdh5.11.2]# /usr/share/cmf/schema/scm_prepare_database.sh mysql -h mysql-host -P 3306 cm cm password

JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera

Verifying that we can write to /etc/cloudera-scm-server

Creating SCM configuration file in /etc/cloudera-scm-server

Executing: /usr/java/jdk1.7.0_67-cloudera/bin/java -cp /usr/share/java/mysql-connector-java.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/schema/../lib/* com.cloudera.enterprise.dbutil.DbCommandExecutor /etc/cloudera-scm-server/db.properties com.cloudera.cmf.db.

[main] DbCommandExecutor INFO Successfully connected to database.

All done, your SCM database is configured correctly!

--启动Cloudera Manager

sudo service cloudera-scm-server start

监测启动进程日志

tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log

直至出现以下信息，表示Cloudera Manager已成功启动。

2018-05-05 15:55:08,469 INFO WebServerImpl:org.mortbay.log: Started SelectChannelConnector@0.0.0.0:7180

2018-05-05 15:55:08,469 INFO WebServerImpl:com.cloudera.server.cmf.WebServerImpl: Started Jetty server.

2018-05-05 15:55:08,522 INFO SearchRepositoryManager-0:com.cloudera.server.web.cmf.search.components.SearchRepositoryManager: Finished constructing repo:2018-05-05T07:55:08.522Z

2018-05-05 15:55:08,843 INFO ScmActive-0:com.cloudera.server.cmf.components.ScmActive: ScmActive completed successfully.

CDH安装和集群配置

--登陆http:// host1:7180, 初始用户密码建议用admin / admin

--选免费版, Cloudera Express

--搜索服务器10.96.109.[1-10]，根据需要更改。

--配置parcel url http://host1/cm/cdh5.11.2/ 。注意host1是httpd yum源服务器。同时配置cloudera manager agent使用同一yum源，http://host1/cm/

如下图所示，先移除所有外部parcel路径。然后增加http://host1/cm/cdh5.11.2/

Parcel directory, local parcel directory均用预设值，不需要修改。

( 注：parcel为CDH的建议安装包格式。官方下载路径为https://archive.cloudera.com/cdh5/parcels/5.11.2/ , Centos7.4所需的parcel为CDH-5.11.2-1.cdh5.11.2.p0.4-el7.parcel 。可以预先下载并放于httpd服务内，即http://host1/cm/cdh5.11.2/ )