美文网首页
Ambari Building

Ambari Building

作者: 闪电工程师 | 来源:发表于2018-07-05 18:21 被阅读0次

版本信息

NAME VERSION
OS Centos6.7
Ambari 2.5.2
Maven 3.3.9
Node 4.5.0
Python 2.6.6
git 2.9.5
jdk 1.8.0_121

准备环境

JDK

JDK 8 (Ambari 2.6 and below can be compiled with JDK 7, from Ambari 2.7, it can be compiled with at least JDK 8)

环境配置

export JAVA_HOME=/opt/soft/jdk1.8.0_121
export _JAVA_OPTIONS="-Xmx2048m -XX:MaxPermSize=512m -Djava.awt.headless=true"
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/tools.jar
export PATH=$JAVA_HOME/bin:$PATH

测试

 java -version

Maven

Apache Maven 3.3.9 or later

环境配置

export MAVEN_HOME=/opt/soft/apache-maven-3.3.9
export PATH=$MAVEN_HOME/bin:$PATH

测试

 mvn -version

设置Mirrors

    <mirror>
        <id>alimaven</id>
        <mirrorOf>central</mirrorOf>
        <name>aliyun maven</name>
        <url>http://maven.aliyun.com/nexus/content/repositories/central/</url>
    </mirror>
    <mirror>
        <id>maven2</id>
        <mirrorOf>central</mirrorOf>
        <name>central maven2</name>
        <url>http://central.maven.org/maven2/</url>
    </mirror>

Python setuptools

wget https://pypi.python.org/packages/2.6/s/setuptools/setuptools-0.6c11-py2.6.egg
sh setuptools-0.6c11-py2.6.egg

Python-dev

yum -y install python-devel.x86_64

rpmbuild

yum install -y rpm-build

g++

yum install -y gcc-c++

Nodejs

node 4.5.0
环境配置

export NODE_HOME=/opt/soft/node-v4.5.0-linux-x64
export PATH=$NODE_HOME/bin::$PATH

测试

node -v
npm -v

更新 git

  • 卸载旧版本
yum remove git
tar zxvf git-2.9.5.tar.gz
cd git-2.9.5
make prefix=/usr/local/git all
make prefix=/usr/local/git install
export PATH=/usr/local/git/bin:$PATH
yum update -y nss curl libcurl
git --version

下载 Ambari

git clone https://github.com/apache/ambari.git
cd ambari
# checkout tag
git checkout release-2.5.2

修改 storm version

由于依赖的stom的版本没有下载源,需要修改其版本。

vi ambari/ambari-metrics/ambari-metrics-storm-sink/pom.xml
<properties>
/** <storm.version>1.1.0-SNAPSHOT</storm.version> **/
    <storm.version>1.1.0</storm.version>
</properties>

修改Ambari Metrics pom.xml(非必要)

在编译 Metrics中的模块时需要下载 hortonworks 版本的hbase、hadoop、phoenix,下载的过程非常慢,可以预先下载好,放入本地文件服务器中,加快编译速度。

vim ambari/ambari-metrics/pom.xml
修改项如下:
    <hbase.tar>http://private-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.3.4.0-3347/tars/hbase-1.1.2.2.3.4.0-3347.tar.gz</hbase.tar>
    <hadoop.tar>http://private-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.3.4.0-3347/tars/hadoop-2.7.1.2.3.4.0-3347.tar.gz</hadoop.tar>
    <grafana.tar>https://grafanarel.s3.amazonaws.com/builds/grafana-2.6.0.linux-x64.tar.gz</grafana.tar>
    <phoenix.tar>http://private-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.3.4.0-3347/tars/phoenix-4.4.0.2.3.4.0-3347.tar.gz</phoenix.tar>

Building Ambari

mvn -B clean install package rpm:rpm -DnewVersion=2.5.2.0-298 -DskipTests -Dpython.ver="python >= 2.6" -Preplaceurl

build 成功:
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Ambari Main ........................................ SUCCESS [ 16.375 s]
[INFO] Apache Ambari Project POM .......................... SUCCESS [  0.480 s]
[INFO] Ambari Web ......................................... SUCCESS [02:04 min]
[INFO] Ambari Views ....................................... SUCCESS [  4.754 s]
[INFO] Ambari Admin View .................................. SUCCESS [ 43.821 s]
[INFO] utility ............................................ SUCCESS [  1.284 s]
[INFO] ambari-metrics ..................................... SUCCESS [  1.895 s]
[INFO] Ambari Metrics Common .............................. SUCCESS [ 14.881 s]
[INFO] Ambari Metrics Hadoop Sink ......................... SUCCESS [  7.595 s]
[INFO] Ambari Metrics Flume Sink .......................... SUCCESS [  5.671 s]
[INFO] Ambari Metrics Kafka Sink .......................... SUCCESS [  5.318 s]
[INFO] Ambari Metrics Storm Sink .......................... SUCCESS [ 10.031 s]
[INFO] Ambari Metrics Storm Sink Legacy.................... SUCCESS [  5.966 s]
[INFO] Ambari Metrics Collector ........................... SUCCESS [02:26 min]
[INFO] Ambari Metrics Monitor ............................. SUCCESS [  4.017 s]
[INFO] Ambari Metrics Grafana ............................. SUCCESS [  2.806 s]
[INFO] Ambari Metrics Assembly ............................ SUCCESS [02:40 min]
[INFO] Ambari Server ...................................... SUCCESS [10:01 min]
[INFO] Ambari Functional Tests ............................ SUCCESS [  6.532 s]
[INFO] Ambari Agent ....................................... SUCCESS [03:03 min]
[INFO] Ambari Client ...................................... SUCCESS [  0.277 s]
[INFO] Ambari Python Client ............................... SUCCESS [  2.913 s]
[INFO] Ambari Groovy Client ............................... SUCCESS [  6.299 s]
[INFO] Ambari Shell ....................................... SUCCESS [  0.308 s]
[INFO] Ambari Python Shell ................................ SUCCESS [  1.578 s]
[INFO] Ambari Groovy Shell ................................ SUCCESS [  2.871 s]
[INFO] ambari-logsearch ................................... SUCCESS [  0.446 s]
[INFO] Ambari Logsearch Appender .......................... SUCCESS [  0.564 s]
[INFO] Ambari Logsearch Portal ............................ SUCCESS [10:41 min]
[INFO] Ambari Logsearch Log Feeder ........................ SUCCESS [05:49 min]
[INFO] Ambari Logsearch Solr Client ....................... SUCCESS [  2.983 s]
[INFO] Ambari Infra Solr Plugin ........................... SUCCESS [07:42 min]
[INFO] Ambari Logsearch Assembly .......................... SUCCESS [  0.297 s]
[INFO] Ambari Logsearch Integration Test .................. SUCCESS [04:12 min]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 51:14 min
[INFO] Finished at: 2018-07-05T03:19:53-07:00
[INFO] Final Memory: 281M/1212M
[INFO] ------------------------------------------------------------------------

参考文档

相关文章

网友评论

      本文标题:Ambari Building

      本文链接:https://www.haomeiwen.com/subject/rzwuuftx.html