Flume源码导入IDEA

作者: 喵星人ZC | 来源:发表于2019-06-16 17:52 被阅读0次

1、下载flume-ng-1.6.0-cdh5.7.0-src.tar.gz
地址：http://archive.cloudera.com/cdh5/cdh/5/flume-ng-1.6.0-cdh5.7.0-src.tar.gz

2、win安装好maven-3.3.9

3、解压flume-ng-1.6.0-cdh5.7.0-src.tar.gz并进入解压路径

4、编译：mvn clean compile
报错

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-enforcer-plugin:1.0:enforce (clean) on project flume-parent: Some Enforcer rules have failed. Look above for specific messages explaining
why the rule failed. -> [Help 1]

换成以下编译命令，跳过enforcer
mvn clean compile validate -Denforcer.skip=true

报错

[ERROR] Failed to execute goal on project flume-ng-morphline-solr-sink: Could not resolve dependencies for project org.apache.flume.flume-ng-sinks:flume-ng-morphline-solr-sink:jar:1.6.0-cdh5.7.0: Fail
ed to collect dependencies at org.kitesdk:kite-morphlines-all:pom:1.0.0-cdh5.7.0 -> org.kitesdk:kite-morphlines-useragent:jar:1.0.0-cdh5.7.0 -> ua_parser:ua-parser:jar:1.3.0: Failed to read artifact d
escriptor for ua_parser:ua-parser:jar:1.3.0: Could not transfer artifact ua_parser:ua-parser:pom:1.3.0 from/to maven-twttr (http://maven.twttr.com): Connect to maven.twttr.com:80 [maven.twttr.com/31.1
3.83.8] failed: Connection timed out: connect -> [Help 1]

flume-ng-morphline-solr-sink我们用不到，可以直接注释掉，在flume-ng-sinks下的pom中找到并注释

 <modules>
    <module>flume-hdfs-sink</module>
    <module>flume-irc-sink</module>
    <module>flume-ng-hbase-sink</module>
    <module>flume-ng-elasticsearch-sink</module>
    <!--<module>flume-ng-morphline-solr-sink</module> -->
    <module>flume-ng-kafka-sink</module>
  </modules>

然后重新编译mvn clean compile validate -Denforcer.skip=true，成功