美文网首页
Storm整合Kafka:出现的各种问题~

Storm整合Kafka:出现的各种问题~

作者: Sam_L | 来源:发表于2019-03-10 21:16 被阅读0次

1、【报错】
Exception in thread "main" java.lang.NoClassDefFoundError: kafka/api/OffsetRequest

【pom】

<dependency>
  <groupId>org.apache.kafka</groupId>
  <artifactId>kafka_2.11</artifactId>
  <version>0.9.0.0</version>
</dependency>

2、
【报错】
java.lang.NoClassDefFoundError:
org/apache/curator/shaded/com/google/common/cache/CacheBuilder

【pom】

<dependency>
  <groupId>org.apache.curator</groupId>
  <artifactId>curator-client</artifactId>
  <version>2.12.0</version>
</dependency>

3、【报错】
java.lang.NoClassDefFoundError: org/apache/curator/connection/ConnectionHandlingPolicy

<dependency>
  <groupId>org.apache.storm</groupId>
  <artifactId>storm-kafka</artifactId>
  <version>1.1.0</version>
</dependency>

4、【报错】
java.lang.NoClassDefFoundError: Could not initialize class org.apache.log4j.Log4jLoggerFactory
上面有提示:
SLF4J: Detected both log4j-over-slf4j.jar AND slf4j-log4j12.jar on the class path, preempting StackOverflowError.

【官网的解决方式】Using storm-kafka with different versions of Kafka
<dependency>
    <groupId>org.apache.kafka</groupId>
    <artifactId>kafka_2.10</artifactId>
    <version>0.8.1.1</version>
    <exclusions>
        <exclusion>
            <groupId>org.apache.zookeeper</groupId>
            <artifactId>zookeeper</artifactId>
        </exclusion>
        <exclusion>
            <groupId>log4j</groupId>
            <artifactId>log4j</artifactId>
        </exclusion>
    </exclusions>
</dependency>
【第二种----我采用的是这种解决方式,对应自己冲突的jar】
<dependency>
  <groupId>org.apache.kafka</groupId>
  <artifactId>kafka_2.11</artifactId>
  <version>0.9.0.0</version>
  <exclusions>
    <exclusion>
      <groupId>org.slf4j</groupId>
      <artifactId>slf4j-log4j12</artifactId>
    </exclusion>
  </exclusions>
</dependency>

<dependencies>
  <dependency>
    <groupId>org.apache.storm</groupId>
    <artifactId>storm-core</artifactId>
    <version>${storm.version}</version>
    <exclusions>
      <exclusion>
        <groupId>org.slf4j</groupId>
        <artifactId>log4j-over-slf4j</artifactId>
      </exclusion>
      <exclusion>
        <groupId>org.slf4j</groupId>
        <artifactId>slf4j-api</artifactId>
      </exclusion>
    </exclusions>
  </dependency>

相关文章

网友评论

      本文标题:Storm整合Kafka:出现的各种问题~

      本文链接:https://www.haomeiwen.com/subject/zfgppqtx.html