error in streaming twitter data to Hadoop using flume error in streaming twitter data to Hadoop using flume hadoop hadoop

error in streaming twitter data to Hadoop using flume


I found a solution to this issue. As flume-sources-1.0-SNAPSHOT.jar and twitter4j-stream-3.0.3.jar contains the same FilterQuery.class, there arises a jar conflict. All twitter4j-3.x.x uses this class so it would be better to download twitter jars of version 2.2.6(twitter4j-core,twitter4j-stream,twitter4j-media-support) and replace 3.x.x with these newly downloaded jars under flume/lib directory.

Run the agent again and twitter data will be streamed to HDFS.


ChangeTwitter-agent.sources.source1.type=com.cloudera.flume.source.TwitterSourcewith TwitterAgent.sources.Twitter.type = org.apache.flume.source.twitter.TwitterSource