Apache Flume stopped streaming Twitter data after Twitter API SSL/TLS mandatory requirements.

Question

I have followed cloudera's tutorial (http://blog.cloudera.com/blog/2012/09/analyzing-twitter-data-with-hadoop/) for an application to ingest twitter data into HDFS using Apache Flume. Twitter has restricted its api connection to SSL/TLS only with effect from 15th January 2014. After this change my Flume agent has stopped streaming the twitter data. Kindly reply if you have already implemented the respective changes to cater for new requirements based on specs in follwoing article. https://dev.twitter.com/docs/security/using-ssl

Thanks, Hussnain

Answer 1

issue got resolved after I installed newer version of twitter4j i.e v 3.0.3 that is using HTTPS. For reference see
jira.twitter4j.org/browse/TFJ-632
and comments on

http://www.datadansandler.com/2013/03/making-clouderas-twitter-stream-real.html?showComment=1390047763159#c8713000610110252026