How to get all Twitter links?

StackOverflow https://stackoverflow.com/questions/1220129

  •  10-07-2019
  •  | 
  •  

Question

There are lots of sites offering additional services to Twitter:

  • hashtags.org
  • tweetmeme.com
  • repeets.com
  • dailyrt.com
  • backtweets.com

They all have something in common: They seem to get all updates from Twitter. Otherwise, they couldn't offer such complex services with high quality results.

But how do they do this? Twitter has a XMPP feed (Firehose) but not everybody is allowed to get data from it.

Are there any approaches you can recommend or which you think they are using? The normal API is limited too much, isn't it?

Was it helpful?

Solution

Twitter has a new Streaming API which it looks like anyone can access, it's still under alpha but this is what tweetmeme.com is probably using.

OTHER TIPS

Quoted from http://apiwiki.twitter.com/Rate-limiting

Whitelisting

Some applications find that the default limit proves insufficient. Under such circumstances, we offer whitelisting. It is possible to whitelist both accounts and IP addresses. Each whitelisted entity, whether an account or IP address, is allowed 20000 requests per hour. If you are developing an application that should be considered for whitelisting, please fill out the whitelisting request form. Our manual review process can take up to a week. If you have a whitelisting that needs to be updated through the addition or removal of IP addresses, reapply with an explanation of the change. Approval or rejection for whitelisting requests is emailed to the email address associated with the account that filed the application.

Check out tweetSharp http://tweetsharp.com/. It's a .Net library that makes accessing the Twitter API much easier. I've used it in a little app to search Tweets for the name of the my company. There's also a dnrTV episode if you want to find out more.

I'm not quite sure what you mean by

"The normal API is limited too much"

You certainly don't have access to all tweets going back to the start, but as I understand it there's definitely enough in there to build a pretty decent Twitter client.

Check out Twitterizer. It's way easier than any other Twitter ASP.NET library I've ever used.

Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top