Download Stack Overflow data for a research project

Question

I would like to download the Stack Overflow data for a data mining research project. I tried the SQL interface at data.stackexchange.com, but the downloading process was not obvious since the result of any SQL query is limited to 50,000 rows only.

Is there any efficient way to download the data?

Answer 1

You can grab the latest data dump as well.

Note that these are basically in XML, so you will likely need to import it to your database of choice. Here are a couple links to help with that:

• Scripts to convert data-dump to other formats
• https://meta.stackexchange.com/questions/44330/do-you-want-to-quickly-and-easily-import-the-so-data-dump-into-your-sql-server

Answer 2

Check this blog post, the Machine Learning Contest has a large dataset available for download.