Retrieve large amount of data from REST API GitHub

StackOverflow https://stackoverflow.com/questions/22334247

  •  13-06-2023
  •  | 
  •  

Question

How to retrieve large amount of data from REST API GitHub? Nowadays it provided only a small amount of data JSON from GitHub timeline, in many cases limited to only 300 events. I need a bigger volume to work in my Master Research and i need to know how to via the REST API.

Was it helpful?

Solution

github's api (and most IMHO good apis) use pagination to reduce load on themselves and clients. you could write a simple script to go through all the "pages" of results one at a time, then combine your results after the fact locally.

more info here: http://developer.github.com/guides/traversing-with-pagination/

Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top