Question

I'm writing a program to scrape data from IMDB, using an IMDB scraping API. It works wonderfully, yet sometimes.. it just stops. No exception thrown, no error, nothing shown on intellitrace, can't find a reason why it stops. And it's intresting, because the point where it stops is totally random!

So for example.. if I start it, it scrapes data successfully 100 times, but if I restart it, it gets stuck after 50.. I truly don't have an idea why it does this.

If I pause the code if it's stuck, it doesn't write anything (like it would be running normally without any errors), (or I just don't notice it). The green marker on the left is at

IMDb imdb_movie = new IMDb(link, false);

The source code can be found here

Any ideas? Thanks in forward!

Was it helpful?

Solution

This sounds like a bug in the API you are using. I would take it up with the developer or download the class file he provides so that you can debug it yourself. If you installed the DLL without source then you'll get green-arrow during pause while the IDE waits for the external code to complete but if you add the class file to your project then you can step through and see where it is getting stuck.

Also, fundamentally : Why regex is probably a bad idea here...

Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top