Problems getting the page source with urlopen [closed]

Question

This question is unlikely to help any future visitors; it is only relevant to a small geographic area, a specific moment in time, or an extraordinarily narrow situation that is not generally applicable to the worldwide audience of the internet. For help making this question more broadly applicable, visit the help center.

Closed 9 years ago.

The webplayer on this site http://rockantenne.de/webplayer has a playlist available with all the songs played so far on that day.

When I am in Firefox and press Ctrl-U to see the source code of the page I can see all the songs played. However if I use urllib2.urlopen and then read() it, everything is the same except the songs are left out.

Can anyone tell me what is the problem here?

Thanks

Answer 1

The page uses AJAX to load the songlist asynchronously, from http://www.rockantenne.de/webplayer/xml/livesongcache.xml?82321.

Load that URL instead, and parse the returned XML yourself.