Python browser emulator with JS support [closed]

Question

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.

---

We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.

Closed 4 years ago.

Improve this question

I want to grab some data from a site. Usually I use mechanize for such things, but now the site gives the data with JS. Alas, mechanize doesn't support it.

What can I use instead?

Answer 1

Here are some options:

1. Selenium (tutorial)
   • For headless automation, Selenium can be used in conjunction with PhantomJS
2. WebKit
3. Spidermonkey

Here are some code examples:

• PyQt4 + WebKit
• An example using PyQt4+WebKit, and redone with Selenium