3
votes

I want to grab some data from a site. Usually I use mechanize for such things, but now the site gives the data with JS. Alas, mechanize doesn't support it.

What can I use instead?

1
Can you show some example data? - msvalkon
For example, this one: apps.who.int/trialsearch/AdvSearch.aspx There you can select ALL in Recruitment status is and Novartis on Primary Sponsor. Then, when we submit it as a POST form, it gives us the data with JS paging. - Felix

1 Answers

9
votes

Here are some options:

  1. Selenium (tutorial)
    • For headless automation, Selenium can be used in conjunction with PhantomJS
  2. WebKit
  3. Spidermonkey

Here are some code examples: