Headless Browser and scraping - solutions [closed]
If Ruby is your thing, you may also try:
- https://github.com/chriskite/anemone (dev stopped)
- https://github.com/sparklemotion/mechanize
- https://github.com/postmodern/spidr
- https://github.com/stewartmckee/cobweb
- http://watirwebdriver.com/ (Selenium)
also, Nokogiri gem can be used for scraping:
there is a dedicated book about how to utilise nokogiri for scraping by packt publishing
A kind of JS-based Selenium is Dalek.js. It not only aims for automated frontend-tests, you can also do screenshots with it. It has webdrivers for all important browsers. Unfortunately those webdrivers seem to be worth improving (just not to say "buggy" to Firefox).