html - Web Crawler with JavaScript support in Perl?

Question

I want to code a perl application that would crawl some websites and collect images and links from such webpages. Because the most of pages use JavaScript that generate a HTML content, I need to code quasi a client browser with JavaScript support to be able to parse a final HTML code that is generated and/or modified by JavaScript. What are my options?

If possible, please publish some implementation code or link to some example(s).

Answer 1

There are several options.

• Win32::IE::Mechanize on Windows
• Mozilla::Mechanize
• WWW::Mechanize::Firefox
• WWW::Selenium
• Wight