You might also look into using a scriptable browser. I think the
Mozilla organization has
something along these lines.
On Dec 17, 2005, at 11:16 AM, Christopher Hart wrote:
There are also JavaScript engines available in C and Java
(SpiderMonkey and Rhino, respectively, available on mozilla.org). You
may be able to leverage those.
Chris
On 12/17/05, Bjoern Hoehrmann <derhoermi@xxxxxxx> wrote:
* webmaster@xxxxxxxxxxx wrote:
I am working on a http agent which harvests various products and
prices on
a number of websites. The problem I run into is that some sites use
javascript.
There is Win32::IE::Mechanize.
After downloading a web page from my perl script, what I want to
do is:
1. Execute any existing javascript on the page.
2. Modify the page according to the javascript results.
3. Save the page to a local file.
Note that the scripts might not terminate, so you might get the DOM
at a specific point, but there is not necessarily a specific result.
--
Björn Höhrmann · mailto:bjoern@xxxxxxxxxxxx · http://
bjoern.hoehrmann.de
Weinh. Str. 22 · Telefon: +49(0)621/4309674 · http://
www.bjoernsworld.de
68309 Mannheim · PGP Pub. KeyID: 0xA4357E78 · http://
www.websitedev.de/
|
