hi

is there any way I can scrape web pages that uses AJAX using something like ruby + mechanize on linode.

http://watir.com/ would be a solution but I guess not applicable to linode.

Thank you

R

Probably. Figure out what the application is doing to get the data you want, and then do that. AJAX isn't magic; there's still HTTP under the hood.

_________________

/* TODO: need to add signature to posts */

sounds interesting!

I am not the author of the AJAX code so do you think that 'analysing HTTP' traffic let's say using firebug would do the job?

thank you

R

Perhaps. It depends a lot on the application and what you want to do... it can be a fun way to use tools in ways you don't normally use them, at the very least.

Firebug will probably get you moving; Wireshark is good to play with, as well.

_________________

/* TODO: need to add signature to posts */

the first step will be to just to scrape (get) data, next one modify/enter data

yep, you're completely right. It sounds really exciting ... also because I know nothing about it right now ...


I think I installed Wireshark once and didn't get how it works

Thank you

R.