Scaping confusing Ajax? site
Hi
I am attempting to scrape this site: http://davidevansagricultural.co.uk.temp.realssl.com/Used/UsedTractors/tabid/67/Default.aspx
I can see the html for the results page, (above) and I can see the data I want to take out of each of the relevant product detail pages here for example:
http://davidevansagricultural.co.uk.temp.realssl.com/Used/UsedTractors/tabid/67/ctl/Detail/mid/469/xmid/870/xmfid/7/Default.aspx
But I cannot find how to get the post data to create the link from the search results page to the product detail page.
I am sure that I'm missing something basic - I've run it through the proxy and I can't even find the 870 (in the URL example above) anywhere!
Help Please!!?
Jason
I proxied that page, and they
I proxied that page, and they are using POST data that is not in key/value pairs, so you need to use setRequestEntity to make the POST look like theirs.
setRequestEntity Help
I have tried to understand your comment and I don't understand where in the process I have get the POST information and where I put it - in a script or as a parameter or something similar?
The link I sent will run in a
The link I sent will run in a script. Did you see the instructions and example here http://community.screen-scraper.com/documentation/api/scrapeablefile/setrequestentity?