need help :navigate to next page.
hi
i am using screen scraper for extracting data from webpage.i am stuck when i need to go to second page of search result.
The website is in ASP.NET .form tutoral i came to know that it is possible to navigate to next page if you have next page link.and you can grab that link by extracting it from that webpage.but in my website there is not a link to next page i means to say that as the site is in ASP.NET,the address of next page in that website is as follow
javascript:__doPostBack('ctl00$C1$pag2$lnkPage2','')
its an java script funcation.now any one tell me how to go to next page in this situation.????
need help :navigate to next page.
bhavin12300,
ASP.net sites can be tricky. They don't follow the standards or conventions of other sites. However, they do comply with HTTP standards (because they have to) and it's these standards that you only need to worry about.
So, proxy the site and pay close attention to the values being passed as post parameters. You'll need to grab those values from the page that precedes the page you're posting to. These sites can be very finicky about passing the correct referrer. So, just make sure you traverse your scrapeable files in the order you navigated site.
Please the following posts, as well.
http://www.screen-scraper.com/forum/phpBB2/viewtopic.php?t=414
http://www.screen-scraper.com/forum/phpBB2/viewtopic.php?t=1149
Hope that helps,
Scott