Problem with Next link -recursively get the same page
Hello!
I am a beginner to screen scraper. I am trying to scrape an asp page. I followed the instruction from Tutorial 2 to make the Next link but I have obtained recursively the same page.
Example: I have one variable called PAGE. When the PAGE variable changes and have the value 3, the link for the next page remains always the same (...Results.aspx?Page=2). Please help me.
Regards,
Roxi
With aspx pages you typically
With aspx pages you typically have to also scrape the viewstate from the page and pass this as a post parameter. I recommend using the screen-scraper proxy to see exactly what is going on in page navigation.
Me too have the same problem.
How can we solve it?
The pages are in .aspx
You'll need to proxy the page
You'll need to proxy the page navigation using screen-scraper's proxy and look for the post parameters. Next you'll need to build an extractor pattern to capture these parameters on the previous page and save them as session variables. Last, input those saved variables into the post parameters of the next requested page.
The viewstate and event validation from the previous page will give you permission to access the next page.