Can't read page - SS drops parameters
I'm trying to scrape a category page in asp.net - the url looks like "http://www.example.com/category.aspx?CategoryID=12345". If I type that URL into a browser, I get a particular subcategory page. However, when I scrape it (using 'strict mode' or extracting the parameters) I get the top-level category page, which is the same URL but without any parameters.
Any idea why I can't scrape this page?
AriEng Sorry that it has
AriEng
Sorry that it has taken so long to reply to your post.
The most common problem with asp.net pages is the viewstate. You may need to back up a few pages till you get to a true start page (like one without get or post parameters) and start grabbing the viewstate from that page all the way down to the page you are trying to get to. Remember to save them as session variables and to imput them into the parameter list on the next page (such as ~#VIEW_STATE#~)
Did this help solve your problem?