Changing page-java;dopostback(the other post didn't help:( )
http://www.usgbc.org/myUSGBC/Members/MembersDirectory.aspx
I've been working with this members list and unfortunately, after reading all of the examples on the forums surrounding the same asp.net style website, i am still unable to figure it all out. If anyone could provide me with some insight as to how to transfer from one page to the next after I've scraped the data from each member individually, that would be awesome! I've got the code almost 100%. I can scrape every member on a single page, but i just need to figure out how to keep going after the first page is done. for search parameters, just search for Canadian companies. Thats what I'm working with.
Changing page-java;dopostback(the other post didn't help:( )
Justin,
Please have a look at a blog entry I recently completed on the topic. Hopefully, it will give you some tools to work with.
http://blog.screen-scraper.com/2008/06/04/scraping-aspnet-sites/
-Scott
Changing page-java;dopostback(the other post didn't help:( )
aspx pages can be a little trick sometimes. The best way is to use screen scrapers proxy server to try to figure out what is going on with the post parameters.
Glancing at your page it looks like you will have to scrape the _VIEWSTATE value (which is a huge messy looking string) from the page and pass it with your other post variables.