Scraping ASP,NET sites
Hi,
I am struggling with scraping asp.net sites and I have read the blog entry (http://blog.screen-scraper.com/2008/06/04/scraping-aspnet-sites) but I am still having issues with it.
I have proxied all steps through the site, included all listings as scrapeable files and tried to run them in order, or when appropriate called in certain files. Many of the scrapeable files do not have any get or post parameters. I get to initial search page of the site and it returns a server error page and in the screen scraper log for scraping session it returns an Error Code 500. I can not find any VIEWSTATE OR EVENTTARGET parameters anywhere.
I am missing a big piece of information somewhere and I'm getting very frustrated. The sites I am trying to scrape are www.diversifiedstaff.com & www.wellsfargo.com (the open positions or careers page of both sites)but I am just running into a brick wall.
Could you please explain the VIEWSTATE and EVENTTARGET parameters for me and give examples of these please. Many companies are changing to asp.net and I can't seem to figure it out.
Please respond ASAP to [email protected] and I can send what I have so far and you can see what I have written and the errors I am getting.
Help is GREATLY appreciated!
Asp site scrapping
Hello i trying to scrap data from asp site but i am not getting right way to do this.
i have logged in site but next navigation give me 500 error.
please help me if have done before.
you can send me email at : [email protected]
Please.
Regards
Damodar
Damodar, Yes, it is possible.
Damodar,
Yes, it is possible. Have a look at the following resources for more help.
http://blog.screen-scraper.com/2008/06/04/scraping-aspnet-sites/
http://community.screen-scraper.com/node/1117
-Scott
Asp site scrapping
Hi Scott,
Thanks for given suggestion.
Can you give me any example code. because i don't getting how to pass dynamic parameters.
its give me this error : Warning! Received a status code of: 500.
regards
Damodar
Asp site scrapping
Hello ,
I have read http://blog.screen-scraper.com/2008/06/04/scraping-aspnet-sites/ and other topics in the forum but I am still struggling.
i am scraping data from (https://myaccount.comed.com/_layouts/LoginPage/login.aspx);
after login i have getting a page for choosing account. but there is problem.
because Scrabble data is after that and its show me : https://myaccount.comed.com/pages/comedmessages.aspx?message=TechnicalError
please help.
Regards
Damodar
Damodar, I'll contact you via
Damodar,
I'll contact you via email. We'll need more information from you in order to help track this down.
-Scott
Scraper replied via email
I've replied via email to this post.
Thanks
Scraper
Replied to your reply with the scraping session attached
Hi Scraper,
I replied back to your email with the scraping session attached as a .zip file for your review. I just wanted to make sure you did get it.
Any suggestions or sample info. to point me in the right direction would be GREATLY APPRECIATED.
Thank you for your help!!!
I am trying to do the samething for this site. Help!!
Hi, I am trying scape from the same type ASP site with multiply selection boxes. Can you please help!?
Please contact me at: [email protected]
Thank You
rudykong, I sent you an
rudykong,
I sent you an email. Please email me if you did not receive it.
scottw [@] ourdomain
-Scott