Bypassing intermittent warning page
I'm trying to scrap a site that sometimes displays warning page, on the same URL than the detail page that interests me.
How could I test and bypass that?
PS: no, the site I'm scrapping is not an adult site... ;-) it's just a bunch of console games catalogue (the warning is for ESRB rating over Everyone) !
Bypassing intermittent warning page
n19784,
Use screen-scraper's proxy to find out what is happening with the HTTP transactions. Our [url=http://screen-scraper.com/support/tutorials/tutorials.php]tutorials[/url] are a great place to get your feet wet working with screen-scraper.
-Scott