Can't scrape after log in
Hi
I wrote two scraping file based on the tutorial 3 for log in. First file is to log in the site and second one is to extract the pattern.
From the response for the first scraping file I can see that I've logged in.
However for the second scraping file (with the different URL) it redirect to signup page as if I haven't log in.
It says in the tutorial that the screen-scraper automatically retain the cookies for the log in. Is anything else I am missing?
I am using the pro edition.
Thanks a lot
Can't scrape after log in
Found why..
In order to retain the login cookie,
Had to create scraping file from proxy server. Only URL won't do!!
Put here just in case it can help other newbies. :D