Log-off and log back in using a different username
There's a site out there that allows free lookups up to 100 searches per day, per free account. However, I have 500 searches to do per day.
Using the shopping site tutorial, I've figured out how to login once and scrape a site using an imported csv. However, when the 100 searches limit is reached, the website gives an error, the session stops working, and the session keeps running with errors. I then must stop the session, replace the data file with the next 100 records, change the username used to login screen scraper, and then run it again. I have to repeat this process 5 times to get all 500.
It seems like a simple concept but I can't get my mind around it. Can you please explain how I should setup screen scraper to log off and then log back in as the next unused user if a "you've reached your maximum searches per day" pattern is matched?
It sounds simple
It sounds simple theoretically but it's not for someone like me. You don't have any public scripts that do it setup already do you?
I don't ... since everyone's
I don't ... since everyone's database is different, there's not a good way to generalize it.
Shouldn't be hard. I'd have a
Shouldn't be hard. I'd have a DB table of credentials with a column to mark it they were used today, and then when the scrape gets the limit message, grab the credentials for the DB, and use a scrapeable file to log in again.