Automated screen scraping
Hi talents,
We have used screen scraper basic edition and scraped 2 of the sites sucessfully and loaded those data in our portal.
Its all working fine.. well.
Now i need to automate my screen scrapping session like, it has to scrape those sites for every 24 hours and store the new data to our portal..
Is it possible..
Do i need to buy any versions of screen-scraper.
Will it support.
Guide me.
Thanks in advance,
Alex
Some limited functionality for Basic Edition
It is possible to run screen-scraper on a schedule with Basic edition (and this same advice could apply to Professional Edition), however it's functionality that isn't built into the program itself.
Check out this page in our FAQ: Can screen-scraper be scheduled to scrape sites on a periodic basis?
The idea is that you can use Windows Scheduler or a Linux "cron" job to execute screen-scraper from the command line. From there, you may perform individual tasks with screen-scraper.
Note that in the Pro version, though, you may run screen-scraper in its server mode, which allows external programs to interface with screen-scraper (to run scrapes, etc) whenever you wish, so long as the server is running in the background (ie, a Windows service)
Hope that's what you were after!
Tim