Hi team,
Ive to use SS for scraping data from two wesbsites.
Shall we do it parallelly?
I tried it.But the second one exits in two three seconds.
Thanks
Arun
By far the easiest way to do this is to run screen-scraper as a server, then invoke the scraping sessions remotely, calling 'setDoLazyScrape( true )'. That will cause them to be run simultaneously.
Another possibility would be to run two separate command line instances--one for each site you're scraping.
Yet another would be to generate multiple RunnableScrapingSession objects, but that can get messy. I'd try the first two approaches before resorting to this one.
Web Data Extraction
How we can run 2 scraping sessions parallely
Hi,
By far the easiest way to do this is to run screen-scraper as a server, then invoke the scraping sessions remotely, calling 'setDoLazyScrape( true )'. That will cause them to be run simultaneously.
Another possibility would be to run two separate command line instances--one for each site you're scraping.
Yet another would be to generate multiple RunnableScrapingSession objects, but that can get messy. I'd try the first two approaches before resorting to this one.
Kind regards,
Todd Wilson