screen-scraper support for licensed users
Input/Output Error
Hello Support,
I have version 5.0.30a. I've been intermittently receiving the following error message in the workbench and the server:
The error is inconsistent as I run the same set of properties many times but receive the error at different points in the run.
Thanks
Adrian
Can ScreenScraper crawl this?
Hi,
I keep having issues scraping sites which are built using a lot of java script. I'm wondering whether ScreenScraper could potentially scrape this site -- I mean the paging on this site:
http://www.thenorthface.com/catalog/ca_ecom/en/gear/mens-jackets-vests
The issue is the paging through the product lists! Since the site is done using java script the html doesn't change. As far as I know, there is no way of scraping such sites using ScreenScraper.
Extractor patter for option value
Hi all-
Its been awhile since I posted last. I am working on a scrape for customer, but for the life of me I can not figure out the right extractor pattern to use to get the value from
Here is the code
Ports 8778, 9001, 8779, 8555
Part I:
Hello Support,
Screen-scraper (SS) was working fine yesterday but today I'm receiving the following error when I try to open SS:
Sorry, screen-scraper will need to exit because it can't bind to the following port(s):
8778 (for the server)
9001 (for the database)
8779 (for the web server)
8555 (for the web server)
Scheduled time for deployment changes automatically
Hi,
the deployment (since 5.0.24a or so) changes the next scheduled time automatically and doesn't keep the one which has been set.
There was already a long-outstanding issue when scheduling a scrape for the first time and the scheduled time was set to today some hours in the past. Then the scheduled time would be the current time when the scrape started. So I had to reedit the scheduled time to be in the future, then the deployment would save the time properly.
Dynamic Loading of External Java Libraries
Is there a way to force Screen-Scraper, or at least scripts in SS to re-load the newest versions of library files in lib/ext without having to reboot the screen-scraper server? Obviously doing this in the middle of a scraping session would be a bad idea, but in a large production environment with quite a number of scraping sessions potentially running simultaneously, it would be very nice to force new instances of scripts to use new versions of libraries.
Exporting Scraping Session from GUI less environment
Is there any way to export a scraping session from a GUI-less environment? I'd like to be able to export the file (like you can on the workbench) and be able to do diff's with versions on my computer.
logInfo not working in API
This seems to be something from the very latest alpha (5.0.22a). When I run my scrape that uses an outside JAR file, I get the following error:
The error message was: NoSuchMethodError (line 20): com.screenscraper.scraper.ScrapingSession.logInfo(Ljava/lang/String;)V-- Method Invocation geocoder.geocode
The JAR file does call
session.logInfo()
, so perhaps it's not in the API anymore? Do I need to change my code?
Different results on server vs workbench
I've attached a very simplified version of a scrape we've created. The problem is that when you run this scrape on your local computer using the screen-scraper workbench, it returns a normal result, but as soon as I upload it to a server interface and run it there, it gives a Bad Request 400 error. The ss versions are basically the same (recent alphas); why would it be doing this?
Thanks,
Chris
GUI-less removing one script from
*edit acidently i found answer on this topic
Regards,
Radek