screen-scraper support for licensed users

Questions and answers regarding the use of screen-scraper. Only licensed Professional and Enterprise Edition users can post; anyone can read. Licensed users please contact support with your registered email address for access. This forum is monitored closely by screen-scraper staff. Posts are generally responded to in one business day.

Input/Output Error

Hello Support,

I have version 5.0.30a. I've been intermittently receiving the following error message in the workbench and the server:

10 Realist Property Details for LAMF: An input/output error occurred while connecting to 'http://realist2.firstamres.com/searchdetail'. The message was Connection to http://realist2.firstamres.com refused.

The error is inconsistent as I run the same set of properties many times but receive the error at different points in the run.

Thanks

Adrian

Can ScreenScraper crawl this?

Hi,

I keep having issues scraping sites which are built using a lot of java script. I'm wondering whether ScreenScraper could potentially scrape this site -- I mean the paging on this site:
http://www.thenorthface.com/catalog/ca_ecom/en/gear/mens-jackets-vests

The issue is the paging through the product lists! Since the site is done using java script the html doesn't change. As far as I know, there is no way of scraping such sites using ScreenScraper.

Extractor patter for option value

Hi all-

Its been awhile since I posted last. I am working on a scrape for customer, but for the life of me I can not figure out the right extractor pattern to use to get the value from

Here is the code

<div class="row selectTruckWrapper "><label for="selectTruckalias" class="left optional">Find by name:</label>

Ports 8778, 9001, 8779, 8555

Part I:

Hello Support,

Screen-scraper (SS) was working fine yesterday but today I'm receiving the following error when I try to open SS:

Sorry, screen-scraper will need to exit because it can't bind to the following port(s):

8778 (for the server)
9001 (for the database)
8779 (for the web server)
8555 (for the web server)

Scheduled time for deployment changes automatically

Hi,

the deployment (since 5.0.24a or so) changes the next scheduled time automatically and doesn't keep the one which has been set.

There was already a long-outstanding issue when scheduling a scrape for the first time and the scheduled time was set to today some hours in the past. Then the scheduled time would be the current time when the scrape started. So I had to reedit the scheduled time to be in the future, then the deployment would save the time properly.

Dynamic Loading of External Java Libraries

Is there a way to force Screen-Scraper, or at least scripts in SS to re-load the newest versions of library files in lib/ext without having to reboot the screen-scraper server? Obviously doing this in the middle of a scraping session would be a bad idea, but in a large production environment with quite a number of scraping sessions potentially running simultaneously, it would be very nice to force new instances of scripts to use new versions of libraries.

Exporting Scraping Session from GUI less environment

Is there any way to export a scraping session from a GUI-less environment? I'd like to be able to export the file (like you can on the workbench) and be able to do diff's with versions on my computer.

logInfo not working in API

This seems to be something from the very latest alpha (5.0.22a). When I run my scrape that uses an outside JAR file, I get the following error:

An error occurred while processing the script: Kia - CSV
The error message was: NoSuchMethodError (line 20): com.screenscraper.scraper.ScrapingSession.logInfo(Ljava/lang/String;)V-- Method Invocation geocoder.geocode

The JAR file does call session.logInfo(), so perhaps it's not in the API anymore? Do I need to change my code?

Different results on server vs workbench

I've attached a very simplified version of a scrape we've created. The problem is that when you run this scrape on your local computer using the screen-scraper workbench, it returns a normal result, but as soon as I upload it to a server interface and run it there, it gives a Bad Request 400 error. The ss versions are basically the same (recent alphas); why would it be doing this?

Thanks,
Chris

GUI-less removing one script from

*edit acidently i found answer on this topic

Regards,

Radek