screen-scraper support for licensed users

Questions and answers regarding the use of screen-scraper. Only licensed Professional and Enterprise Edition users can post; anyone can read. Licensed users please contact support with your registered email address for access. This forum is monitored closely by screen-scraper staff. Posts are generally responded to in one business day.

When does an imported scraping session become effective?

I imported a scraping session onto a server that has the screen-scraper service running. The scraping session still doesn't work and I'm not sure if it is because of a program error or if it is because the service is not using the new scraping session.

When does an imported scraping session become effective? Do I have to stop and restart the service to make new scraping sessions effective after importing them?

An error occurred while writing the data to a file: Dangling meta character '+' near index 0 + ^

Hi Support,

I haven't seen this one before and was not able to fix it myself. The token is as follows:

streetaddress=+~@ADDRESS@~&citystatezip=~@CITY@~%2C+~@STATE@~+~@ZIP@~'

The ADDRESS and CITY has + (plus sign) in the HTML, such as:

425+N+Curson+Ave

and

Los+Angeles

so I applied the following script:

Next page

I have been working a scrape now for about 3 days straight and a little confused how I can get it to go to the next page. Below is the code that outlines the pages, but I can not figure out how to make and extractor pattern and/or script to proceed to the next page. Also I am attaching my most current scrape work.

Help with moving through categories and pages within category

Hi Guys-

I have not posted in awhile and am working on a new scrape for someone. The problem I am running into is moving through each category and the page within the category. I am attaching my scrape so far, but stuck on how to maneuver through the categories and pages within the URL within a Loop. Its probably pretty simple, but my brain is fried...lol!

Thanks ahead of time for any support

http://www.jj54.com/ProcessLibrary/

Java Error on Start Up

We are using an older version of Screen Scraper Pro and it has worked with no issues for quite some time.

Recently however - when I tried to launch the program - I recieved a "Fatal Application Error" stating: This Application has Unexpectely Quit, Invocation of this Java Application has caused an InvocationTargetException. This application will now exit. (LAX).

With the details being:

How to control multiple instance via web console?

Hi,

I am trying to install multiple instances of Screen-Scraper on one system. I've made the modification as mentioned in the FAQ (http://community.screen-scraper.com/MultipleInstances).

Would installing multiple instances help?

Hi,

I am trying to scrape multiple sites via the web console. Each scraping session scrapes a different site. The scraping sessions would stop (each at different time) even though it has not completely scraped the whole site. There are no error messages. But if I run the sessions individually, it would scrape the whole site correctly. Should I try installing multiple instances of Screen-Scraper on one machine to have it run properly?

Thank you in advance for your help!

Launch Server Headless

Hi,

when running Screen-Scraper server (enterprise edition) on a Mac OS X Leopard or Snow Leopard, the user starting the server has to be logged in and it cannot be started in headless mode. I added the following line

-java.awt.headless=true

to the server.vmoptions file.

Is there a way of launching the server in headless mode?

Thank you,

Edgar

List variable refuse to save

Good evening scrapers.

I'm working on a setup to scrape a pretty large XML file which for each object has a number of images. I used the following script when trying to add those images to a common variable IMAGE_LIST before inserting the values. All seem to work well but the IMAGE_LIST variable keeps coming out with null values. Am I missing something here:

import com.screenscraper.common.*;

// Extract images from datarecord
DataSet Images = scrapeableFile.extractData(dataRecord.get("DATARECORD"), "Single foto");

// Iterate

session.breakpoint() passing values back to ss

When session.breakpoint() is called, is there a way for the script that called it to find out whether the user choose to stop or continue scraping the script? I'd like to have the script display some additional state information before it ends if the user selected 'stop' but to go on if not.

I was thinking I could use the session.isRunning() function, but it doesn't really seem to work.