screen-scraper public support

Questions and answers regarding the use of screen-scraper. Anyone can post. Monitored occasionally by screen-scraper staff.

Version numbers and download

Hi,

Newbie here.. any help appreciated.

I'm having a problem working out exactly what version of SS i have.

I checked in the screen-scraper.properties and it says 3.0

But there are many updates available (3.48 is the latest.. am I right? )

So

1) How do I tell which version I really have and
2) How do I download an update if I need it

Many thanks in advance

SS is a GREAT product :)

The Monki

error message..

Sorry, screen-scraper will need to exit because it can't bind to the following port(s): 9001. Please see this page for more information: http://www.screen-scraper.com/support/faq/faq.php#PortBindingError
~

[b]this is a log message.[/b]

i'm running linux machine on command line mode.
i have excute './start_server.sh' and run it './excute.sh' that was involved
following script.

only follow links that go deeper into a website

Hi,

We have a database with internetsites of hotels. It's always the specific link, so not e.g. www.marriott.com but something like http://marriott.com/property/propertypage/AUAAR. Is there a way to automatically follow only links that go lower into the website instead of links to external sites or links that go up in the website ?

How to duplicate a dataRecord

Hi, i'm scraping info about some products and the disponibility of them on various cities i need to create an entry on the dataset for each city containing the same information. For example:

Product Reference Location
NoteBook NB12B54 Miami, FL - Los Angeles CA - New York, NY

Should generate 3 entries on dataSet.
NoteBook NB12B54 Miami, FL
NoteBook NB12B54 Los Angeles CA
NoteBook NB12B54 New York, NY

scrap search page but must visit home page

i have a site to scrap
url:http://www.parliament.uk/directories/hciolists/alms.cfm
I have to click on link(Boig) and scrap all the details from page opened after ckicking.
In scrapper tool I created a session and provide url as http://www.parliament.uk/directories/hciolists/alms.cfm
I extracted the id and stored in session.
I created another session and provided the url

tidying HTML failed

Hello,

I requested a url-http://www.yell.com/ucs/HomePageAction.do from scrapper tool and got the following message:

scrap page having session variables and not query string

i have a home page and then a search page, i provided a search page url to the scrapper tool but when the page is requested from tool it is directed to pageexpired pages because the search page has session variable and must be visited through the home page,
will this type of pages can be scrapped where we need to go to home page first and then click the search button to go to search page and then start scrapping?

I get a Page Not Found 404 error when using proxy server

Hi,

I am trying to scrape a site, and it give me a Page Not Found 404 error whenever I use the proxy server. It works fine if I'm not using the proxy server.

Any idea of how I might get through this?

Here is the site:

http://www.icaac.org/
then I click --> "here" at the link for July 30, 2007 in "Click Here to search the 47th ICAAC program", which takes me here:

it's run command line mode not GUI on Linux

Dear ....

our aim of new project is to work on Linux.
there is no GUI Interface.

i made some scrapable session.
and export them into a xml file.

and i'm copy the file into import directory.
and i ran the './start_server' file.

so i can't see the file in the 'import' dicrectory.
but i can't know the name of scrapable sesion.
because i can't run 'screen-scraper' file on text mode.

therefore i can't excute the new session file.
how can i get the name of scrapable session?

cannot load class sun/plugin/JavaRunTime.

I have a project which uses interpreted java scripts.

The file basically reads in a txt file and then goes through each line and uses the value to do a search.

On the scraping session, I have selected the HTTP client: to the value of Internet Explorer (Windows Only).

When I run the script, I get a the error

cannot load class sun/plugin/JavaRunTime.