screen-scraper public support

What I would like to do is have SS set up so that it will automatically visit about 3 website and log All the products on sale on those sites
Product code Product description and price

Then I would like the details from each site pasted into an excell sheet.

Can SS do this?

I'm new to SS but can't even got off the ground.
I get absolutely nothing recorded in the progress or response panes when I browse web sites
I have tried IE and Firefox set up for localhost 8777. I have a direct connection to the internet. I have also tried 127.0.0.1 with 8777.

Any idea what could be wrong

I have written a simple scrape that loops through and pulls the details from 2,300 pages. The scrape pulls a single page, adds the scraped values to session vars, writes those values out to an xml file, and then sets all the session vars to "" before scraping the next page.

After about 300-400 screens i get the following error -
An error occurred while processing the script: --loop jobs
The error message was: The application script threw an exception: java.lang.OutOfMemoryError BSF info: null at line: 0 column: columnNo

hi )

i want to call scraping session "b","c",etc, from scraping session "a" 's java script, and i want the logs will be in file b.log, c.log, under disck C

i tried to add these into scraping session a's script

scarping0= new com.screenscraper.scraper.RunnableScrapingSession( "b" );
scarping0.scrape();

scarping1= new com.screenscraper.scraper.RunnableScrapingSession( "c" );
scarping1.scrape();

scarping2= new com.screenscraper.scraper.RunnableScrapingSession( "d" );
scarping2.scrape();

encoding for this page http://www.pcwelt.de/start/computer/pc/tests/143839/
says UTF8.

With utf8 character setting on SS i got "parenden CPU verfÿÃ'´

Hi all,

First all i have to say i am new to scraping technology.

I want to scrape a website which is using POST method for variables
[url]http://shopping.sify.com/shopping/index.php[/url]

And i dont know how to scrape..

I have downloaded the Screen-scraper. And gone through the tutorials, I have scraped the screen-scraper/shop site too as guided in the tutorial 3.

But, now i am in a hurry to finish my task (Scrape the shopping.sify.com site)
Even though, i am not clear now, i am in confusion..

Hi,

when I write data to a text file, the CR or CRLF doesn't work.

e.g.

out = new FileWriter( "dmy.txt" );
out.write( "line1" );
out.write( "\n" );
out.write( "line2" );

out.close();

I'm using WinXP and the Basic Edition v.4. I also tried '\n' and "\n\r", but it is just ignored. What am I doing wrong ?

Thanks
Frank

Scraping session log extracts the text and then encounters a problem processing the script. I am demoing the pro version. token is ~@EXTRACTED_TEXT@~
this is what is shows (in vbscript):

...
Processing script: "Write extracted data to a file"
An error occurred while processing the script: Write extracted data to a file
The error message was: Token Parsing Error: Lexical error at line 1, column 3. Encountered: "O" (79), after : "\' ".
Processing scripts after scraping session has ended.
Scraping session "test" finished.

I am scraping a site that goes to a temporary screen with the words "Processing..." flashing on the screen and then loads the results that I want. Right now Screen-scraper is scraping the processing screen and of course failing to find the extractor patterns from the final results screen.

My question is: how can I tell screen scraper to wait for the final page to load before scraping, is there a way to specify a pause?

Thanks,

Joel

I updated to 4.0.1a and now screen-scraper cant seem to find the driver..

The error message was: The application script threw an exception: java.sql.SQLException: No suitable driver found for jdbc:mysql://xxxxx/scraping?user=xxxxx&password=xxxxx BSF info: null at line: 0 column: columnNo

any ideas?