screen-scraper public support

We're trying to keep track of the amount of data we're pulling off a site (per scrape), and I was wondering if there were any techniques for keeping a log of and/or reporting the size of each page screen-scraper receives...

I know how to do it by adding a script to each and every scrapeable file, but that's obviously not a preferred solution. I've got almost a thousand scrapeable files in hundreds of scrapes.. So that wouldn't be ideal.

Just to make sure it wasn´t a user-pb I've gone through the tutorial several times but I still get to the same point here:
http://www.screen-scraper.com/support/tutorials/tutorial1/running_the_co...

I cannot find the "form_submitted_text.txt" file that should have been created although the scraping log does not report anything abnormal:

I receive the following message when backing up the scraping session: " C:\Program Files\screen-scraper basic edition\resource\db\backup' december 16, 2007 " but the file is nowhere to be found!!!

Similarly, i can only save without choosing the destination folder.

Is it because i am using the basic edition that it just won't let me save or backup or my work?

(I've checked the comparison matrix and there isn't any sign of limitation on this side of the soft; I'm looking at buying the soft but this is what's preventing me to do so for the moment!

thanks,

Hi -

SS Pro newbie here currently evaluating Trial version. So far so good!

Bit confused now however.

I am running a Proxy Session. I want to scrape some data from each webpage I visit during the Proxy Session, while

the Proxy Session is running. That can be done, yes? (The documentation talks about harnessing the power of the

scripting engine while running proxy sessions, so I'm assuming so).

I have created a simple Extractor page that takes the data I need, called "Product_Data".

Hi,

It seems to me I am not solving problems but moving them to another place in my scrape application. Now I often have a certain error in the wrapper.log file:

JVM appears hung: Timed out waiting for signal from JVM.
JVM did not exit on request, terminated

Screen-scraper is written in Java and so is my code in the scripts, but what did I do wrong to have this problem with the Java Virtual Machine ?

Hi,

I often get the message underneath in the error.log file:

I can call the Interpreted Java scripts just fine, but what is the correct way to call a script that's written in VBSCRIPT via the Command-Line?

Also- can screen-scraper be programmed to automatically trigger certain tasks based on error return codes, such as send out an email?

Regards,
ML

Hi,

Error message "Returning the default character set because the Content-Type header is null." appears often in my error.log file. Any idea what causes this error ? Can I do anything to prevent it from happening or are these websites just not built in a right way ?

Thanks,
Tamara Vos

Hi -

I have successfully completed Tutorial 1 (great stuff!), using VBScript.

But now having a problem at the beginning of Tutorial 2.

I am following the 'Invoking a Scraping Session in VBScript' strand. I have pasted the VB basic script from the tutorial into SS Pro, it looks just the same as the tutorial.

But when I click on 'Run' I get a Script Error window.Inside the window it says:-

------------------------------------------------------------

Script: Hello World -- begin scraping session

Error Message:

Hi,

Today we received this error in one of our crawls

An error occurred while processing the script Clickspace--Write Combined Product to XML Feed
The error message was The application script threw an exception org.jdom.IllegalDataException The data "null" is not legal for a JDOM attribute A null is not a legal XML value. BSF info null at line 0 column columnNo