screen-scraper public support

Questions and answers regarding the use of screen-scraper. Anyone can post. Monitored occasionally by screen-scraper staff.

use mail server to send email

Hi:
I used mail server to send email in script ,but it was error.The error msg is "553 5.1.8 ... Domain of sender address Administrator@lenovo-f6cc8683 does not exist ".It's an inside mail server.
But I had used other outside mail server to send ,it's also error, and the error msg is "Could not connect to SMTP host: pop3.sohu.com, port: 25, response: 421".May I use an inside mail server?

Running from command line

Hi,
when I try to initiate a scraping session using the following command line,
the console is invoked and the script loaded, but not run. I'd actually prefer to just
run the script without opening the console.

Is this possible with a different command line switch?

Thanks.

D:\Program Files\screen-scraper basic edition>".\jre\bin\java.exe" -jar screen-scraper.jar "TEST.sss"

replace characters

I use screenscraper to download meteo data (max and min temperature, wind) and save it in a csv file.
the script to save data is:

outputFile = session.getName() + ".csv";
try
{
File file = new File( outputFile );
fileExists = file.exists();

out = new FileWriter( outputFile, true );
session.log( "Writing data to a file." );

How to Subtract Datarecords

I scrape a site and I store 2 values. Low1 and Low2. I created a script using java that does the following "after each pattern application"

import java.lang.*;

int a,b,c;
a = Integer.parseInt(dataRecord.get( "low1" ));
b = Integer.parseInt(dataRecord.get( "low2" ));
c = a - b;

session.log(c);

this keeps giving me an error:

The error message was: The application script threw an exception: java.lang.NumberFormatException: For input string: "1,553" BSF info: null at line: 0 column: columnNo

Scraping data from <textarea>

I'm trying to extract address data from a text area

 (<textarea></textarea>)
form field on a web page. Each line of the address is shown on a different line in the text box.

When I scrape the data, I lose these line breaks so the address gets joined together (E.g Old Farm BarnPetworth RoadWisborough GreenWest SussexRH14 0BJ)

I have tried scraping with tidy HTML on and off, but it makes no difference. Any suggestions would be much appreciated. Thanks

Newbie troubles Tutorial #2.

On page 7 of Tutorial 2, I run the script to confirm I should see everything that I expect to see. The problem is that it continuously loops through page 1. Never goes to page 2. Any suggestions on where I fouled it up?

Unknown Number of Fields to a CSV

I am looking for a bit of help regarding a scrape that attempts to grab highway closures from a website and writing them to a csv where the 6 variables below would be in each row. The list of these is arranged by increasing highway numbers, yet the way they update the information is random, so there is never a set number of the above code (yet it will never go above 300). I'm wondering if there is some type of script or loop I could use to pull out the information. The website I'm scraping contains an unknown and varying number of entries of the following form:

Solve: Typecast??

CoolED is a Session variable that is comming from a scrapping session.

I tried to compare the numerical value in CoolED to a number.

I tried:

Can I use different character to scrae data from different character web in one screen-scraper?

Hi,I want to scrape different character WEB form one screen-scraper.Can I scrape success?If I can,how I set the screen-scraper?

Badly formed HTTP header with file upload

I'm trying to scrape and ASP page basically to login and upload a CSV file.

I've got around all the hairy ASP stuff like setting the multitude of meaningless variables. I'm having trouble with the actual upload request.

If I capture the HTTP header with the Live HTTP Headers firefox extension or look at in the proxy server this is the correctly formed request: