screen-scraper public support

I'm kinda newbie and would appreciate any help at all...

I'm running on XP and am trying to scrape some addresses off a website. I get an error (below) in my log when I try and use a script to write the data to a file....

I also would like to scrape the site roboting through the urls like this...

page.htm?number=1
page.htm?number=2
page.htm?number=3
...etc..etc

Is this possible??

Any help appreciated

Gwilym

OR noExtractorPatternsMatched.

they are both part of scrapeableFile, but I want to kinda check them from the piece calling the scrape original.

basically we have a script we run, which creates a session and starts it scraping. BUT along the way some pages are causing problems, and I want to run them in a loop TILL I GET VALID DATA. HELP!!!!

Got a message from one of the forum members:

"i read your posting on screen scraper and was wondering if you knew how to read to variables from one file?

I need to send in a city and state on a store locator and have a list but do not know how to read in two variables? I can read one in like a zip code but not two."

I'm posting the answer here, because I'm sure there are others who will want to do something similar.

hi,

any help on scraping the details page for this...

the search results page behaves exactly like your shopping site example...the links from a table of "dealers" to their respective details page is simply a url...easy enough...

however when I get to the details page (/dealers/abccompany.html) the pages source is actually this:

Hey. Im currently evaluating screen scraper for work (Basically I work in a travel company and we want to use it to scrape details of travel packages on the websites of some of our partners who, alas, havent got any sort of XML or equivilent feeds.

I have a few questions.

I'd like to be able to get around the slightly goofy upload-to-php method of sticking the data in a mysql database. And with that in mind I'm somewhat interested in the JYTHON bindings.

Hi All,

I need once again small help from u gr8 guys:
I have set screen scrapper successfully to scrape a site a small prob is

site first display list of articles with
"TITLE" and "SUMMARY" on one page and on click of one title it display the detail article,title,author,wordcount etc on this page i can extract these article fields by creating the datarecord easily but i am left with summary field which is displayed on previous page.

How to tackle this problem,How to get in summary field in datarecord Please help.

Thanks

Hi all ,

I have configured screen-scrapper-2.7.2 basic edition for ezinearticles.com
and its working very fine but after approx 90 to 94 request it starts giving error 400 but whne i check the url on which it started 400 error it was opening fine in browser.

Hi there,

I wanted to ask why my installation of screenscraper has corrupted to where I cannot access or open the workbench. I am recieving this error:

'The InstallAnywhere properties file contains invalid information'

Any incite to the cause or solution to this problem is greatly appreciated!

Thanks,

Michael

When I try to run my file scraper I get the following error:

Shop: An error occurred while processing the script: File Looper
Shop: The error message was: The application script threw an exception: java.lang.ClassCastException BSF info: null at line: 0 column: columnNo

This is the File Looper script.

// for loop, from 1 to 711
for ( int i = 1; i < 712; i++ )
{
// Set the "FILE" session variable to the current value of i.
session.setVariable( "FILE", i );