screen-scraper public support

.

I have a list of URLs in an excel spreadsheet column that I need to scrape .

is there a way (perhaps a script) that I may use to import this list into screen-scraper and create the scrapeable files ? I have not found a solution to that in any of the previous posts in the present forum.

I have tried to do that by copying / pasting this list in
Somename (Scraping Session).xml,
(i.e. in a "template" of an exported Somename (Scraping Session).xml file - but screen-scraper does not allow to import it back.

I searched the forums and documentation but could not determine if there is a function that would work like a session.getCookie() function might. Does anyone have a solution for how to retrieve the cookie variables so that I can bring them down to the session scope for modification or tracking?

Thanks,
J

how do I repeat the scrape in a loop, modifying the (single) POST parameter each time? Prefer vbscript example...

Do I have to set up a screen-scraper server and call the session in a loop?

What would be the typical vbscript to open an existing .txt file and append the new data? I'm using the below from the tutorial:

Session.Log "Writing data to a file."
Set objFSO = CreateObject( "Scripting.FileSystemObject" )
Set objStoriesFile = objFSO.GetFile( "H:\Export.txt" )
objStoriesFile.Write Session.GetVariable( "FORM_SUBMITTED_TEXT" )
objStoriesFile.Close

i am trying to scrape through a website.I am able to scrape the first page pf the request, but to go to the next page its giving me error.
i have checked the cookies etc though its getting set properly, not sure why the error happens. The site tells that there is a cookie issue.
The URL to the next page is also getting set perfectly.

any answers?

Thanks,

I'm interested in outputting the DATARECORD to a file in interpreted Java. Need help with correct syntax. Thank-you.

BK

Hello All,

I need help in getting started with screen-scraper. What I'm trying to do is log onto one page which contains a list of names and for each name, a list of days. The days are actually links to other pages which have the detail information I want to scrape.

Hello -
I lost my SS code to a hard drive crash, trying to relearn here...

I'm scraping Google.

(1) Here's my scrape page URL
http://www.google.com/search?q=%22~#GOOGLESEARCH#~%22&num=100&hl=en&lr=&...

i've got the following problem.
I am scraping listings. They all have a different number of images.

The problem is that if a listing has 4 images, and a previous one has 5,
the session variable from the previous listing is also used for the next.

The method is [i]apply pattern after each pattern application[/i].

So i am trying to do this in a script:

if(dataRecord.get( "image5" ) == "" )
{
session.setVariable( "image5", null );
}
// call the Save scrape
session.scrapeFile( "Save_images" );

Given that these variables have to be assigned to the scrapeable file object, how can I from a prior scrapeable file object, access the next one I am going to trigger? I can't seem to see any way to retrieval a scrapeable file object.