screen-scraper support for licensed users

Hi,

I'm trying to extract some data that has been URL encoded. I'm sure this is a common issue so can you point me at a relevant post or part of the documentation that deals with this (I've struggled to find an answer using search).

Thanks

Alex

I'm trying to create an extrator pattern for the following HTML Source:

I know this is a stupid questions but for some reason I don't know how I can call in a local .xml file to scrape and then create the csv.
I was thinking it could be a call to the file in the "Initialize & Run" script but I'm not exactly sure how to specify the variables.

One of our suppliers have made changes and we are struggling with what appears to be a Java script routine that is executed after a edi data file is uploaded. The session seems to sucessfully upload the data file but the site requires you to click a button to verify the contents of the upload.

The verification code is below:

I am attempting to rewrite my scripts to scrape a website that recently changed to asp.net. I am able to pull the EVENTTARGET, EVENTARGUMENT, and VIEWSTATE parameters and then post to the next page but when I get to the ERecruit page to select the Additional Search Options these parameters stop being passed/listed. I'm not quite sure if I need to us the PS_TOKEN or other variable set in the html but even when I try to use these I still am not able to pull up the Additional Search Options page from the ERecruit Search Page.

Hi,
Something very strange is happening. I have a scrapeable file that looks like it's ignoring the response from the web server. I'm trying to scrape the following url; http://www.pittsburghlegaljournal.org/subscribe/pn_sheriffsale.php.

The log file shows the following;

I am using Interpreted Java.

This appears in log when running scraping session:

FullProductDetailsPage_01: Extracting data for pattern "MainGrab"
FullProductDetailsPage_01: Saving data set "MainGrab" into a session variable.
FullProductDetailsPage_01: Appending data set "MainGrab" to an existing data set.
FullProductDetailsPage_01: Number of data records for data set "MainGrab" is now 2 <---- This is the problem
FullProductDetailsPage_01: The following data elements were found:

I have a site I'm scraping that's doing some moderately crazy stuff -- including an external call to a page that returns a javascript chunk that decodes an embedded base64 string containing HTML that it then displays.

Was out looking for a library that would do a base64 decode for me but noticed a lot of people are using local libraries (like Sun) that have the function in them -- it's sneaky but works.

So does screen-scraper have a base64 decoder function I can mooch off? If not, does anyone have a preferred library they're using?

Hi,