screen-scraper public support

Questions and answers regarding the use of screen-scraper. Anyone can post. Monitored occasionally by screen-scraper staff.

How do I : export to a dynamic file name?

I want to be able to initialize the file name in a session variable, and then have SS write to that as a file name.

The following doesn't work. I get a file named "null.csv"

Ex Init:
session.setVariable( "PLATFORM", "xbox360" );

Ex Export:
out = new FileWriter( dataRecord.get( "PLATFORM" ) + ".csv", true );

Thanks.

~@DAVE@~

I got a "Stack" error, won't work now.

I wish I had saved it, but the error stated something like ...has run into the maximum number (50) of (something) for the stack... halting

I have tried rebooting to no avail. My session ran for about 3 hours, and gathered 104 search results pages (out of 400) before it quit.

I dread having to write the project again from scratch, but that's what I'm gonna try next if I can't find any ideas on this forum. :-/

~@DAVE@~

Corrupt Database

I've downloaded both the pro and enterprise versions of the software for the Mac, in both cases I am told after installation, when I try to start up the app that I have corrupt databases. The solution is to restore from backups - obviously I don't have backups yet. Can anyone help, this has been frustrating as I've sent email already a couple times - no response.

How to compensate for bad HTML coders in Details Page?

I'm trying to scrape video game details from Game Fly. I need the game description, inside <p> tags, which follows an <h3> tag.

But sometimes there's extra tags before, inside, and after the description paragraph.

What expression should I use? I want to ignore all tags inside the first <p> and the last </p> in the Sub Extractor Pattern

EX: Simplest Format::

<h3>Game Description</h3>
<p>~@DESCRIPTION@~</p>
<div

Screwy Formats::

<h3>Game Description</h3>
<p></p>
<p>~@DESCRIPTION@~</p>

Scripts: Run After Each Pattern Match

Hi All - still trying to work my way through my first successful scraping session, independent of the tutorial. I'm scraping a page that has a list of product ID's and then a details page. However when I try to add the details page scrape script - I'm only presented with 2 options - run "before file is scraped" or "after file is scraped". Not being given an option to select "run after each pattern match". any thoughts?

thanks in advance.

-Rory

Foreign Language Characters

Hi there - I'm a brand new convert to SS and trying to make my way through the tutorials. I managed to get a scrapping session to work on a site that has some French names, however the output in the text document replaces all the French Characters (â è ê ć á) with a "?"

Is there anything I can do with my Screen Scraper settings?

Advance Gratitude,

-R

Need Java code to Decode email

I am not a coder and need a decoder java code file for my scrapefile to use. I assume the number of var's are different for every scraped email. The following are 2 examples that are found inside javascript tags using CDATA. each var represents a character, and the vars are appended to formulate the email string. Can you paste the java code to decode this email obfuscation?

================================================

Input Filtering

I'm parsing scraped data to insert into a mysql database, I'm using a java.sql.PreparedStatement. All the incoming scraped data are strings or null and a prepared statement requires typed data based on the column types, so I can't directly insert strings as numeric or date types.

Cannot find screen-scraper.jar installed on system anywhere

Hi

I wish to schedule some scrapes to run periodically on a Windows 7 machine. Following the guide to invoke java on the command line, I cannot find the screen-scaper.jar file installed anywhere.

Running Version 5.0 of SS.

Can anyone assist on how I might run a scheduled scrape please?

MSB

*** REINSTALL SORTED. ISSUE CLOSED. THANKS ****

Variable Links

Someone Could help me ?

Look this site:

https://www60.fazenda.sp.gov.br/wps/portal/!ut/p/c1/04_SB8K8xLLM9MSSzPy8xBz9CP0os3gj5wBjYzN_QwOLYDNDAyMnUzdvN28zAwMDY_2CbEdFAI-P1VI!/

type data below:

21/09/2010

Click in "Pesquisar".

I put this site in SS but they don´t Scrape.

Someone know How Can I Scrap this kind Site ?