screen-scraper public support
How do I : export to a dynamic file name?
I want to be able to initialize the file name in a session variable, and then have SS write to that as a file name.
The following doesn't work. I get a file named "null.csv"
Ex Init:
session.setVariable( "PLATFORM", "xbox360" );
Ex Export:
out = new FileWriter( dataRecord.get( "PLATFORM" ) + ".csv", true );
Thanks.
~@DAVE@~
I got a "Stack" error, won't work now.
I wish I had saved it, but the error stated something like ...has run into the maximum number (50) of (something) for the stack... halting
I have tried rebooting to no avail. My session ran for about 3 hours, and gathered 104 search results pages (out of 400) before it quit.
I dread having to write the project again from scratch, but that's what I'm gonna try next if I can't find any ideas on this forum. :-/
~@DAVE@~
Corrupt Database
I've downloaded both the pro and enterprise versions of the software for the Mac, in both cases I am told after installation, when I try to start up the app that I have corrupt databases. The solution is to restore from backups - obviously I don't have backups yet. Can anyone help, this has been frustrating as I've sent email already a couple times - no response.
How to compensate for bad HTML coders in Details Page?
I'm trying to scrape video game details from Game Fly. I need the game description, inside <p> tags, which follows an <h3> tag.
But sometimes there's extra tags before, inside, and after the description paragraph.
What expression should I use? I want to ignore all tags inside the first <p> and the last </p> in the Sub Extractor Pattern
EX: Simplest Format::
<p>~@DESCRIPTION@~</p>
<div
Screwy Formats::
<p></p>
<p>~@DESCRIPTION@~</p>
Scripts: Run After Each Pattern Match
Hi All - still trying to work my way through my first successful scraping session, independent of the tutorial. I'm scraping a page that has a list of product ID's and then a details page. However when I try to add the details page scrape script - I'm only presented with 2 options - run "before file is scraped" or "after file is scraped". Not being given an option to select "run after each pattern match". any thoughts?
thanks in advance.
-Rory
Foreign Language Characters
Hi there - I'm a brand new convert to SS and trying to make my way through the tutorials. I managed to get a scrapping session to work on a site that has some French names, however the output in the text document replaces all the French Characters (â è ê ć á) with a "?"
Is there anything I can do with my Screen Scraper settings?
Advance Gratitude,
-R
Need Java code to Decode email
I am not a coder and need a decoder java code file for my scrapefile to use. I assume the number of var's are different for every scraped email. The following are 2 examples that are found inside javascript tags using CDATA. each var represents a character, and the vars are appended to formulate the email string. Can you paste the java code to decode this email obfuscation?
================================================
Input Filtering
I'm parsing scraped data to insert into a mysql database, I'm using a java.sql.PreparedStatement. All the incoming scraped data are strings or null and a prepared statement requires typed data based on the column types, so I can't directly insert strings as numeric or date types.
Cannot find screen-scraper.jar installed on system anywhere
Hi
I wish to schedule some scrapes to run periodically on a Windows 7 machine. Following the guide to invoke java on the command line, I cannot find the screen-scaper.jar file installed anywhere.
Running Version 5.0 of SS.
Can anyone assist on how I might run a scheduled scrape please?
MSB
*** REINSTALL SORTED. ISSUE CLOSED. THANKS ****
Variable Links
Someone Could help me ?
Look this site:
https://www60.fazenda.sp.gov.br/wps/portal/!ut/p/c1/04_SB8K8xLLM9MSSzPy8xBz9CP0os3gj5wBjYzN_QwOLYDNDAyMnUzdvN28zAwMDY_2CbEdFAI-P1VI!/
type data below:
21/09/2010
Click in "Pesquisar".
I put this site in SS but they don´t Scrape.
Someone know How Can I Scrap this kind Site ?