screen-scraper public support

Hi team,
Ive to use SS for scraping data from two wesbsites.
Shall we do it parallelly?
I tried it.But the second one exits in two three seconds.
Thanks
Arun

Hello!

Hi everybody,
I really appreciate your program. Unfortunatly I am not very good in programming with interpreted java or similar, and I have some problems iterating a single scraping session. I would like to repeat few time a single scraping session constituted by 4 scrapeable files. At the beginning I tried with a script like:
for( i = 0; i {
runnableScrapingSession = new com.screenscraper.scraper.RunnableScrapingSession( "Session-name" );
runnableScrapingSession.scrape();
}

Is there some way to iterate through the variables in a scrape? I'm trying to write a script that populates a meta-dataset including information like passed values, number of records returned, timing, etc.

I'd prefer to iterate through the session variables rather than hardcode an entry for each possible passed parameter. Generic is better than specific, right? :)

Hi,

Im trying to scrape the website www.wetseal.com. http://www.wetseal.com/pod/stores/default.asp?stateID=TX&stateName=Texas&token=

Im trying to save the part highlighted in bold to a session variable as follows,the ouput is as follows, TX&stateName=Texas.

I would need your help in removing the amp and passing only the value TX&;stateName=Texas.

Thanks,

Ganesh Ethiraj.

Ok, I have a bunch of scrapes that take parameters. That's cool.

But if I "run" the scrape from within the screen-scraper application, the parameters aren't set, since I'm not passing them. That's fine, I have a script that will set a default parameter if one is lacking.

But this means if someone forgets/mistypes a parameter on the SOAP call, they get the default.

Is there some way I can (in the script) tell I'm in the app vs being called as a server/SOAP call?

R

(obligatory "you guys rock" statement here)

Time+Range%3A+%3Cb%3E8%2F3%2F2006+00%3A00+-+8%2F3%2F2006+23%3A59

This is part of the URL of my scraping session with a variable that indicates a date range. (8/3/2006-8/3/2006) Changing the red numbers to a different date has no effect. Any idea what I'm doing wrong?

Thanks!

I'm having a typical "works in browser without proxy, but not with proxy" when it comes to cookies. The proxy just won't set the cookies.

Here's the site URL:

http://pacer.flsd.uscourts.gov/

Just click on the "login" link and enter login info at the following form.

Sadly, I can't give you the login information to see it for yourself -- maybe you can spot something off about their cookie methods.

im trying to write an if statement in interpreted java, no matter what i do it always uses the last case... seems it doesnt test the condition... my guess it my syntax is wrong... can you please help
here is the script.

I have run the following script successfully however I found that the scraping session was taking to long and decided to write a dataset to file instead of the individual session variables. Could you advise how I change the text to write the dataset "getdata" so I can run the script after each pattern is applied?

FileWriter out = null;