screen-scraper public support

So, if all I want to do is scrape each page of a search, do I need a script to do that or do I just need to create a scrapeable file for each page?

I'm not a programmer so some of this stuff is a bit over my head. Thanks for any info you can provide.

--sam

I would like to compare a record search scraped date string with the current date and then decide if a detailed scrape will be performed.

Would it be possible to get the Interpreted Java code?

Data record date has the following format MAY-20.

Thank you!

Hi All,

I have been happily scraping away until today, when my scrape suddenly hung, requiring a hard reset of my machine. Now, when I launch screen-scraper, I get the following message:

ERROR | wrapper | 2007/05/18 14:32:07 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR | wrapper | 2007/05/18 14:32:07 | JVM did not exit on request, terminated

Thoughts?

Version is 3.0, been pretty stable for a while, but this happened twice in the last few hours. :(

I am a new user, so please forgive me if this is a dumb question. i installed screen-scraper. everything is working fine creating tutorial scraping sessions.

when i attempt to create a proxy for a url with a port number, it makes it to the screen-scraper proxy, but the proxy doesn't seem to get a response back from the requested site.

the proxy log has these two lines, that's it:

I have many page and extracted data in each page but I want to write all data into 1 XML file
http://...page=~#PAGE#~
PAGE: session variable.(PAGE=1--> 10)
Thanks.

Hello, I'm new to this but it looks interesting and I'm having a play about.

How, after scraping a number of mathematical numbers from a site would I sort in order. Like this:

Scraped:
29
4
18
1
7

Would like it sorted in order like this:
1
4
7
18
29

Also, how would I then tell the system to determine the highest number from the results? eg, 29 is the highest.

Thank you!

New user attempting to scrape a yahoo groups member list.

I am the group owner with a need to track group growth chronology.

Used the proxy server with "auto login" and all works fine.

Tried the same with a script and the cookies arre apparently not processed correctly because first call is delivered to a login screen.

Second attempt was a proxy track of (the from scratch) login. This also rorked ok and allowed me to "discover" the hacker protection buried in hidden fields of the login screen.

I am trying to scrape a page for earnings details. The target page may be in two sections "Earnings Releases-Confirmed" and "-Proposed". "Confirmed" comes first, and I have a pattern which finds that.
Going down through the page, you hit the "...Proposed" section and I want to change my CONFPROP variable at that point to "Proposed" and keep on extracting to the end, effectively capturing the CONFPROP variable value for the database.