screen-scraper public support

I'm scraping a site where the results are delivered over multiple pages. When I step through the site using the proxy server and Firefox, everything is fine until I click on the Next Page link. When I do that, I get a blank screen. If I don't use a proxy server, the Next Page link works fine. I captured the URL using Live Headers, but when I try to use it to get results, I get the following message in the log: An HTTP error occurred while connecting to [URL]. The message was: Invalid query..

Hi,

I've upgraded to Screen Scraper Professional 3.0.65a and now the "Apply Pattern to Last Scraped Data" button doesn't show you the variable for just the specific sub-extractor pattern. It seems like it's showing you all the variables for the entire main extractor pattern.

Is there an updated version that fixes this? Or is this the first time you've heard of this problem?

Thanks,

Brendan

What is the best way for me to move my current scripts running on OLD MACHINE under 2.7.2 to NEW MACHINE where I hope to get 3.0 running?

Do I need to first install 2.7.2 and move the data over to the new machine, THEn upgrade? Trying to do the least amount of work here I hope.

Hi,

Yesterday we had a problem with the server where I installed screenscraper professional edition, running as a server. The tidy.log file was 40 gigabytes big. Because of that the disk of the server had little space left. What I saw before with this logfile was 6 bytes, empty, 10 bytes, 2 bytes, ... It seemed to be emptied often. How can it grow so hard ?

Thanks,
Tamara Vos

Hi,
Im new to Fedora Core 6 and Screen-Scraper. I downloaded screen-scraper .bin file but it's not installing and giving following error:

hi :) ,

in the ss log it says that "索尼爱立信 W810c" was collected but after saved into db by ss automatically, it becomes "Ë÷Ã"ᰮâÃÃ… W810c"....

my db table is of utf-8, and the data i want to scrape seems good in log, then how to make the saved db data right as expected?

thanks your help :)

I am trying to scrape and parse this address information and when it comes to a 2 word city it does not parse correctly since there are multiple spaces as shown below..

How can I change the extraction to work for both cases? (1 word or 2 word city)

Hi,

I'm having problems getting started. I've specified Screen-Scraper's proxy settings in the browser, trying different ports. I've specified my corporate proxy in the "External Proxy" configuration. I've tried both IE and Firefox. But all pages load completely blank. The proxy session logs the url requests, but the status for each is always "Error."

Raw request:

I have used the information from Tutorial 3 to be able to successfully scrape a site which changes pages using GET, and have now hit a brick wall on another site using POST (javascript:__doPostBack) which doesnt pass the variable in the URL. I have found the variable that controls the page displayed in the Parameters tab in Screen Scraper and successfully changed it many times on single screen scrapes and got the correct data from the correct page.

(Hit submit, didn't see the post, hoping this isn't a latent dupe)

I have some very simple scripting functions that I'd like to place in an external jar file. It would make scripting a lot easier in many cases, and I'm guessing it's possible it'd run faster, as well?

Here's the problem: I don't know what I'm doing.

:)