screen-scraper public support

Questions and answers regarding the use of screen-scraper. Anyone can post. Monitored occasionally by screen-scraper staff.

Parse out Duplicates?

I have a piece of code that I need to parse out.

onmouseover="ddrivetip('Herold Herold Assistant*
Jun 2009
7.17','#F5E7AF')" onmouseout="hideddrivetip()" />

I need to retrieve the data into two variables:

Company: Herold
Product: Herold Assistant*

Since "Herold" is a duplicate word, how do I go about extracting these two variables?

reading from .csv and skipping certain records

Hi all,

Newbie to screen scraper so please bare with me!

I have utilized the CSV With Quotes script to initialize the parameters I require. I do however get some timeouts when scraping so want to populate another file after the initial scraping session to attempt to get the missed data. Which in principal is easy enough to do… However I want to be able to pick only certain values to use in different scraping sessions.

i.e. the file will be like the following

Executing a ScrapeFile from an External Program

I want to execute a scraping session from an external program using either SOAP or by linking to the .NET DLL's. I can't figure out how to do the following:

1. Start a scraping session from the external program;

2. Pause the session after running the first couple of scrapefile's and extract data gathered so far;

3. Based on the extracted data from #2, let the external program get some more user input through some web-based form (ex. perhaps the website can be asking for some 'secret question' that requires human input before scraping can proceed to succeeding pages);

Help Firefox

Hallo,
I often use Firefox, a great browser, and sometimes go to Tools - Options - Security - saved password to read and erase the passwords for the sites that I visit.
Do you know if there is a way to shorten this path, maybe insert something in the toolbar to speed up this task?
Thank you

Unable to configure Proxy

Hi,

I'm on a mac and tried configuring Safari, Firefox, and Opera in accordance with the instructions here

http://community.screen-scraper.com/configuring_firefox

and in the other browser-specific guides.

I get a proxy error each time and don't have the specific error on me right now, because my account here just got activated and I tried screen-scraper out just over a month ago.

Unable to configure Proxy

Hi,

I'm on a mac and tried configuring Safari, Firefox, and Opera in accordance with the instructions here

http://community.screen-scraper.com/configuring_firefox

and in the other browser-specific guides.

I get a proxy error each time and don't have the specific error on me right now, because my account here just got activated and I tried screen-scraper out just over a month ago.

Different result using Proxy then Screen scrape session

I have a weird problem. I am trying to scrape a page for a price. When I use the Proxy server to scrape and then create a scrapeable file the first time I go to progress I can see the price, I get this code and paste into extractor (I replace the 263.26 with a session variable)

 <span class="lprice">&#163;263.26</span><br />
                        <span class="price">inc vat</span>

so I create an extractor pattern. When I then run the session it doesn't find any data the code has changed to the following:

Xmx64M

Hi guys

/usr/lib/jvm/java-6.../jre/bin/java -Xmx64M - classpath /home/xxx/screen-scraper.jar com.screenscraper.util.startHypersonic 9001

How could I modify the Xmx64M to any number i want? 64M is too small to scraper a big site.

br
Max

Redirecting to Log out

Hi,
I found an alternative of downloading the trial version so I can connect with the browser but I still have a problem... it redirects to the logout page. I think it is a configuration issue but I haven't a clue yet. any ideas?

Unable to scrape website with French characters (again)!!

I'm sorry to bother you again, but I have always my problem with French accent when I tried to invoke screen-scraper from Java . It seems not to be a hard problem but a have no response.
I would like to buy Screen Scraper Professional but I want to evaluate it before