screen-scraper support for licensed users

Hi

I seem to be struggling of late. I am trying to scrape a not very well put together site.

I would like to save the 'PRODUCTID' from the search results scrape into the same row of my csv file that I am writing to in my dataset from the product page.

I am trying to scrpae this site: http://www.rygor.usedtrucks.mercedes-benz.co.uk/used
The product page itself looks easy enough to scrape, I just cannot get the URL of each product?
An XML file is produced that has the data to be able to construct the URL, but I do not know how to replace the blank spaces in one of the fields with a hyphen to enable me to build the url.

Can someone tell me how to do that or offer an alternative solution?

Thanks

Jason

Getting this error although I have downloaded Microsoft JDBC Driver 4.0 for SQL Server's sqljdbc.jar and sqljdbc4.jar and placed them under lib/ext. I have also downloaded the latest JRE 1.7.

I have also setup the following CLASSPATH=C:\Program Files\screen-scraper Enterprise Edition\lib\ext\sqljdbc4.jar

Please help!!!

Thanks!
Joe

Hi,

embarassingly enough, I have lost the license key to our Screen-scraper professional through a catastrophic disk mishap. How can I obtain the key again?

best regards

Christian Pieler

I need some help increasing my Java skills. I working in IT but I want to get better at my scraping skills.

Books or free online video tutorial links would be greatly appreciated.

I've added a script to run before a scrapeable, "Next", file is run called "Add Parameters".

In "Add Parameters" I've added the following line:

void scrapeableFile.addPOSTHTTPParameter("mortgage_products", "1006");

When I run the scraping session I get the following error:

Scraping file: "Next"
Next: Processing scripts before a file is scraped.
Processing script: "Freddie--Add Parameters"
ERROR--Freddie: An error occurred while processing the script: Freddie--Add Parameters

I'm trying to access the calendar of this page: https://www.airbnb.com/rooms/1371522. The calendar is at: https://www.airbnb.com/rooms/calendar_tab_inner2/1371522?cal_month=8&cal_year=2013&currency=USD when you capture it with the proxy. I'm not sure what I'm missing, but the server needs something that I'm not provide before it will return a valid page.

Thanks,

Jeremy

At the following link (http://www.genetex.com/ATM-antibody-2C1-GTX70103.html?NavigateType=4) the top right "Add to cart" section contains "100 μg". When I open the page with screen scraper I get "100 ?g". The site header returns UTF-8 which is what I'm using without any success. I've also tried every character set and nothing works.

I'm running the latest released Pro version on Windows 7 Ultimate

Hi.

I have been succesfully using the feature of developing in a SS Workbench in my mac and uploading to a SS Linux machine to the "import" folder. This has allways worked.

Today, however, I am running a scrape in my Linux box and by the terminal messages it´s obviously an older version, not the one I am uploading to the "import" folder. I have tried a many times, and I have also updated the Linux SS to latest version just in case, but same thing. It keeps using an older version of my scrape.

What could be the problem?
cheers,
boga

We have a scrape file that posts a form with multiple inputs.
We are having a problem posting the session variable for the textarea input when applying newline.

When recording the form submission through the SS proxy the parameter value is:

comments=Comments+Line+1%0D%0AComments+Line+2%0D%0AComments+Line+3%0D%0AComments+Line+4

This works exactly as required and expected.

However, when we pass this value as a session variable we cannot replicate this.
If we duplicate the above the + is encoded and %0D%0A show in the textarea.