Home » screen-scraper

screen-scraper support for licensed users

Questions and answers regarding the use of screen-scraper. Only licensed Professional and Enterprise Edition users can post; anyone can read. Licensed users please contact support with your registered email address for access. This forum is monitored closely by screen-scraper staff. Posts are generally responded to in one business day.

Workbench setup of Tor

I recently downloaded the tor package but simply cannot get SS workbench pick up the proxy. As I remember, this was a pretty simple setting. I'm using Localhost:9050.

Has anything changed recently?

Best regards

Johan on 07/09/2012 at 10:13 am

Manually setting cookies still isn't working

Try scraping this URL:

http://www.katespade.com/on/demandware.store/Sites-Kate-Site/default/Stores-Find

You'll notice the response says something about having to enable cookies, and it won't perform a search after that. I looked into the JavaScript, and found this code that was determining whether cookies are enabled:

cookiesEnabled : function() {
                                var currentCookie = document.cookie;
                                document.cookie = "Enabled=true";
                                var cookieValid = document.cookie;
                                var result = false;
                                if(cookieValid.indexOf("Enabled=true") != -1) {
                                        result = true;
                                }

chrishathaway on 07/06/2012 at 6:33 pm

Login System using javascript window.location

Hi Screen Scraper

Let me start off by thanking you guys for developing such a great product, it's helped us a lot with saving information out of a web based application that requires logging in to pull reports. The website recently changed their log in page as they are splitting up their american customers from canadian, adding a .ca domain.

csc077 on 06/21/2012 at 4:13 pm

Launch Problem from Desktop

I tried to start SS from my desktop and received a message I've never received before and didn't know how to fix it. Please see the attached screenshot from my desktop. Thanks in advance for your help!

Adrianjay on 06/20/2012 at 9:27 pm

Extract license data

I have a license for screen-scraper - but don't seem to have recorded it in my massive 'licenses.rtf' file where I have 100+ license keys detailed going back many years. So how can I extract/find the license key in use on my current machine, so I can move it to my new development machine?

massoft on 06/06/2012 at 5:18 pm

connection refused to 127.0.0.1:8778

I am running the scrapper server at Win2008 and IIS7. and getting the follow error.

"No connection could be made because the target machine actively refused it 127.0.0.1:8778"

Any Help please???

Thanks
Biru

brianjhammond on 06/01/2012 at 6:06 am

V 6.0 "Feature"

After upgrading to V6.0 SSc has begun scrambling the lower part of the display. This behaviour starts shortly after beginning to use the workbench. "Work-around": minimize / maximize SSc's window. No other program has a problem. System: WinXP, 3GB RAM abvailable, Display 1680x1050, 16Bit

What can be done?
best reagrds

Christian Pieler

cpieler on 05/30/2012 at 4:15 am

session-object in external scripts?

Can I get access to the session-object in external scripts, like in the scripts I use in workbench.

I'm trying to find the equivalent of session.scrapeFile(String scrapeableFileIdentifier) in my java program.

But RemoteScrapingSession don't have a method for doing that. Is there a simple way to do it?

tomkri on 05/25/2012 at 6:37 am

Problem with ISO8859-15

when I try to read a page that uses ISO8859-15 (Latin 9) with
session.setCharacterSet( "ISO-8859-15" ) and tidying OFF, I get a question mark where the character

http://www.gymel.com/charsets/ISO8859-15.html#U0161

should appear. This is BEFORE sutil.convertHTMLEntities is applied.

Java itself (tested in Ecplipse) handles the character correctly.

best regards

Christian Pieler

cpieler on 05/11/2012 at 8:57 am

duplicate entries

Hello .. I have a problem ...;-)

I scrap a page and filter the next "PAGE".

The works flawlessly .. was reached until the last page (example No. 8) ..
If the page has reached 8, is always stored in the variable, the variable 8, and again scanned the page 8.

Unfortunately, I find no possibility that may occur in the variable "PAGE" no duplicate entries.

In my Enterprise Edition I think, unfortunately, under "Advanced" option to "filter duplicate records" does not.

Can anyone help with my problem?

Thank you very much
Boergi
::::::::::::::::::::::

Boergi on 04/26/2012 at 4:19 am