Home » screen-scraper

screen-scraper support for licensed users

Questions and answers regarding the use of screen-scraper. Only licensed Professional and Enterprise Edition users can post; anyone can read. Licensed users please contact support with your registered email address for access. This forum is monitored closely by screen-scraper staff. Posts are generally responded to in one business day.

Proxy Options

Looked through the docs and I just want to see what my options are for external proxies. Is it true that I can only say "Do this session" and not specify scrapeable files? The reason I ask is because we use an external proxy to get to a site, but we have to hit an internal (to us) decaptcha service in the mix. And since that uses the session proxy, it goes outside the firewall and can't see our internal service.. If that makes sense.

fnirt on 08/04/2011 at 9:48 am

Urgent Help needed

Hello Everybody,

I am trying to scrap data from shopzilla

URL :-

http://www.shopzilla.com/gen385822/search?absoluteMinPrice=21&absoluteMaxPrice=45&minPrice=21&maxPrice=45&priceRangeSubmit=&sort=priceAscending&show=20&zipcode=zip+code

I am trying to scrap price with merchant name..

And I am getting Warning! Received a status code of: 405.
I dont know how I would fix this....

Any any help would be aprreciated...

Guys its really urgent

Thanks
Mankss

mankss on 07/27/2011 at 10:28 pm

9003 Errors - Unable to bind ports

Since switching to the Enterprise version I have all kinds of issues actually opening the appliaction to add new scrapes. I have quite a few scrapes running throughout the day and as such when they are running i am unable to get into the application. I get the 9003 error which looks like the database has been locked.

Webcore on 07/26/2011 at 5:11 am

Does Interpreted Java (Beanshell) in screen scraper support enhance for loop and class declaration?

int [] array = new int [] { 1, 2, 3 };

for( i : array )
        system.logError(i);

gives me a
The error message was: class bsh.ParseException (line 3): :-- Encountered ":" at line 3, column 8.

also
class Item()
{
        Item();
        String desc = "";
       
        getDesc() {
                return desc;
        }
        setDesc(String s) {
                desc = s;
        }
}

Item item = new Item();
item.setDesc("123");

session.logError(item.getDesc());

gives me
The error message was: class bsh.ParseException (line 1): class-- Encountered "class" at line 1, column 1.

Test-Scraper on 07/25/2011 at 12:49 pm

Csv writer

Does the Csv Writer support writing in other format? such as in greek, etc.

Test-Scraper on 07/13/2011 at 6:17 pm

Webpage error breaks rest of scrape

This is kind of an odd error, so I'm going to describe it first, and if that doesn't work, I'll attach a sample scrape to demonstrate. First, go to http://www.familydollar.com/pages/store-locator.aspx. Then type in 56686 for the zip code and Search. You come up with the error. You can then click the back button or the link that says "Go back to site" to get back to the locator. At this point you could put in a different zip code and it works fine, like 56687.

chrishathaway on 07/07/2011 at 2:35 am

classpath precedence issue

Is there a way to make my beanshell scripts give jars in lib/ext preference over those in lib itself? I'm trying to use a customized version of a class already in a jar in lib, and the classloader won't see the one in lib/ext.

Thanks :)

tmonaco on 06/23/2011 at 3:02 pm

Screen scraper crash when importing

Not sure why but sometimes when i import a scraping session, screen scraper crashes.

Screen scraper version 5.5.2
os: vista ultimate x64

Test-Scraper on 06/21/2011 at 4:39 pm

I am trying to get any method of external control working, anybody have suggestions

Scene Setting:-

I am using the latest version of Screen-Scraper Enterprise 5.5.9a (I re-downloaded yesterday and re installed just in case), I am running on windows 2003 server. I am completely up to date with Windows Update, I am configured to run 10 scrapes at a time and I think I am up to date with the JVM as far as I can tell, I am in Visual Studio 2008 environment, MVC 1.0 .Net 3.5. I have tons and tons of experience programming... I have been using and writing scrapes for 9 months now. and have many scrapes that work - providing you run them in the workbench one at a time

JulianGuppy on 06/21/2011 at 5:36 am

Web Interface doesnt work

Hi Guys,

I noticed that, from time to time after i reset server in linux GUI-less my Web Interface doesnt work at all, is displaying just a white page or (have no clue why) Access denied.
Any ideas where might be a problem?

Best Regards,

Radek

Radek on 06/20/2011 at 6:20 am