Home » screen-scraper

screen-scraper support for licensed users

Questions and answers regarding the use of screen-scraper. Only licensed Professional and Enterprise Edition users can post; anyone can read. Licensed users please contact support with your registered email address for access. This forum is monitored closely by screen-scraper staff. Posts are generally responded to in one business day.

Running multiple instances

I'm in the process of upgrading from 4.5 to 5.0. I followed the instructions on this page http://community.screen-scraper.com/MultipleInstances. (There is no link to this page from the FAQ list. The only way I found it was on a tiny link on the install wizard). The workbench works fine, but when I attempt to run in server mode and attempt to start a session from a java program, the calling program blocks and I never see the session starting. This is now the case for the new 5.0 instance and the original 4.5 instance. I uninstalled the 5.0 and the 4.5 is still behaving this way.

bbaron on 08/24/2010 at 12:48 pm

Cannot download images when running remote scrape session from external asp.net program code

Please help! I created a scraping session to scrape/download images from amazon.com. This works perfectly inside screenscraper, but when I try to do the scraping remotely from an external program written in asp.net no images are downloaded. What am I doing wrong? Here is my code:

Private Function RunScrapingSession(ByVal product As String, ByVal productid As Integer) As Boolean
        Dim remoteScrapingSession As RemoteScrapingSession

        Try
            remoteScrapingSession = New RemoteScrapingSession("Amazon Images")
        Catch ex As Exception

sthaynes on 08/18/2010 at 8:17 am

Output text with commas to a CSV

I am outputing variables of text that include commas.
EXAMPLE
YEAR = 1989
TITLE = SHAFT, THE GRAPHIC NOVEL
ISBN = 0987434231

I want these entries to be separate but not split the title into two entries. Any suggestions?

Sorry about all of the noobie questions and thanks for all of your help!

Andrew

andrewbkillen on 08/10/2010 at 3:01 pm

Can't Use More than 1024MB of memory

I am running some fairly large scrapes and I am running into outofmemory errors quite frequently. I was just wondering if there was any way to set the memory allocation higher than 1024MB. I am in the process of making my scrapes more efficient by using some tips from http://blog.screen-scraper.com/2008/07/07/large-data/ . Any reason why I can't use more memory to help alleviate this problem?

andrewbkillen on 08/10/2010 at 11:51 am

SqlDataManager.getColumns etc. not working with Oracle?

Hi,
I'm trying to add data and such to my database with the new SqlDataManager. I have two questions.

1: Problem #1 is that I can't get it to work. I get an NullExecption with this line:

s = dm.getColumns("MY_TABLE");

I can't find out where I went wrong. Might it be an Oracle specific thing?

2: Is it possible to use Eclipse for this? I can't get it to work, because the SqlDataManager takes a session parameter.

import com.screenscraper.datamanager.sql.*;
import com.screenscraper.datamanager.*;
import org.apache.commons.dbcp.BasicDataSource;

gpalsson on 08/09/2010 at 9:38 am

Downloading an Captcha Image generated by a .NET/ASP Site

I'm working on scraping a site that is generated by by a .NET/ASP system which generates a captcha on some pages, but I am having difficulty actually downloading the Captcha.

theburningor on 07/26/2010 at 7:23 pm

j_transactionid

Hello Support:

My local MLS recently changed their format for login. The j_transaction POST type value changes everytime I login, but I can't figure how the value is generated. The URL to the login into the MLS is:

http://idp.socal.safemls.net/idp/Authn/UserPassword

The parameters is as follows:

Adrianjay on 07/18/2010 at 11:44 am

Linux install errors....

Hi, we are currently trying to install the enterprise edition on our Red Hat box. We had it on an OSX machine and we are attempting to move it. Our Linux Admin used the command line installer (no GUI on the box) and receieved the following errors:

Setting the install directory to: /usr/local/screen-scraper_enterprise

ajlisowski on 07/12/2010 at 6:47 am

The system is too busy to handle the file download at this time

Hi Support:

This screening scraping session has been working for the last few months but I just started receiving the following message in the log:

Adrianjay on 07/11/2010 at 4:33 pm

Issue observed with an extractor pattern in Linux/ Solaris

We are observing an unique issue with a extractor pattern. When we run the session / extractor pattern
in the development environment which is windows we get the response from the extractor pattern in a few seconds.

The same session when deployed in Linux/ Solaris environment, takes about 7-8 minutes for the extractor pattern to apply
as we observe from the logs.

Any inputs on the same.

Thanks and Regards - Dipti

diptirmaya on 07/06/2010 at 5:03 am