screen-scraper public support

Questions and answers regarding the use of screen-scraper. Anyone can post. Monitored occasionally by screen-scraper staff.

Screen scrape Bluezone terminal emulator - How to

Hi there,

I'm a newbie to Screen scraping. We have a 3270 Bluezone terminal emulator.
It uses a Win32 application to connect to the host (mainframe) using ActiveXControl/Java applet.
After establishing the connection we access various info. say reservation number .

Variable Proxy Server?

Is it possible to use a session variable to populate the Proxy Port and Host setting in a scrape? By using something like ~#PROXYHOST#~ and ~#PROXYPORT#~?

I've had luck passing username and password into the authentication settings for a scrapeable file like that, but this is at the session level.

Short of that, is there a way I can set a session's proxy by script?

How might I deal with two identical patterns?

For some reason, the database that I am scraping from occasionally generates pages with identical fields, e.g.

[color=indigo]

 <br />

Subject Swindlers and swindling
Subject Great Britain -- History

unable to loop a scraping session - please help

please somebody help, my loop script is in the root directory and contains

Problems installing on Ubuntu

Hello,

I am trying to install Screen Scraper basic on an Ubuntu Linux server edition. I found in another post where a user was directed to a development version of the program because there were issues.

The setp program I downloaded was setup_ss_basic.sh. I am running the install in console mode, since I am on my server via SSH. Here is the output of the installation - looks like it fails right at the end.

Sorry, but this is kinda long...

Expired Certificate

We've found one of the sites we're scraping has an expired certificate.

Understanding that they need to update their certificate... (my catchphrase around the office is "I can't fix their server")

1. Is there a way to convince screen-scraper that I'm cool with the problem? :)

2. How do I explain to the business side that says "But my browser just ignores it when I tell it it's ok" and wants to know why the scrapes can't just be fiddled with to make it work? (I'm planning on just putting up a buzzword shield..)

R

trying to install on ubuntu gutsy

I'm trying to install screen-scraper on my machine, but it seems to have a couple of bugs, it doesn't seem to be statically compiled for example, so i get these errors

datarecord/dataset : undefined variable or class name pb

trying to scrape a site and I get the following error message (the same whether I use the datarecord or dataset method.
Not to sure why :? ... anybody has an idea?

- An error occurred while processing the script: Write data to new file
- The error message was: Attempt to invoke method: writeToFile() on undefined variable or class name: dataSet : at Line: 1.

tks,

h.

Proxy not working on particular site

I'm having trouble with the proxy working on a site. It works fine for any other standard site. It worked a few days ago but know it won't scrape. I've tried different ports and different browsers. In addition I tried to build it manually but can't get passed the login. I've tried what the tutorial stated on logins but to no avail.

Can you help?

The site is www.collegcoachesonline.com

Thanks

Run scrape session from inside MS Access db via VBA

Hi -

Could somebody give me a steer please on how to call a scraping session externally from inside Microsoft Access db using Visual Basic for Applications?

I have got as far as the following:-

Sub Test_remote_scraping_session()

Dim objRemoteScrapingSession As RemoteScrapingSession

Set objRemoteScrapingSession = ????

objRemoteScrapingSession.Initialize ("My_scraping_session")
objRemoteScrapingSession.Scrape

End Sub