screen-scraper support for licensed users

Questions and answers regarding the use of screen-scraper. Only licensed Professional and Enterprise Edition users can post; anyone can read. Licensed users please contact support with your registered email address for access. This forum is monitored closely by screen-scraper staff. Posts are generally responded to in one business day.

Privoxy Issues using V5.5

I often use a free proxy for testing before switching to a paid proxy for production. I have had no problems using Tor and Privoxy prior to V5.5 for this purpose. I get HTTP errors ("Software caused connection abort" or "Target server failed to respond") with the new Enterprise V5.5. If I revert to V5.0 I have no issues. Is there a known issue or easy fix? Thx

Strange connection error

I'm having trouble debugging this one. I've never seen a message come back as null on a "input/output" error.

"An input/output error occurred while connecting to 'http://www.orbitinfo.net/ViewImagePopup.aspx'. The message was null."

I'm moderately sure it's making the call to the server, but it works great in a browser, and nothing funky appears to be going on. However, I cannot see ANYTHING in the "Last Request" window. Which is odd.

I can't say for sure, but I think this was working before our last set of upgrades. :(

Scraping file: "Proxy Popup"

Confusing https situation

So I have this site:

https://pa_allegheny.uslandrecords.com/palr/controller

And it's https, no problem. Works in a browser. However, when running it through the (ver5.5.4a) proxy I get an error:

Error 107 (net::ERR_SSL_PROTOCOL_ERROR): SSL protocol error.

Ok, fine, proxy can be strange some times (have never had this issue before, however) so I'll do it by hand. I use tamper with firefox and get the http request response flow and start plugging URLs into screen-scraper, the first being the simple:

https://pa_allegheny.uslandrecords.com/palr/controller

Bug when creating new ScrapeableFile

I'm using version 5.5.5a. Here's how to reproduce:

1. Select any scrape in the workbench.
2. Click the button that says "Add Scrapeable File"
3. Select the new Scrapeable file that was just created.

It only shows the main info for the scrape, not the new tabset for the scrapeable file. You have to close and reopen screen-scraper to get it working. This seems to be new with this version.

Where can I find previous version for testing?

Hello,

I would like to downgrade my 5.5 Pro install to 5.0 for testing purposes and I
am having trouble finding earlier versions.

Regards,
M

Multiple Post Parameters with same name

Hi,

I have a site I am scraping and I am entering data. But there are post parameters with the same name but have to have different data. So I have assigned different variables to the parameters but the same variable is being assigned to the multiple parameters. I have named the two parameters differently. This seems to be the only reason for it as when I test the extractors the correct data is being extracted for the variables but not assigned. I was wondering if there is any way around this.

Thanks in advance,
Seamus

Status Code 500

I'm having a problem getting logged into a site.
I get a Status code: 500 and don't get logged in.
Here is the site:http://gatewayfsb.lpx.com/v40/BuildPage.aspx?Page=58
I'll email the userid and pwd to scott.

Thanks

Error with SqlDataManager

Hi,
I am using the SQLDatamanager object and methods following the examples in the documentation.
In the script that writes to the database which is executed after the extractor pattern is applied, I have an error in shown in the log and the script doesn´t write to the database. The error is:

Processing script: "Write to database"
An error occurred while processing the script: Write to database

Stuck using manual pool of proxies...

Hi there,

I am using the example for using a manual pool of proxies. I copied and pasted the example shown here:

http://community.screen-scraper.com/anonymization_via_manual_proxy_pools

I also got a txt with anonymous proxy servers in the format ipadress:port in each line and with a total of more than 900 entries. The name of the text file is proxies.txt(which is called from proxyServerPool.populateFromFile) and it is located in the main screen_scraper application folder. I am using Mac Osx

When I start the scraping session this is what I get in the log:

 

subextraction patterns with no content no longer picking up whole extraction?

I am on version 5.5.2.

Prior versions of screen-scraper would give me blank results when content was unavailable, but now I'm not getting any at all. This is a pretty big deal for me, and I just want to know if it's a bug or a feature, and either way how I might address it.

<tr><td class="firstcolumn">foo</td><td class="secondcolumn">bar</td></tr>
<tr><td class="firstcolumn">ack</td><td class="secondcolumn"></td></tr>
<tr><td class="firstcolumn">foo</td><td class="secondcolumn">bar</td></tr>
<tr><td class="firstcolumn">foo</td><td class="secondcolumn">bar</td></tr>