screen-scraper public support

Questions and answers regarding the use of screen-scraper. Anyone can post. Monitored occasionally by screen-scraper staff.

SSL Error - No Trusted Certificate Found

A scraping session that was working fine has started failing after the website server renewed their SSL certificate (verisign). Here is the error that I now get:

sun.security.validator.ValidatorException: No trusted certificate found.

I am able to access the website with IE explorer and Firefox without the error. However the proxy firefox session fails also through firefox.

Any suggestions on how to get screen scraper to accept the updated SSL certificate? Any help is much appreciated!

Thanks.

Multi Web Image Download......

Dear.

i have to download one or more images in web page.
i just know it that 's possible from Session.DownloadFile(a, b) method.

please explain the detail how to do.
sorry for many question.

bye. :oops:

Multi-page form scraping

Hi all

I'm new to screen-scraping and before I spend hours going through the tutorials I just wanted to know if screen-scraper can do what I need it to do.

I'm looking at scraping a 5 or 6 page form, from a car website which contains postcode lookups, car registration lookups and various validation amongst other things. I need it to look as though the form is actually on our site, so we can pass the customers over to the scraped site at the end of the process for the final quote.

is this possible?

thanks

Basic and HTML tidy

I'm using the basic editon and in the settings menu you can select if you want to tidy HTML after scraping, but no matter what I choose (on or off) HTML tidy stays on (I've tried to exit and restart the application also).

I can't seem to turn it off, and it messes up the charset of the page (ISO-8859-1). Either I'm doing something wrong or this seems to be bug.

Will pay for help!

I'm looking for someone to assist me in scraping an ecommerce site.

Very basic get details write to file. Would also like to grab product files.

Budget around 100.00

Contact me for details

remove spaces
tobad78 @ yahoo.com

phpbb scrape file

Has anyone created a scrape file to scrape a standard phpbb2 board?

Problem of Encoding

Dear.

i have a question.

[b]our work is scrape from different site of different encoding type.
so we want to scrape data right encoding type by one pass through in interpret Java scripts.[/b]

how can i do that?

fsockopen unable to connect to 127.0.0.1:8778 screen scraper

Hi there

I have had no end of problems trying to figure out what is causing this error.. I run screen scraper the linux server version on a cron job.. it runs fine for weeks and then all of a sudden dies with this error message. Any ideas???

Starting screen-scraper...

Warning: fsockopen(): unable to connect to 127.0.0.1:8778 (Connection refused) in /home/intfxco/screen-scraper/misc/php/remote_scraping_session.php on line 98
Connection refused (111)
root@taipan [/web/intfxco/screen-scraper]#
root@taipan [/web/intfxco/screen-scraper]#

Can't login to site using s-s proxy

I'm having trouble with a secure site login - if I use the s-s proxy the login seems to fail, though doesn't explicitly say so, and redirects back to the blank login page. I have tried using IE and Firefox.

[I have of course tested I can login fine without proxy]

I am happy to provide data files/responses etc if it helps.

Any help appreciated.

DAvid

Pattern doesn't fit, but still extracts?

I have a bit of a problem. I've set up a scraping session and all the necessary scripts and I have it working almost perfectly. The one problem I do run into is that there's an area of the website that varies. There's either 1, 2 or 3 table cells.

So I've made a extractor pattern for each variation like so:

1 Table Cell: