Unable to scrape website
I have been able to scrape the site www.theice.com for a couple of years. Then a week ago screen-scraper stopped being able to see it. When I run the scrape now the log shows:
Scraping file: "ICE Test"
ICE Test: Resolved URL: https://www.theice.com
ICE Test: Sending request.
ICE Test: An input/output error occurred while connecting to 'https://www.theice.com'. The message was peer not authenticated.
I am able to see it in a browser but if I run the proxy I get a ERR_SSL_PROTOCOL_ERROR message.
Has anyone experienced this before?
We've seen many of these
We've seen many of these lately. They've changed the SSL certificate, and version 6.0 can't handle it. If you have a licensed version, you can update and it should work.
Instructions here.