Expired Certificate
We've found one of the sites we're scraping has an expired certificate.
Understanding that they need to update their certificate... (my catchphrase around the office is "I can't fix their server")
1. Is there a way to convince screen-scraper that I'm cool with the problem? :)
2. How do I explain to the business side that says "But my browser just ignores it when I tell it it's ok" and wants to know why the scrapes can't just be fiddled with to make it work? (I'm planning on just putting up a buzzword shield..)
R
Expired Certificate
Robert,
Those error message may help but what we really need is a site who's certificate had expired so we can see what's being passed in the header and to test with.
If you come across another site let us know.
Thanks,
Scott
Expired Certificate
Happily/Sadly, the site updated the certificate. But here is the error screen-scraper gave me:
“(4) Search Menu: An error occurred while connecting to 'https://pacer.login.uscourts.gov/cgi-bin/login.pl?court_id=00idx'. The message was java.security.cert.CertificateExpiredException: NotAfter: Wed Jan 02 17:59:59 CST 2008.â€And if it helps, this is from the same site, scraped with some old vb code:
“The underlying connection was closed: Could not establish trust relationship with remote server.“Expired Certificate
Robert,
Are you getting any kind of error message when scraping? I tried a small test on a mismatched certificate and screen-scraper didn't complain but I don't know of any expired certificates to test on. Could you share the site with me and I'll test it?
Thanks,
Scott