HTTP Client - Security Problem
Hello Screen Scrapers,
I have created my scraping session to connect to a secure site that if I visit using IE that checks to see I have my Trusted Connect Smart Card in,
prompts me to choose a key (digital certificate being the smart card) from a list and enter my pin.
If I create my Scraping session and configure it to use Internet Explorer as the HTTP Client and run my scrape from the GUI it prompts me for the key and pin and happily scrapes away.
However I would prefer to run a Remote scraping session so i can do multi threads.
When I run my scraping session remotely it prompts for the key but the list is blank so I cannot choose a certificate to authenticate to the site.
Is there a way the get the Remote scraping session to use IE as the http client also?
Thanks for your help
gfusion
HTTP Client - Security Problem
Hi,
Have you tried running your scrape from the command line? That's generally the route we recommend for longer scrapes. You can find more on how to do that here
http//www.screen-scraper.com/support/docs/invoking_screenscraper_from_the_command_line.php
Kind regards,
Todd
HTTP Client - Security Problem
Yeah it only seems to work with Internet Explorer so I am a bit lost.
The main problem I have is that running a really long scrape from the GUI causes it to freeze and after about an hour it stops running and hangs.
The way I know it stops is it stops writing to my output file.
HTTP Client - Security Problem
Hi,
Thanks for the posting. I have to confess, I've never heard of this method of authenticating to a web site. Can I assume this is something that only works with IE (e.g., not Firefox)? If it's IE only, then it may be trickier to automate passing your certificate, but may be possible.
Kind regards,
Todd Wilson