Login problem
Hi Guys-
This is killing me, been working on it for about 2 days now. The site only requires IE and I have been using IE via VMWare on my mac to access it. I had the proxy running while trying to login, but it fails everytime and will not capture the login sequence. I have about 25% of it, but the last part is getting me.
Website: https://www.amtrustgemstone.com/
I have a scrape file setup to go to the main page first and get the cookie then another scrape file to pass the login parameters, that is where I am getting stuck on the login sequence.
I can email you the login and pass, did not want to post it in here.
Jason
| Attachment | Size |
|---|---|
| AmTrust (Scraping Session).sss_.txt | 5.16 KB |
Sometimes the SSL will detect
Sometimes the SSL will detect the proxy, and interrupt it as a man-in-the-middle. In such cases I usually resort to using another proxy to capture the HTTP requests, and then emulate manually in my scraepable file(s).
One good 3rd party proxy is Charles. You might see if that will work.
Jason Thanks for the help. I
Jason
Thanks for the help. I used Charles to capture most of the parameters, but the main problem I am running to now is if it is your first visit to their website they require you to answer a few questions first. I don't think the questions will come up each time in the scrape because it will hold the cookie and know you have been there before and follow the login procedure. I am attaching my current work so you can see where I'm at. This one has really got me! All of my hair is about out after this one!...lol
Jason
Jason & Jason, I had created
Jason & Jason,
I had created a test scraping session for Jason's, er, Jason's client back in November. I just sent it to you, Jason, because it contains code where I was handling the challenge questions.
Hope it helps.
-Scott