Having trouble replicating Amazon login

Hi,

For some scraping on Amazon I need to first to make SS go through the Amazon login process so that my later scrapes work with SS logged in(amazon shows some info only if you are logged in).

I have recorded the login steps in the SS Proxy, then added the home and the login POST sending page with my login details recorded in the parameters which are set to run in my Scraping Session before anything else.

However, when I run the session, the login POST sending page does not seem to be properly doing the login, and if I check the Last Response of this login page by clicking "Display Response in Browser" I can see that instead of successfully logging in, the same login page is being returned with my email filled and a message that says: "Please Enable Cookies to Continue"

What could be the problem?

Thanks,
BoGa

Assuming your requests are

Assuming your requests are correct, they could set a cookie in JavaScript.

http://community.screen-scraper.com/proxy_session/detectjscookies

I don't know how to fix this.

I don't know how to fix this.

I cleared the browser cookies, then did all the Home > Login sequence manually browsing the pages while recording with the workbench proxy then I stop and click "Detect JS Cookies" and I am getting this message:

"Warning! Cookies were found in the first HTTP request.
For the JavaScript cookie detector to work properly you should clear cookies from your browser before starting your proxy session"

I click OK and I get the window with all the cookies like this:

2       http://www.amazon.com/gp/redirection/india.html Request Header Value    Cookie  csm-hit=M1P5VH940THV5PF4CQ8Q+s-M1P5VH940THV5PF4CQ8Q|1448575061094
15      http://www.amazon.com/gp/redirection/canada.html        Request Header Value    Cookie  csm-hit=M1P5VH940THV5PF4CQ8Q+s-M1P5VH940THV5PF4CQ8Q|1448575061094
16      http://www.amazon.com/gp/redirection/mexico.html        Request Header Value    Cookie  csm-hit=M1P5VH940THV5PF4CQ8Q+s-M1P5VH940THV5PF4CQ8Q|1448575061094
17      http://www.amazon.com/gp/prime/digital-adoption/navigation-bar/191-2237057-3059620?type=load&isPrime=false&referrer=&height=958&width=1918&_=1448575064032      Request Header Value    Cookie  csm-hit=M1P5VH940THV5PF4CQ8Q+s-M1P5VH940THV5PF4CQ8Q|1448575061094
18      http://www.amazon.com/gp/overlay/display.html   Request Header Value    Cookie  csm-hit=M1P5VH940THV5PF4CQ8Q+s-M1P5VH940THV5PF4CQ8Q|1448575061094
19      http://www.amazon.com/gp/youraccount/navigation/sidepanel/191-2237057-3059620?rid=1YMXKKTEZWYCJSNEW8BG&_=1448575065376  Request Header Value    Cookie  csm-hit=M1P5VH940THV5PF4CQ8Q+s-M1P5VH940THV5PF4CQ8Q|1448575061094
21      http://www.amazon.com/gp/product/sessionCacheUpdateHandler.html/191-2237057-3059620     Request Header Value    Cookie  csm-hit=M1P5VH940THV5PF4CQ8Q+s-M1P5VH940THV5PF4CQ8Q|1448575061094
51      http://www.amazon.com/gp/gw/ajax/desktop/herotator/record-impressions.html/191-2237057-3059620?ie=UTF8&aPTID=36701&cmpnId=447894822&cnttId=1&h=421C38C344A73A9DE835CC0A092D11C826D6BC415&mId=ATVPDKIKX0DER&mkId=ATVPDKIKX0DER&pId=2302195042&pIdent=desktop&rId=1YMXKKTEZWYCJSNEW8BG8&sid=14&slotName=desktop-hero-H    Request Header Value    Cookie  csm-hit=M1P5VH940THV5PF4CQ8Q+s-M1P5VH940THV5PF4CQ8Q|1448575061094
63      http://www.amazon.com/gp/gw/ajax/desktop/herotator/record-impressions.html/191-2237057-3059620?ie=UTF8&aPTID=36701&cmpnId=446184482&cnttId=1&h=3E9FA77CE61A429B081B2D9FEED28569020A09FA9&mId=ATVPDKIKX0DER&mkId=ATVPDKIKX0DER&pId=2296543382&pIdent=desktop&rId=1YMXKKTEZWYCJSNEW8BG4&sid=14&slotName=desktop-hero-G    Request Header Value    Cookie  csm-hit=1YMXKKTEZWYCJSNEW8BG+s-1YMXKKTEZWYCJSNEW8BG|1448575072595
65      https://www.amazon.com/gp/navigation/redirector.html/ref=sign-in-redirect/191-2237057-3059620?ie=UTF8&associationHandle=usflex&currentPageURL=https%3A%2F%2Fwww.amazon.com%2F%3Fref_%3Dnav_custrec_signin&gatingWeblabOn=1&pageType=Gateway&yshURL=https%3A%2F%2Fwww.amazon.com%2Fgp%2Fyourstore%2Fhome%3Fie%3DUTF8%26ref_%3Dnav_custrec_signin Request Header Value    Cookie  csm-hit=1YMXKKTEZWYCJSNEW8BG+s-1YMXKKTEZWYCJSNEW8BG|1448575072595
66      https://www.amazon.com/ap/signin?_encoding=UTF8&openid.assoc_handle=usflex&openid.claimed_id=http%3A%2F%2Fspecs.openid.net%2Fauth%2F2.0%2Fidentifier_select&openid.identity=http%3A%2F%2Fspecs.openid.net%2Fauth%2F2.0%2Fidentifier_select&openid.mode=checkid_setup&openid.ns=http%3A%2F%2Fspecs.openid.net%2Fauth%2F2.0&openid.ns.pape=http%3A%2F%2Fspecs.openid.net%2Fextensions%2Fpape%2F1.0&openid.pape.max_auth_age=0&openid.return_to=https%3A%2F%2Fwww.amazon.com%2F%3Fref_%3Dnav_custrec_signin        Request Header Value    Cookie  csm-hit=1YMXKKTEZWYCJSNEW8BG+s-1YMXKKTEZWYCJSNEW8BG|1448575072595
67      https://www.amazon.com/ap/signin        Request Header Value    Cookie  csm-hit=s-3ES7JP0QQW6E9WTK37AX|1448575081694
68      https://www.amazon.com/?ref_=nav_custrec_signin&        Request Header Value    Cookie  csm-hit=s-3ES7JP0QQW6E9WTK37AX|1448575081694

I am lost as to what to do about it and if these are really the JS Cookies that you said that I might have to manually set with setCookie in which case, what should I put.

Thank you for any help with this,
Boga

I proxied this, and it looks

I proxied this, and it looks more complex than I can address in a forum post. I think it would fall under contracted development, but email me if you want me to get you an estimate.