Home » Forums » screen-scraper » screen-scraper public support

Issue with Dynamic/ Changing cookies

Hi we have observed this issue with websites which have changing cookies.

When we capture a scrapable file in the headers we find the cookie set as

ASP.NET_SessionId xokrkt453wnjza45ynqqotfc

I try to capture the same scrapable file after some time and observe that
the value for ASP.NET_SessionId has changed.

Due to this doing a session.setCookie() in my first script to any value does not work,
since the script would work for the time being, but not work after some time.

IS there a work around to the same. How can screen scraper handle such changing/ Dynamic cookies

Appreciate your response - Saurabh

‹ Issue with a scraping session which works fine on Windows but fails in Solarris Regex for thousands separator? ›
diptirmaya on 04/01/2010 at 3:23 am

If the cookie is set in the

If the cookie is set in the header, screen-scraper will handle it without problem. When the cookies are set in JavaScript, you may need to track down where the cookie is set, scrape the value, and use that value in the session.setCookie method.

 jason on 04/01/2010 at 8:36 am

Cookies issue

Hi Jason, appreciate the response,

We scanned all the responses from the website, but could not figure out, where the cookie is being set.
It is not present as part of any response. When we capture a scrap able file, you can directly observe
the cookies being passed as a request to the website. Our guess is that it is being set in a separate
JavaScript file before the request is passed. Is there any solution to the same.

Thanks and Regards - Dipti

 diptirmaya on 04/08/2010 at 6:06 am

Hard to say. I've seen times

Hard to say. I've seen times that they do that, and sometimes it's just something else in the request that doesn't match. Could you let me see the session to see if I can figure anything out?

 jason on 04/08/2010 at 11:14 am