Changing the URL of a ScrapeableFile Dynamically
My scenario is kinda similar to the one in http://community.screen-scraper.com/node/1263 wherein the URL that I would post to, gets redirected to another URL which contains dynamic entries in its path. If I manually add scrapeable files into the scraping sesson I'm building using the Proxy Session, obviously, the URL path will have static values that were created at that point in time.
I followed the advise in http://community.screen-scraper.com/node/1274 to get the current redirected URL and have extracted the dynamic items. My question is -- is it possible to change the URL of an existing scrapeable file via a script before it is executed? I need to rewrite the URL to use the dynamically generated values. There seems to be no scrapeableFile.setUrl() or something similar to that.
Is the only solution to this problem to do the whole thing via script files?
I assume you're seeing a
I assume you're seeing a JavaScript redirect that screen-scraper doesn't automatically follow. In such cases, I always make 2 scrapeable files: the first goes to the page to get the parameters, and the second to make the request with the dynamic parameters set via variables. Should be no need to try to reuse the same scrapeable file again.