Referrer

Just curious-- Is there any subtle "referrer" difference between letting scrapableFiles run in sequence versus chaining them together with scripts? Moreover, would a single script calling several scrapableFiles share the same referrer for each scrapableFile's request (as if each scrapeableFile gets pushed onto the stack and then popped before the next one runs)?

It *looks* like none of those things matter, that the referrer is always exactly what you'd expect it to be, given the scraped order of files...

I can't say that that's exactly what causes my problem, but it raised the question, and I didn't have a solid answer for myself.

Thanks.

My understanding is that

My understanding is that unless you manually set a referrer, it reflects the HTTP response immediately previous to this one.

Say you have a page with 10 search results for which you use a script to call the scrapeable file "Details" for each. On the first details page the referrer will be the details page, on the second details page, the referrer will be the 1st details page.