How to change the URL in a scrapeable file?
One of the tasks I will have to do after I learn screen-scraper is to check web pages whose URLs change periodically, perhaps once a day or more. In order to handle this, I am thinking about doing this if possible: The .NET program will determine what the URL of the web page is likely to be. Use a .NET program to change the URL contained by a scrapeable file before the program tells it to scrape the web page.
Is it possible for a .NET program to change the name of the URL contained by a scrapeable file before it scrapes a web page? If so, how would you do that?
Gary, Yes, you can set the
Gary,
Yes, you can set the URL of any scrapeable file simply by referring to it as a session variable.
Have your .Net set the URL as a session variable then refer to it like so in the URL field of the scrapeable file.
~#myURL#~If you know that the domain won't change and it will always be a php file you could also do something like this.
http://www.mydomain.com/~#myPartURL#~/~#myPHPFileName#~.php-Scott