Embedded Parameters In URL

I need to iterate through a number of web pages with the following URL format:

http://www.company.com/info/0,,12345~9876,00.html

with the value 9876 changing for each new page.

Please advise?

matekus

Just as with parameters

Just as with parameters passed to the scrapeable file, you can also use the ~#varname#~ syntax in the URL field as well. This would make your url look like this:


http://www.company.com/info/0,,12345~~#PAGE#~,00.html

One thing to note, though: When variables are used in the parameters tab, screen-scraper will automatically do all the URI-encoding. When you use variables in the URL, it will not. Simply put, a non-alphanumeric character will work in a parameter, but in the URL, it will most commonly cause an "input/output" error in the screen-scraper log.

Since you're using just a number, you likely won't run into this issue. But just know that if there is any chance a non-letter/number character is in the variable, you need to turn it into its hex equivalent (ie, a space turns into "%20").

Tim

That Worked!

Thanks Tim.