Passing "%" in parameter
I want to make a call to a url with parameters containing the percent symbol (%) like so:
http://www.someurl.com?id=%99%9D%9B%9C%98
If I try putting "%99%9D%9A%9A%9B" as-is in the Parameters tab, the '%' gets expanded so that the actual URL being called is:
http://www.someurl.com?id=%2599%259D%259B%259C%2598
If I try using something like java.net.URLDecoder.decode(id, "UTF-8") on the parameter prior to passing it to scraper, the actual URL changes to:
http://www.someurl.com?id=%EF%BF%BD%EF%BF%BD
What is the correct way of doing this?
If you use the parameters
If you use the parameters tab, it always tried to encode them. In this case, I would just add the GET parameters to the URL on the general tab ... that one won't attempt to encode it for you.
Is there a way to dynamically
Is there a way to dynamically modify the URL on the general tab during runtime? The URL that I'm trying to scrape generates that GET parameter with the % on-the-fly. So I don't know ahead of time what the URL will be. I'm using extractor patterns to determine what it should be during runtime.
You can put a session
You can put a session variable in that field. Just like