Dynamic Parameter List
I'm trying to pull a list of doctors from the Medicare site (http://www.medicare.gov/Physician/Home.asp?bhcp=1), and I'm running into a problem with the parameter list for the scrapeable file.
Once the criteria are entered, the site compiles a list of IDs which it sends to the results page. When I add the results page to my scraping session, I see that there is a separate parameter for each ID. The number of IDs changes depending on the criteria entered.
I can capture the IDs, but I don't know any way to dynamically incorporate them into the parameter list before submitting the scrapeable file. Any ideas?
Thanks.
Dynamic Parameter List
John,
Have a look at the addHTTPParameter method. It should be what you need. We also have an as-yet undocumented remove http parameter method that I can further explain if you need it.
-Scott
(admin edit to fix broken URL)