Thanks for the suggestion. We plan on creating more tutorials that will provide further examples, but for now feel free to post your specific suggestions to this forum and we'll do our best to help.
Regarding the specific case you present, you could generate full or partial URL's in an external program (e.g., PHP or ASP), store them as session variables, then make use of them in the URL field as in the tutorials. For example, you could generate the URL "http//www.foo.com", store that in a session variable called "URL", then use the following in the URL field of a scrapeable file
~#URL#~
to embed the value at runtime. More commonly you might do something like this
Thanks for the posting. Our third tutorials is intended to cover many of the basic tasks that are common in scraping sites. Could you give a few specific examples you'd like to see? We're definitely interested in improving out tutorials and documentation. Any suggestions would be helpful.
Web Data Extraction
Example scripts?
Hi,
Thanks for the suggestion. We plan on creating more tutorials that will provide further examples, but for now feel free to post your specific suggestions to this forum and we'll do our best to help.
Regarding the specific case you present, you could generate full or partial URL's in an external program (e.g., PHP or ASP), store them as session variables, then make use of them in the URL field as in the tutorials. For example, you could generate the URL "http//www.foo.com", store that in a session variable called "URL", then use the following in the URL field of a scrapeable file
~#URL#~
to embed the value at runtime. More commonly you might do something like this
http//www.foo.com/search.php?search_term=~#SEARCH_TERM#~
where "SEARCH_TERM" is a session variable holding the term you'd like to search for.
Hopefully this helps to get things rolling. Don't hesitate to post back if you'd like more detail.
Kind regards,
Todd Wilson
[email protected]
Example scripts?
Hi,
Thanks for the posting. Our third tutorials is intended to cover many of the basic tasks that are common in scraping sites. Could you give a few specific examples you'd like to see? We're definitely interested in improving out tutorials and documentation. Any suggestions would be helpful.
Thanks,
Todd Wilson
[email protected]