Web Application - Allow for download of crawl log.
It would greatly ease my work flow if it were possible to download the log file for a running/run scrape directly through the web interface. The "Peek" feature allows to view up to the last 100 lines of the document, which is not nearly sufficient for long running session.
Tyler
The log files themselves are
The log files themselves are still very accessable to an administrative user, who can just the directory contents of the "log" folder in screen-scraper. there's no attempt to hide the log files.
However, one could argue that more than half the battle has already been fought, if we've built in something to *view* the end of the log; we may as well just allow the user to have the whole file.
Suggestion noted.
Timv, Thanks for considering
Timv,
Thanks for considering the suggestion. I understand that log files are easily accessible through the "log" directory. However, as my scraping sessions are deployed on an external machine, it would save me from having to tunnel in on another port to grab the log file for a quick glance.
Thanks again.
Tyler