Login info not appearing in POST info box
Hi,
I am in the same situation as this user: http://community.screen-scraper.com/node/1088
Except that I am trying to scrape pages on Wordpress.com. Even turning off "don't log binary files," there is still no log-in info in the post data. Pages are showing up normally in the proxy log, though.
Is there any way around this? Thanks for the help, and let me know if you need any more info.
-Maxim
alternative proxies
it may be that javascript is setting a cookie that is sent that deals with the login information. To get a better idea of what is going on I suggest checking out "Charles Proxy". There is a free demo of it.
Also some other useful tools for reverse engineering websites are located in the screen-scraper Tips, Tricks & Samples section. Tamper Data and Web Developer toolbar are invaluable firefox extensions for more complex screen-scraping.