screen-scraper public support

Questions and answers regarding the use of screen-scraper. Anyone can post. Monitored occasionally by screen-scraper staff.

How the screen scraper works?

Hello,

Doesn SS hide the IP address from the scraping site? Is is leagal to scrape a web site without having the permissions. Just like to know because you guys are experts in this area.

thanks,

Last search term in list file executes twice

I'm back to evaluating Screen-Scraper Pro after a long hiatus.

The first scraping session I have attempted has gone well, except for one issue I have been unable to resolve. I expect there is a simple solution, but I have been unable to find it.

My scraping session is similar to that detailed in Tutorial 7 where a text file is used to submit search criteria to the scraping session. Everything works except the scrape session for the last search term (and only the last search term) is executed twice.

Login info not appearing in POST info box

Hi,

I am in the same situation as this user: http://community.screen-scraper.com/node/1088

Except that I am trying to scrape pages on Wordpress.com. Even turning off "don't log binary files," there is still no log-in info in the post data. Pages are showing up normally in the proxy log, though.

Is there any way around this? Thanks for the help, and let me know if you need any more info.

-Maxim

Firewall Settings [Basic Edition]

In order to get traffic through the firewalls I need the following information -

Ports Used? (for a single screen-scraper instance)[basic edition]

> External ie (Internet Facing)
>> Whether Inbound / Outbound or bi-directional?

> Internal ie (LAN Only)
>> Whether Inbound / Outbound or bi-directional?

Protocols
> What protocols need to be allowed on each Port?

Results fetched using Ajax

Hi,
I was trying to scrap the real estate site www.californiamoves.com.
When I start the proxy server to record the transactions the result page is not being displayed.
It is showing an error saying "Ajax call had trouble in th e response" and the request is not getting loaded.

This is the url of the search result from the browser's address bar

Scraping NEXT pages

I am trying to scrape the "Next Page" results from http://www.walmart.com/search/search-ng.do?ic=48_0&search_constraint=394.... I have tried numerous ways of getting this done but nothing in the tutorials seem to work. The way they have their pages setup is in order to get to the next page you have to select a number (1-?). There are 5 numbers on every page.

Problem with screen scraping in facebook

I am doing the project which need i use the screen scraper to extract the names of members of groups in social networks such as facebook, Linked in, hi5.