screen-scraper public support

It is impossible to create a RemoteScrapingSession with the COM or .NET API under windows server 2012. The cause of the problem seems to be JAVA. Screenscraper.dll is registered but seems to have a problem to use de java class to produce the ActiveX object RemoteScrapingSession.

With ASP.NET, I have the following message:

Retrieving the COM class factory for component with CLSID {249DCB04-2D6E-4B94-B182-9E1275B3088D} failed due to the following error: 80040154 Class not registered (Exception from HRESULT: 0x80040154 (REGDB_E_CLASSNOTREG)).

There's a site out there that allows free lookups up to 100 searches per day, per free account. However, I have 500 searches to do per day.

As in the Shopping site tutorial: http://community.screen-scraper.com/tutorials/tutorial_5/0_saving_scraped_data_to_a_database, my script will write data to a CSV file for each record found.

It cycles through each one and writes correctly, but is there any way to display in the LOG, how many times it has found a result?

If I know I have 1000 records to scrape, I would like to be able to check the log as it's scrolling and see how many it has done so far.

Hi,

I managed to log in to facebook. Now I would like to scrape my friend list in order to extract some data from there.

The browser URL for the friend list is something like:
https://www.facebook.com/username/friends

But with this I only get the first pageload of friends like 10 people or so. In firefox the friendlist would just grow whith scrolling down.

So my problem is, how can you get the first people load and then the next and so on in screenscraper.

While live proxying I found out that when you scroll the friendlist down you get:

I use the free version.

I was scraping data from http://yellowpages.superpages.com/listings.jsp?C=apartments&CS=L&MCBP=true&search=Find+It&SRC=&STYPE=S&SCS=&channelId=&sessionId=

The session was working just fine and after some 50 pages of scraping, I got an error saying something like this

ERROR--halting the scraping session because the maximum number of scripts allowed on the stack was reached. Current number on the stack is: 50.

What does it mean? In the place of 124469 records in total I got some 1400+ records. How can I get all the data scraped?

After starting proxy server, when I tried to record a search result, I got the error "The proxy server is refusing connections".

What could be the reason for that? What shall I do to correct it?

Windows 7 is my OS and I used Firefox to record pages.

I hope to get a reply soon.

Thank you

Hi,

I went through other posts and closest I got to the answer was on the old sample yellow pages, but it's no longer on the site.

I want my write to csv script to also output the name of the url it is scraping, whether from local folder or scraping a site online.

The post http://community.screen-scraper.com/node/1095 says that this can be done but can't find other examples.

Sorry if it's in plain sight, but I have looked!

My write to csv script currently looks like this:

FileWriter out = null;

try
{
session.log( "Writing data to a file." );

Hi,

I have a lot of urls to scrape!

I have a scraping session that scrapes 70% of the urls into a .csv file, no problem with the scraping session.
The problem is that when the session reaches a url that it reports back "No matches were made by any of the extractor patterns associated with this scrapeable file."
it moves onto the next url and does not write Null or blank ... as its output into the .csv

WHAT I WANT:

I want my "write to .csv script" to write a value when no matches were made by any of the extractor patterns associated with this scrapeable file.

Regarding the: "Output to CSV" tutorial here: http://community.screen-scraper.com/script_repository/Write_to_CSV

How do I add the "Computer Name" that the session was run on to the output filename?

I know i would need to add it to this line: outputFile = "output/" + session.getName() + ".csv";

I just don't know what the code would be. Anyone?

Sorry for the 2nd post of the day - also probably a dumb question...

I have an extractor pattern on a 1st webpage that triggers a scrape of a 2nd webpage. One of the parameters I have to supply to the 2nd webpage is a record number that is supposed to increase for each new record.