screen-scraper public support
Service dependencies upon startup?
Morning All,
We have Screen-Scraper setup as a service to startup automatically on one of our servers, and usually it starts with no problems. However, recently it needed to be bounced for some system maintenance, and upon restarting, everything came up fine except the Screen-Scraper service. It started up fine when we manually went into Services and started the service, but we'd like it to startup automatically upon a reboot.
Scraping from ASP vbscript
I am trying to scrape using my screenscraper enterprise in an ASP page using vbscript. I get this error:
Error Type:
Microsoft VBScript runtime (0x800A01AD)
ActiveX component can't create object
When I issue this command:
Set objRemoteSession = Server.CreateObject("Screenscraper.RemoteScrapingSession")
This used to work a long time ago but not anymore...did something change?
Scraping Large Numbers of Websites
I have a need to scrape 100+ websites reasonably alike commerce (type) websites. Screen-Scraper seems like it would be suitable and has worked in testing. However I can not seem to fathom how to make it useable with large numbers of URLs. I have read the FAQ at [url]http://www.screen-scraper.com/support/faq/faq.php#LargeNumberScrapingSessions[/url] but can't really make much sense of how it would operate in practise.
Scraping .Net Websites
Hi there,
I'm looking to scrape an aspx website that uses postback. Basically its like a normal website with an index page next button for next page but uses aspx postback / javascript.
Any ideas how to get it to return the pages I need?
Cheers
Noobie: Wierd error when doing tutorial 2
Hey guys, im VERY new to Screen Scraper, i've been learning how to use this program remotely through a server. When i try to run scraping sessions (this happened when i tried running the scraping session on tutorial one as well) I get a java error and after the first tutorial, i tried looking at the compiled text file and there was nothing in it (Java error as well) ill post the error from the log and hopefully you guys can help me with this problem so i can see some results :)
Linux install
I'm looking to install the basic version on a small linux box withóut X server. I understand that using a tarball is the recommended way to do this. I can find this link: [url]http://www.screen-scraper.com/install/professional/lin/ss_pro_lin.tgz[/url], but that seems to be Professional v3.0. Is there a basic version 4.0 tarball somewhere?
Javascript responses
I'm creating a scraping session for http://www.resultat.dk/fodbold/danmark. This seems to call http://www.resultat.dk/iframe/sport.php?sport=soccer&category=21&serial=108. An extract of the result is
Pull entire page contents?
Hi all-
I am stuck on this problem. The individual pages that I am trying to scrape (after various parsing of link lists etc) are actually plain text.
that is to say there are no html codes or headers or footers.
I need to save teh entire contents of the page (as one datafield is fine).
But I can't figure out an extractor pattern to simply pull the entire contents of the page...
thoughts?
Scrape Log Options
Is is possible to have the scrape log only show what has been explicitly requested through session.log? All of the additional data being displayed makes it difficult to monitor at times.
Repeat sub-extractor pattern?
I would like to scrape a page where a "header information" precedes a variable-length table, from which I want to scrape each row. The output data I want should contain a set of data for each row in the table, with the "header information" included (repeated) in each set of data. I.e.
Header1
A B C
D E F
Header2
G H I
- should give
Header1 A B C
Header1 D E F
Header2 G H I