screen-scraper public support
Only getting half the dataset
I'm using Tutorial 3 and would like to write out the PRODUCTID, MODEL and PRICE.
So I identified the extractor pattern on the Search Results page "PDL" (and checked the Automatically save the data set ... box) ~ found that if I didn't do this would get the "java.null..." problem.
I also identified the extractor pattern on the Details page "PDL" and checked the "Automatically ..." box.
Tried both append & join (coundn't find any documentation on this feature) seperately.
Here is my code
How do you add the url into the dataset?
I'd like to add the url of the page that I'm scraping into the datarecord of my detail page. This way when the scrape is complete I can easily process each data record within a data set and place details into an ADO Recordset in an external ASP script. Alternatively - perhaps you can show us how to do it with Tutorial 3 or at least combine PRODUCTID scraped on "Search results" page with TITLE ... on Details page
Thanks,
RF
VBScript runtime error '800a01ad' when attempting to connect
I'm receiving the following error:
Microsoft VBScript runtime error '800a01ad'
ActiveX component can't create object
/screenscrape/shopsite.asp, line 5
(line 5 is the Server.Creatobject line below )
Thought I'd use the Shoping site as a test - so here is the code:
Script Failure
Newbie to your product and Java so bare with me.
I took the existing Interpreted Java script and edited it to suit a test application like so:
Invoke a Scrapeable file from Java
Is it possible to invoke a scrapeable file from an external Java source?
I have managed to scrape from Java using sequenced files, but I need to invoke files directly.
Error handling examples
I'm having trouble trapping errors and wondering if i could get some examples.
I have a scraping session that has 3 scraping files:
- <Page 1><br />
- <Page 2><br />
- <Page 3>
each page may return an error page, or if successfully scraped, variables extracted will be used for the next page.
if i encounter an error, i want to capture the error & terminate the scraping session
currently i kick off my session via a script
General Observations/Some Specific Questions
First off, let me say... this is a great product and it filled a need I was desperate to fill!
Now then... some of the problems I have been experiencing and some work-arounds I have found and other suggestions/questions. Note: I am using the .NET interface as I could not get the COM working properly using vb.net 2005 express:
Main one, we will call it #1 :-) :
POST parameter example
i'm having troube trying to use a session variable as the value for a POST
i'm calling ss from a php script designed to login to a web page, grab a bit of data, then move onto the next user to do the same thing
i've put ~@USER@~ and ~@PW@~ as the value in my scripting session
i've created a script much like Weather - begin scraping session example, but it seems the values are not being passed.
the log file shows
Login: POST data: f_username=%7E%40USER%40%7E&f_userpass=%7E%40PW%40%7E&
can't run ss gui when loaded as a service on win2k
I have screen scrapper running as a service on win2k server.
for learning and debugging purposes, using the screen scrapper gui is the way to go, but i get an error if i try to load this while the service is still running.
it means i have to shut down the service, run screen scrapper, then shut it down, restart the service, etc. a bit of a pain.
is this correct?
the error i get when i load screenscrapper when the service is still running is that there is already an instance running. i ignore the warning, press "yes", but then it gets really upset.
Lock file exists
Having problems with an evaluation version of screen scraper:
System: w2k server
SS v 1.5
I was testing an extractor pattern, when ss appeared to hang. ended the task via task manager, and now whenever i try to start it, i get the following message:
it appears as though an instance of screen scraper is already running, which is not allowed. if a second instance is already open and you continue data could be corrupted. Would you like to continue anyway? Yes/No
- ss is not running as a service
- i even tried a reboot, and still get the message.