Problem importing scraping session
Hi.
I have been succesfully using the feature of developing in a SS Workbench in my mac and uploading to a SS Linux machine to the "import" folder. This has allways worked.
Today, however, I am running a scrape in my Linux box and by the terminal messages it´s obviously an older version, not the one I am uploading to the "import" folder. I have tried a many times, and I have also updated the Linux SS to latest version just in case, but same thing. It keeps using an older version of my scrape.
What could be the problem?
cheers,
boga
First thing to do is to check
First thing to do is to check the error.log. Sometimes there is something in the scrape causes the error to fail, and in that case it should be logged there.
Otherwise, make sure screen-scraper is stopped, clear the log directory, copy the file into import, and then start up again. That should do it.
Hi. On the Linux, non graphic
Hi.
On the Linux, non graphic install of Screen Scraper I did this:
1) I checked the error.log located in /screen-scraprer_pro/log/ and there was nothing but a bunch of java errors which I couldn´t understand
2) I made sure Screen Scraper was stopped, deleted all the files in the /screen-scraper/log/ directory, and I copied the file into the import folder with my ftp program
3) I executed the scraping session from the command line, and by the output, it was obvious that it was STILL using an outdated version of at least one of the scripts belonging to that session
Then, On my mac ss workbench I did this:
4) I tried to modify the problematic script and re-upload it to the Linux box but same problem. When executing scraping session at the Linux box, it was using an older version of at least one of the scripts.
Then:
5) I checked the error.log in the Linux machine and it was empty, so no error
6) On the mac ss workbench I changed the problematic script´s name from "Parse JSON & insert into database" to "NEW_SCRIPT" and in the script that manually called called it as
session.executeScript("Parse JSON & insert into database");
I changed it tosession.executeScript("NEW_SCRIPT");
7) I saved, exported and uploaded the scraping session to the Linux box
8) I executed the scraping session from the Linux box command line, but this time I am getting an error:
Couldn't execute the script: "NEW_SCRIPT" because it doesn't exist.
So what´s happening?
cheers,
boga
Step number 6) was
Step number 6) was actually:
6a) copied all the contents of the "Parse JSON & insert into database" script into the clipboard
6b) deleted the script "Parse JSON & insert into database" script
6c) Created new script, called it "NEW_SCRIPT" and moved it to this specific scraping session´s folder in the workbench
Could you run the attached
Could you run the attached scrape, and post the log for me?
here it is: Initializing
here it is:
Starting scraper.
Running scraping session: Test instance
Processing scripts before scraping session begins.
Processing script: "Write status to log"
=================== Log Variables with Message ===============
screen-scraper Instance Information
=================== Variables being monitored ================
Java Vendor : Sun Microsystems Inc.
Java Version : 1.6.0_30
OS Architecture : amd64
OS Name : Linux
OS Version : 3.2.0-31-virtual
SS Connection Timeout : 180 seconds
SS Edition : Professional
SS Extractor Timeout : 30000 milliseconds
SS Max Concurrent Scraping Sessions : 5
SS Maximum Memory : 512 MB
SS Run Mode : Command Line
SS Version : 6.0.28a
======== Message logged at: 06/05/2013 12:56:55.190 GMT-05:00 ========
Scraping file: "IP address"
IP address: Resolved URL: http://www.icanhazip.com
IP address: Sending request.
IP address: Extracting data for pattern "Get IP address"
IP address: The following data elements were found:
Get IP address--DataRecord 0:
CURRENT_IP=54.246.109.55
Processing scripts after scraping session has ended.
Processing scripts always to be run at the end.
Scraping session "Test instance" finished.
thank you,
boga
So you imported that session
So you imported that session fine, and the details all look good. Would you be okay to send me the particular scrape that you're trying to import?
thanks. I just sent it to you
thanks. I just sent it to you by email.
cheers,
boga