Scraping session was either invalid or has not been set.

I get this error while scraping using the non-gui tarball of screen-scraper.
The same thing works fine with the GUI version. We need the non-gui version for our server. Any ideas ?

-agn

agn on 04/27/2006 at 1:19 am

screen-scraper public support

Scraping session was either invalid or has not been set.

Hi Arun,

Sorry for the inconvenience. We've actually never tested on Debian, so I suppose there could be an issue there. We also tried on a Gentoo box a while back, and, while it worked fine, there were some memory issues with the JRE.

Todd

todd on 05/11/2006 at 9:53 am

Scraping session was either invalid or has not been set.

Hi Todd,
Tested the latest update. Same thing. This time on debian as I had told. But I noticed something strange. Its running a lot (around 40) processes. Is it normal. Am pasting the wrapper.log below.

----------------------------------------------------------------------------------------
DEBUG | wrapper | 2006/05/11 05:49:15 | Spawning intermediate process...
DEBUG | wrapper | 2006/05/11 05:49:15 | Spawning daemon process...
STATUS | wrapper | 2006/05/11 05:49:15 | --> Wrapper Started as Daemon
DEBUG | wrapper | 2006/05/11 05:49:15 | Using tick timer.
DEBUG | wrapperp | 2006/05/11 05:49:15 | server listening on port 1777.
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[0] : /usr/local/screen-scraper/jre/bin/java
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[1] : -Xss5M
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[2] : -Xms3m
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[3] : -Xmx256m
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[4] : -Djava.library.path=./:./lib
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[5] : -classpath
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[6] : ./lib/:./:./screen-scraper.jar:./lib/junit.jar:./lib/mail.jar:./lib/jasper-runtime.jar:./lib/jargs.jar:./lib/Tidy.
jar:./lib/commons-logging.jar:./lib/naming-common.jar:./lib/naming-resources.jar:./lib/commons-collections-stripped.jar:./lib/commons-httpclient.jar:./lib/rome.jar:./lib
/bootstrap.jar:./lib/axis-ant.jar:./lib/servlets-default.jar:./lib/jgi-client.jar:./lib/jaxrpc.jar:./lib/ant-jsp.jar:./lib/activation.jar:./lib/ant.jar:./lib/castor-xml.
jar:./lib/wsdl4j.jar:./lib/xerces.jar:./lib/tomcat-util-stripped.jar:./lib/tomcat-coyote.jar:./lib/kunststoff.jar:./lib/bsf.jar:./lib/commons-codec.jar:./lib/saaj.jar:./
lib/lws.jar:./lib/lws-jgi.jar:./lib/l2fprod-common-buttonbar.jar:./lib/browser-launcher.jar:./lib/l2fprod-common-directorychooser.jar:./lib/hsqldb.jar:./lib/dom.jar:./li
b/catalina-jsp.jar:./lib/jython.jar:./lib/jgoodies.jar:./lib/jakarta-oro.jar:./lib/js.jar:./lib/catalina-stripped.jar:./lib/systray4j.jar:./lib/bsh.jar:./lib/axis.jar:./
lib/commons-discovery.jar:./lib/lws-util.jar:./lib/jdom.jar:./lib/jrex.jar:./lib/skinlf.jar:./lib/servlet.jar:./lib/ale.jar:./lib/looks.jar:./lib/freemarker.jar:./lib/se
rvlets-invoker.jar:./lib/jasper-compiler.jar:./lib/log4j.jar:./lib/servlets-common.jar:./lib/wrapper.jar:./lib/tomcat-http11.jar
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[7] : -Dwrapper.key=AuLwTiyVohUDOKct
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[8] : -Dwrapper.port=1777
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[9] : -Dwrapper.jvm.port.min=31000
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[10] : -Dwrapper.jvm.port.max=31999
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[11] : -Dwrapper.debug=TRUE
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[12] : -Dwrapper.pid=8703
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[13] : -Dwrapper.version=3.2.0
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[14] : -Dwrapper.native_library=wrapper
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[15] : -Dwrapper.service=TRUE
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[16] : -Dwrapper.cpu.timeout=10
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[17] : -Dwrapper.jvmid=1
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[18] : org.tanukisoftware.wrapper.WrapperStartStopApp
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[19] : com.screenscraper.controller.ControllerMain
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[20] : 1
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[21] : --start-server
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[22] : com.screenscraper.controller.ControllerMain
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[23] : true
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[24] : 1
DEBUG | wrapper | 2006/05/11 05:49:15 | Command[25] : --stop-server
STATUS | wrapper | 2006/05/11 05:49:15 | Launching a JVM...
INFO | jvm 1 | 2006/05/11 05:49:15 | WrapperManager class initialized by thread: main Using classloader: sun.misc.Launcher$AppClassLoader@133056f
INFO | jvm 1 | 2006/05/11 05:49:15 | Wrapper (Version 3.2.0) http://wrapper.tanukisoftware.org
INFO | jvm 1 | 2006/05/11 05:49:15 |
INFO | jvm 1 | 2006/05/11 05:49:15 | Wrapper Manager: JVM #1
INFO | jvm 1 | 2006/05/11 05:49:15 | Running a 32-bit JVM.
INFO | jvm 1 | 2006/05/11 05:49:15 | Wrapper Manager: Registering shutdown hook
INFO | jvm 1 | 2006/05/11 05:49:15 | Wrapper Manager: Using wrapper
INFO | jvm 1 | 2006/05/11 05:49:15 | Load native library. One or more attempts may fail if platform specific libraries do not exist.
INFO | jvm 1 | 2006/05/11 05:49:15 | Loading native library failed: libwrapper-linux-x86-32.so Cause: java.lang.UnsatisfiedLinkError: no wrapper-linux-x86-32 in ja
va.library.path
INFO | jvm 1 | 2006/05/11 05:49:15 | Loaded native library: libwrapper.so
INFO | jvm 1 | 2006/05/11 05:49:15 | Calling native initialization method.
INFO | jvm 1 | 2006/05/11 05:49:15 | Inside native WrapperManager initialization method
INFO | jvm 1 | 2006/05/11 05:49:15 | Java Version : 1.5.0_03-b07 Java HotSpot(TM) Client VM
INFO | jvm 1 | 2006/05/11 05:49:15 | Java VM Vendor : Sun Microsystems Inc.
INFO | jvm 1 | 2006/05/11 05:49:15 |
INFO | jvm 1 | 2006/05/11 05:49:15 | WrapperManager.start(org.tanukisoftware.wrapper.WrapperStartStopApp@1100d7a, args["--start-server"]) called by thread: main
INFO | jvm 1 | 2006/05/11 05:49:15 | Open socket to wrapper...Wrapper-Connection
INFO | jvm 1 | 2006/05/11 05:49:15 | Opened Socket from 31000 to 1777
INFO | jvm 1 | 2006/05/11 05:49:15 | Send a packet KEY : AuLwTiyVohUDOKct
INFO | jvm 1 | 2006/05/11 05:49:15 | handleSocket(Socket[addr=localhost.localdomain/127.0.0.1,port=1777,localport=31000])
DEBUG | wrapperp | 2006/05/11 05:49:15 | accepted a socket from 127.0.0.1 on port 31000
DEBUG | wrapperp | 2006/05/11 05:49:15 | read a packet KEY : AuLwTiyVohUDOKct
DEBUG | wrapper | 2006/05/11 05:49:15 | Got key from JVM: AuLwTiyVohUDOKct
DEBUG | wrapperp | 2006/05/11 05:49:15 | send a packet LOW_LOG_LEVEL : 1
DEBUG | wrapperp | 2006/05/11 05:49:15 | send a packet PING_TIMEOUT : 30
DEBUG | wrapperp | 2006/05/11 05:49:15 | send a packet PROPERTIES : (Property Values)
DEBUG | wrapper | 2006/05/11 05:49:15 | Start Application.
DEBUG | wrapperp | 2006/05/11 05:49:15 | send a packet START : start
INFO | jvm 1 | 2006/05/11 05:49:15 | Received a packet LOW_LOG_LEVEL : 1
INFO | jvm 1 | 2006/05/11 05:49:15 | Wrapper Manager: LowLogLevel from Wrapper is 1
INFO | jvm 1 | 2006/05/11 05:49:15 | Received a packet PING_TIMEOUT : 30
INFO | jvm 1 | 2006/05/11 05:49:15 | Wrapper Manager: PingTimeout from Wrapper is 30000
INFO | jvm 1 | 2006/05/11 05:49:15 | Received a packet PROPERTIES : (Property Values)
INFO | jvm 1 | 2006/05/11 05:49:15 | Monitoring of the JVM thread count will be delayed for 1 seconds.
INFO | jvm 1 | 2006/05/11 05:49:15 | Received a packet START : start
INFO | jvm 1 | 2006/05/11 05:49:15 | calling listener.start()
INFO | jvm 1 | 2006/05/11 05:49:15 | WrapperStartStopApp: start(args) Will wait up to 2 seconds for the main method to complete.
INFO | jvm 1 | 2006/05/11 05:49:15 | WrapperStartStopApp: invoking start main method
INFO | jvm 1 | 2006/05/11 05:49:16 | Send a packet START_PENDING : 5000
DEBUG | wrapperp | 2006/05/11 05:49:16 | read a packet START_PENDING : 5000
DEBUG | wrapper | 2006/05/11 05:49:16 | JVM signalled a start pending with waitHint of 5000 millis.
INFO | jvm 1 | 2006/05/11 05:49:17 | Initializing screen-scraper server. Please wait...
INFO | jvm 1 | 2006/05/11 05:49:17 | Warning: You're not using a Java Development Kit (SDK) environment so JSP pages can not be compiled.
INFO | jvm 1 | 2006/05/11 05:49:17 | Ready.
INFO | jvm 1 | 2006/05/11 05:49:17 | The server is in non-interactive mode. Run the "stop server" script to stop it.
INFO | jvm 1 | 2006/05/11 05:49:17 | WrapperStartStopApp: start main method completed
INFO | jvm 1 | 2006/05/11 05:49:17 | WrapperStartStopApp: start(args) end. Main Completed=true, exitCode=null
INFO | jvm 1 | 2006/05/11 05:49:17 | returned from listener.start()
INFO | jvm 1 | 2006/05/11 05:49:17 | Send a packet STARTED :
DEBUG | wrapperp | 2006/05/11 05:49:17 | read a packet STARTED :
DEBUG | wrapper | 2006/05/11 05:49:17 | JVM signalled that it was started.
INFO | jvm 1 | 2006/05/11 05:49:17 | Starting service LiteWebServer Base Module (lws-base/3.0.3) (with LiteWebServer JSP Module (lws-jsp/1.1.2))
DEBUG | wrapperp | 2006/05/11 05:49:19 | send a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:19 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:19 | Send a packet PING : ok
INFO | jvm 1 | 2006/05/11 05:49:19 | Non-daemon thread count = 3 - 1(system) = 2
DEBUG | wrapperp | 2006/05/11 05:49:19 | read a packet PING : ok
DEBUG | wrapper | 2006/05/11 05:49:19 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/11 05:49:24 | send a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:24 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:24 | Send a packet PING : ok
INFO | jvm 1 | 2006/05/11 05:49:24 | Non-daemon thread count = 3 - 1(system) = 2
DEBUG | wrapperp | 2006/05/11 05:49:24 | read a packet PING : ok
DEBUG | wrapper | 2006/05/11 05:49:24 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/11 05:49:28 | send a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:28 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:28 | Send a packet PING : ok
INFO | jvm 1 | 2006/05/11 05:49:28 | Non-daemon thread count = 3 - 1(system) = 2
DEBUG | wrapperp | 2006/05/11 05:49:28 | read a packet PING : ok
DEBUG | wrapper | 2006/05/11 05:49:28 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/11 05:49:33 | send a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:33 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:33 | Send a packet PING : ok
INFO | jvm 1 | 2006/05/11 05:49:33 | Non-daemon thread count = 3 - 1(system) = 2
DEBUG | wrapperp | 2006/05/11 05:49:33 | read a packet PING : ok
DEBUG | wrapper | 2006/05/11 05:49:33 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/11 05:49:37 | send a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:37 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:37 | Send a packet PING : ok
INFO | jvm 1 | 2006/05/11 05:49:37 | Non-daemon thread count = 3 - 1(system) = 2
DEBUG | wrapperp | 2006/05/11 05:49:37 | read a packet PING : ok
DEBUG | wrapper | 2006/05/11 05:49:37 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/11 05:49:42 | send a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:42 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:42 | Send a packet PING : ok
INFO | jvm 1 | 2006/05/11 05:49:42 | Non-daemon thread count = 3 - 1(system) = 2
DEBUG | wrapperp | 2006/05/11 05:49:42 | read a packet PING : ok
DEBUG | wrapper | 2006/05/11 05:49:42 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/11 05:49:46 | send a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:46 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:46 | Send a packet PING : ok
INFO | jvm 1 | 2006/05/11 05:49:46 | Non-daemon thread count = 3 - 1(system) = 2
DEBUG | wrapperp | 2006/05/11 05:49:46 | read a packet PING : ok
DEBUG | wrapper | 2006/05/11 05:49:46 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/11 05:49:51 | send a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:51 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:51 | Send a packet PING : ok
INFO | jvm 1 | 2006/05/11 05:49:51 | Non-daemon thread count = 3 - 1(system) = 2
DEBUG | wrapperp | 2006/05/11 05:49:51 | read a packet PING : ok
DEBUG | wrapper | 2006/05/11 05:49:51 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/11 05:49:55 | send a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:55 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:55 | Send a packet PING : ok
INFO | jvm 1 | 2006/05/11 05:49:55 | Non-daemon thread count = 3 - 1(system) = 2
DEBUG | wrapperp | 2006/05/11 05:49:55 | read a packet PING : ok
DEBUG | wrapper | 2006/05/11 05:49:55 | Got ping response from JVM
DEBUG | wrapper | 2006/05/11 05:49:58 | Signal trapped. Details:
DEBUG | wrapper | 2006/05/11 05:49:58 | signal number=15 (SIGTERM), source="kill, sigsend or raise"
DEBUG | wrapper | 2006/05/11 05:49:58 | signal generated by PID: 8763 (Session PID: 6125), UID: 0 (root)
STATUS | wrapper | 2006/05/11 05:49:58 | TERM trapped. Shutting down.
DEBUG | wrapper | 2006/05/11 05:49:58 | wrapperStopProcess(0) called.
DEBUG | wrapper | 2006/05/11 05:49:58 | Sending stop signal to JVM
DEBUG | wrapperp | 2006/05/11 05:49:58 | send a packet STOP : NULL
INFO | jvm 1 | 2006/05/11 05:49:58 | Received a packet STOP :
INFO | jvm 1 | 2006/05/11 05:49:58 | Thread, Wrapper-Connection, handling the shutdown process.
INFO | jvm 1 | 2006/05/11 05:49:58 | calling listener.stop()
INFO | jvm 1 | 2006/05/11 05:49:42 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:42 | Send a packet PING : ok
INFO | jvm 1 | 2006/05/11 05:49:42 | Non-daemon thread count = 3 - 1(system) = 2
DEBUG | wrapperp | 2006/05/11 05:49:42 | read a packet PING : ok
DEBUG | wrapper | 2006/05/11 05:49:42 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/11 05:49:46 | send a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:46 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:46 | Send a packet PING : ok
INFO | jvm 1 | 2006/05/11 05:49:46 | Non-daemon thread count = 3 - 1(system) = 2
DEBUG | wrapperp | 2006/05/11 05:49:46 | read a packet PING : ok
DEBUG | wrapper | 2006/05/11 05:49:46 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/11 05:49:51 | send a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:51 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:51 | Send a packet PING : ok
INFO | jvm 1 | 2006/05/11 05:49:51 | Non-daemon thread count = 3 - 1(system) = 2
DEBUG | wrapperp | 2006/05/11 05:49:51 | read a packet PING : ok
DEBUG | wrapper | 2006/05/11 05:49:51 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/11 05:49:55 | send a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:55 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/11 05:49:55 | Send a packet PING : ok
INFO | jvm 1 | 2006/05/11 05:49:55 | Non-daemon thread count = 3 - 1(system) = 2
DEBUG | wrapperp | 2006/05/11 05:49:55 | read a packet PING : ok
DEBUG | wrapper | 2006/05/11 05:49:55 | Got ping response from JVM
DEBUG | wrapper | 2006/05/11 05:49:58 | Signal trapped. Details:
DEBUG | wrapper | 2006/05/11 05:49:58 | signal number=15 (SIGTERM), source="kill, sigsend or raise"
DEBUG | wrapper | 2006/05/11 05:49:58 | signal generated by PID: 8763 (Session PID: 6125), UID: 0 (root)
STATUS | wrapper | 2006/05/11 05:49:58 | TERM trapped. Shutting down.
DEBUG | wrapper | 2006/05/11 05:49:58 | wrapperStopProcess(0) called.
DEBUG | wrapper | 2006/05/11 05:49:58 | Sending stop signal to JVM
DEBUG | wrapperp | 2006/05/11 05:49:58 | send a packet STOP : NULL
INFO | jvm 1 | 2006/05/11 05:49:58 | Received a packet STOP :
INFO | jvm 1 | 2006/05/11 05:49:58 | Thread, Wrapper-Connection, handling the shutdown process.
INFO | jvm 1 | 2006/05/11 05:49:58 | calling listener.stop()
INFO | jvm 1 | 2006/05/11 05:49:58 | WrapperStartStopApp: stop(0)
INFO | jvm 1 | 2006/05/11 05:49:58 | WrapperStartStopApp: invoking stop main method
INFO | jvm 1 | 2006/05/11 05:49:58 | Stopping server...
INFO | jvm 1 | 2006/05/11 05:49:58 | Stopping service LiteWebServer Base Module (lws-base/3.0.3) (with LiteWebServer JSP Module (lws-jsp/1.1.2))
INFO | jvm 1 | 2006/05/11 05:49:58 | Wrapper Manager: ShutdownHook started
INFO | jvm 1 | 2006/05/11 05:49:58 | WrapperManager.stop(0) called by thread: Wrapper-Shutdown-Hook
INFO | jvm 1 | 2006/05/11 05:49:58 | Thread, Wrapper-Shutdown-Hook, waiting for the JVM to exit.
INFO | jvm 1 | 2006/05/11 05:50:04 | Thread, Wrapper-Shutdown-Hook, continuing after 5 seconds.
INFO | jvm 1 | 2006/05/11 05:50:04 | Send a packet STOPPED : 0
DEBUG | wrapperp | 2006/05/11 05:50:04 | read a packet STOPPED : 0
DEBUG | wrapper | 2006/05/11 05:50:04 | JVM signalled that it was stopped.
INFO | jvm 1 | 2006/05/11 05:50:05 | Wrapper Manager: ShutdownHook complete
DEBUG | wrapper | 2006/05/11 05:50:05 | Signal trapped. Details:
DEBUG | wrapper | 2006/05/11 05:50:05 | signal number=17 (SIGCHLD), source="unknown"
DEBUG | wrapper | 2006/05/11 05:50:05 | Received SIGCHLD, calling wait().
DEBUG | wrapper | 2006/05/11 05:50:05 | wait() returned, child process should be gone.
DEBUG | wrapperp | 2006/05/11 05:50:05 | socket read no code (closed?).
DEBUG | wrapper | 2006/05/11 05:50:05 | JVM process is gone.
DEBUG | wrapper | 2006/05/11 05:50:05 | JVM exited normally.
STATUS | wrapper | 2006/05/11 05:50:05 | <-- Wrapper Stopped
------------------------------------------------------------------------------------

I used start-server to run it and stop-server to stop screen-scraper. The php script executed fine, but as usual, without any output. I don't know if I will be posting here anymore. Will be installing Xorg on server and using the gui versionof screen-scraper which run's fine (as we use that here).

Thanx,
Arun

agn on 05/11/2006 at 4:58 am

Scraping session was either invalid or has not been set.

Ok. I'll try the updated one. I ran screen-scraper as root and stoppped it with
the stop-server script. I think that what you see in the log. Also when run in interactive mode, the script runs fine without any output. Its the same case. Anyway, this was for our client. He was using RedHat before. They switched to debian. Now I can install Xorg on it and use the gui version. Anyway I'll test this update also. Thanx for the help.

-Arun

agn on 05/11/2006 at 4:11 am

Scraping session was either invalid or has not been set.

Hi,

I just updated the wrapper.jar file to 3.2, so that should take care of that warning you're seeing. I'm doubtful that's the issue, but feel free to give it a try by downloading the latest tarball.

From the log, it looks as though root is explicitly stopping the server:

Is that the case, or does it seem to be happening on its own? That is, it looks like screen-scraper is up and running for a while, but then gets killed by the root account.

Also, could you clarify--when you run screen-scraper in interactive mode does it function just as you'd expect it to?

Thanks,

Todd

todd on 05/10/2006 at 10:33 am

Scraping session was either invalid or has not been set.

Hi,
I tried the new one and still I don't see any output on running the script. Nothing in error.log. I changed the log level to DEBUG in wrapper.conf. Below is the wrapper.log:
--------------------------------------------------------------------------------------
DEBUG | wrapper | 2006/05/10 04:45:20 | Spawning intermediate process...
DEBUG | wrapper | 2006/05/10 04:45:20 | Spawning daemon process...
STATUS | wrapper | 2006/05/10 04:45:20 | --> Wrapper Started as Daemon
DEBUG | wrapper | 2006/05/10 04:45:20 | Using tick timer.
DEBUG | wrapperp | 2006/05/10 04:45:20 | server listening on port 1777.
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[0] : /usr/local/screen-scraper/jre/bin/java
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[1] : -Xss5M
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[2] : -Xms3m
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[3] : -Xmx256m
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[4] : -Djava.library.path=./:./lib
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[5] : -classpath
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[6] : ./lib/:./:./screen-scraper.jar:./lib/junit.jar:./lib/mail.jar:./lib/jasper-runtime.jar:./lib/jargs.jar:./lib/Tidy.jar:./lib/commons-logging.jar:./lib/naming-common.jar:./lib/naming-resources.jar:./lib/commons-collections-stripped.jar:./lib/commons-httpclient.jar:./lib/rome.jar:./lib/bootstrap.jar:./lib/axis-ant.jar:./lib/servlets-default.jar:./lib/jgi-client.jar:./lib/jaxrpc.jar:./lib/ant-jsp.jar:./lib/activation.jar:./lib/ant.jar:./lib/castor-xml.jar:./lib/wsdl4j.jar:./lib/xerces.jar:./lib/tomcat-util-stripped.jar:./lib/tomcat-coyote.jar:./lib/kunststoff.jar:./lib/bsf.jar:./lib/commons-codec.jar:./lib/saaj.jar:./lib/lws.jar:./lib/lws-jgi.jar:./lib/l2fprod-common-buttonbar.jar:./lib/browser-launcher.jar:./lib/l2fprod-common-directorychooser.jar:./lib/hsqldb.jar:./lib/dom.jar:./lib/catalina-jsp.jar:./lib/jython.jar:./lib/jgoodies.jar:./lib/jakarta-oro.jar:./lib/js.jar:./lib/catalina-stripped.jar:./lib/systray4j.jar:./lib/bsh.jar:./lib/axis.jar:./lib/commons-discovery.jar:./lib/lws-util.jar:./lib/jdom.jar:./lib/jrex.jar:./lib/skinlf.jar:./lib/servlet.jar:./lib/ale.jar:./lib/looks.jar:./lib/freemarker.jar:./lib/servlets-invoker.jar:./lib/jasper-compiler.jar:./lib/log4j.jar:./lib/servlets-common.jar:./lib/wrapper.jar:./lib/tomcat-http11.jar
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[7] : -Dwrapper.key=AbIHHUEeRkKq4J40
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[8] : -Dwrapper.port=1777DEBUG | wrapper | 2006/05/10 04:45:20 | Command[9] : -Dwrapper.jvm.port.min=31000
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[10] : -Dwrapper.jvm.port.max=31999
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[11] : -Dwrapper.debug=TRUE
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[12] : -Dwrapper.pid=12829
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[13] : -Dwrapper.version=3.2.0
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[14] : -Dwrapper.native_library=wrapper
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[15] : -Dwrapper.service=TRUE
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[16] : -Dwrapper.cpu.timeout=10
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[17] : -Dwrapper.jvmid=1
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[18] : org.tanukisoftware.wrapper.WrapperStartStopApp
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[19] : com.screenscraper.controller.ControllerMain
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[20] : 1
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[21] : --start-server
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[22] : com.screenscraper.controller.ControllerMain
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[23] : true
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[24] : 1
DEBUG | wrapper | 2006/05/10 04:45:20 | Command[25] : --stop-server
STATUS | wrapper | 2006/05/10 04:45:20 | Launching a JVM...
INFO | jvm 1 | 2006/05/10 04:45:21 | WrapperManager class initialized by thread: main Using classloader: sun.misc.Launcher$AppClassLoader@133056f
INFO | jvm 1 | 2006/05/10 04:45:21 | Wrapper Manager: JVM #1
INFO | jvm 1 | 2006/05/10 04:45:21 | Wrapper Manager: Registering shutdown hook
INFO | jvm 1 | 2006/05/10 04:45:21 | Wrapper Manager: Using wrapper
INFO | jvm 1 | 2006/05/10 04:45:21 | WARNING - The Wrapper jar file currently in use is version "3.1.2"
INFO | jvm 1 | 2006/05/10 04:45:21 | while the version of the Wrapper which launched this JVM is
INFO | jvm 1 | 2006/05/10 04:45:21 | "3.2.0".
INFO | jvm 1 | 2006/05/10 04:45:21 | The Wrapper may appear to work correctly but some features may
INFO | jvm 1 | 2006/05/10 04:45:21 | not function correctly. This configuration has not been tested
INFO | jvm 1 | 2006/05/10 04:45:21 | and is not supported.
INFO | jvm 1 | 2006/05/10 04:45:21 |
INFO | jvm 1 | 2006/05/10 04:45:21 | Loaded native library: libwrapper.so
INFO | jvm 1 | 2006/05/10 04:45:21 | Calling native initialization method.
INFO | jvm 1 | 2006/05/10 04:45:21 | Inside native WrapperManager initialization method
INFO | jvm 1 | 2006/05/10 04:45:21 | WARNING - The Wrapper jar file currently in use is version "3.1.2"
INFO | jvm 1 | 2006/05/10 04:45:21 | while the version of the native library is "3.2.0".
INFO | jvm 1 | 2006/05/10 04:45:21 | The Wrapper may appear to work correctly but some features may
INFO | jvm 1 | 2006/05/10 04:45:21 | not function correctly. This configuration has not been tested
INFO | jvm 1 | 2006/05/10 04:45:21 | and is not supported.
INFO | jvm 1 | 2006/05/10 04:45:21 |
INFO | jvm 1 | 2006/05/10 04:45:21 | Java Version : 1.5.0_03-b07 Java HotSpot(TM) Client VM
INFO | jvm 1 | 2006/05/10 04:45:21 | Java VM Vendor : Sun Microsystems Inc.
INFO | jvm 1 | 2006/05/10 04:45:21 |
INFO | jvm 1 | 2006/05/10 04:45:21 | Wrapper (Version 3.1.2) http://wrapper.tanukisoftware.org
INFO | jvm 1 | 2006/05/10 04:45:21 |
INFO | jvm 1 | 2006/05/10 04:45:21 | WrapperManager.start(org.tanukisoftware.wrapper.WrapperStartStopApp@145d068, args["--start-server"]) called by thread: main
INFO | jvm 1 | 2006/05/10 04:45:21 | Open socket to wrapper...
INFO | jvm 1 | 2006/05/10 04:45:21 | Opened Socket
INFO | jvm 1 | 2006/05/10 04:45:21 | Send a packet KEY : AbIHHUEeRkKq4J40
INFO | jvm 1 | 2006/05/10 04:45:21 | handleSocket(Socket[addr=localhost/127.0.0.1,port=1777,localport=34567])
DEBUG | wrapperp | 2006/05/10 04:45:21 | accepted a socket from 127.0.0.1 on port 34567
DEBUG | wrapperp | 2006/05/10 04:45:21 | read a packet KEY : AbIHHUEeRkKq4J40
DEBUG | wrapper | 2006/05/10 04:45:21 | Got key from JVM: AbIHHUEeRkKq4J40
DEBUG | wrapperp | 2006/05/10 04:45:21 | send a packet LOW_LOG_LEVEL : 1
DEBUG | wrapperp | 2006/05/10 04:45:21 | send a packet PING_TIMEOUT : 30
DEBUG | wrapperp | 2006/05/10 04:45:21 | send a packet PROPERTIES : (Property Values)
DEBUG | wrapper | 2006/05/10 04:45:21 | Start Application.
DEBUG | wrapperp | 2006/05/10 04:45:21 | send a packet START : start
INFO | jvm 1 | 2006/05/10 04:45:21 | Received a packet LOW_LOG_LEVEL : 1
INFO | jvm 1 | 2006/05/10 04:45:21 | Wrapper Manager: LowLogLevel from Wrapper is 1
INFO | jvm 1 | 2006/05/10 04:45:21 | Received a packet PING_TIMEOUT : 30
INFO | jvm 1 | 2006/05/10 04:45:21 | Wrapper Manager: PingTimeout from Wrapper is 30000
INFO | jvm 1 | 2006/05/10 04:45:21 | Received a packet UNKNOWN(115) : set.WRAPPER_FILE_SEPARATOR=/ set.WRAPPER_PATH_SEPARATOR=: wrapper.app.parameter.1=com.screenscraper.controller.ControllerMain wrapper.app.parameter.2=1 wrapper.app.parameter.3=--start-server wrapper.app.parameter.4=com.screenscraper.controller.ControllerMa
INFO | jvm 1 | 2006/05/10 04:45:21 | Wrapper code received an unknown packet type: 115
INFO | jvm 1 | 2006/05/10 04:45:21 | Received a packet START : start
INFO | jvm 1 | 2006/05/10 04:45:21 | calling listener.start()
INFO | jvm 1 | 2006/05/10 04:45:21 | WrapperStartStopApp: start(args)
INFO | jvm 1 | 2006/05/10 04:45:21 | WrapperStartStopApp: invoking start main method
INFO | jvm 1 | 2006/05/10 04:45:22 | Initializing screen-scraper server. Please wait...
INFO | jvm 1 | 2006/05/10 04:45:22 | Ready.
INFO | jvm 1 | 2006/05/10 04:45:22 | The server is in non-interactive mode. Run the "stop server" script to stop it.
INFO | jvm 1 | 2006/05/10 04:45:22 | WrapperStartStopApp: start main method completed
INFO | jvm 1 | 2006/05/10 04:45:22 | WrapperStartStopApp: start(args) end. Main Completed=true, exitCode=null
INFO | jvm 1 | 2006/05/10 04:45:22 | returned from listener.start()
INFO | jvm 1 | 2006/05/10 04:45:22 | Send a packet STARTED :
INFO | jvm 1 | 2006/05/10 04:45:22 | Warning: You're not using a Java Development Kit (SDK) environment so JSP pages can not be compiled.
DEBUG | wrapperp | 2006/05/10 04:45:22 | read a packet STARTED :
DEBUG | wrapper | 2006/05/10 04:45:22 | JVM signalled that it was started.
INFO | jvm 1 | 2006/05/10 04:45:23 | Starting service LiteWebServer Base Module (lws-base/3.0.3) (with LiteWebServer JSP Module (lws-jsp/1.1.2))
DEBUG | wrapperp | 2006/05/10 04:45:25 | send a packet PING : ping
INFO | jvm 1 | 2006/05/10 04:45:25 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/10 04:45:25 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/10 04:45:25 | read a packet PING : ok
DEBUG | wrapper | 2006/05/10 04:45:25 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/10 04:45:29 | send a packet PING : ping INFO | jvm 1 | 2006/05/10 04:45:29 | Received a packet PING : ping INFO | jvm 1 | 2006/05/10 04:45:29 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/10 04:45:29 | read a packet PING : ok
DEBUG | wrapper | 2006/05/10 04:45:29 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/10 04:45:34 | send a packet PING : ping
INFO | jvm 1 | 2006/05/10 04:45:34 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/10 04:45:34 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/10 04:45:34 | read a packet PING : ok
DEBUG | wrapper | 2006/05/10 04:45:34 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/10 04:45:38 | send a packet PING : ping
INFO | jvm 1 | 2006/05/10 04:45:38 | Received a packet PING : ping
...............[lots of ping] .............
DEBUG | wrapper | 2006/05/10 04:45:56 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/10 04:46:01 | send a packet PING : ping
INFO | jvm 1 | 2006/05/10 04:46:01 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/10 04:46:01 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/10 04:46:01 | read a packet PING : ok
DEBUG | wrapper | 2006/05/10 04:46:01 | Got ping response from JVM
DEBUG | wrapper | 2006/05/10 04:46:05 | Signal trapped. Details:
DEBUG | wrapper | 2006/05/10 04:46:05 | signal number=15 (SIGTERM), source="kill, sigsend or raise"
DEBUG | wrapper | 2006/05/10 04:46:05 | signal generated by PID: 12875 (Session PID: 12431), UID: 0 (root)
STATUS | wrapper | 2006/05/10 04:46:05 | TERM trapped. Shutting down.
DEBUG | wrapper | 2006/05/10 04:46:05 | wrapperStopProcess(0) called.
DEBUG | wrapper | 2006/05/10 04:46:05 | Sending stop signal to JVM
DEBUG | wrapperp | 2006/05/10 04:46:05 | send a packet STOP : NULL
INFO | jvm 1 | 2006/05/10 04:46:05 | Received a packet STOP :
INFO | jvm 1 | 2006/05/10 04:46:05 | Thread, Wrapper-Connection, handling the shutdown process.
INFO | jvm 1 | 2006/05/10 04:46:05 | calling listener.stop()
INFO | jvm 1 | 2006/05/10 04:46:05 | WrapperStartStopApp: stop(0)
INFO | jvm 1 | 2006/05/10 04:46:05 | WrapperStartStopApp: invoking stop main method
INFO | jvm 1 | 2006/05/10 04:46:05 | Stopping server...
INFO | jvm 1 | 2006/05/10 04:46:05 | Stopping service LiteWebServer Base Module (lws-base/3.0.3) (with LiteWebServer JSP Module (lws-jsp/1.1.2))
INFO | jvm 1 | 2006/05/10 04:46:05 | Wrapper Manager: ShutdownHook started
INFO | jvm 1 | 2006/05/10 04:46:05 | WrapperManager.stop(0) called by thread: Wrapper-Shutdown-Hook
INFO | jvm 1 | 2006/05/10 04:46:05 | Thread, Wrapper-Shutdown-Hook, waiting for the JVM to exit.
INFO | jvm 1 | 2006/05/10 04:46:11 | Thread, Wrapper-Shutdown-Hook, continuing after 5 seconds.
INFO | jvm 1 | 2006/05/10 04:46:11 | Wrapper Manager: ShutdownHook complete
DEBUG | wrapper | 2006/05/10 04:46:12 | Signal trapped. Details:
DEBUG | wrapper | 2006/05/10 04:46:12 | signal number=17 (SIGCHLD), source="unknown"
DEBUG | wrapper | 2006/05/10 04:46:12 | Received SIGCHLD, calling wait().
DEBUG | wrapper | 2006/05/10 04:46:12 | wait() returned, child process should be gone.
DEBUG | wrapperp | 2006/05/10 04:46:12 | socket read no code (closed?).
DEBUG | wrapper | 2006/05/10 04:46:12 | JVM process is gone.
WARN | wrapper | 2006/05/10 04:46:12 | JVM exited unexpectedly while stopping the application.
STATUS | wrapper | 2006/05/10 04:46:12 | <-- Wrapper Stopped
----------------------------------------------------------------------------------

I also tried the interactive command you gave. Saw nothing on console or logs. Whatever I do, the script run's fine without any output. I saw some warnings in the log above about a version mismatch. What about that ?

-Arun

agn on 05/09/2006 at 10:56 pm

Scraping session was either invalid or has not been set.

Hi Arun,

That's good news. That means that the problem lies in the third-party library we use to allow screen-scraper to run as a daemon.

I've just updated out Linux tarball with the very latest files from Java Server Wrapper (the aforementioned library). Would you mind downloading and trying it out to see if it resolves this issue? You can get it here: here.

Thanks,

Todd

todd on 05/08/2006 at 1:14 pm

Scraping session was either invalid or has not been set.

Hi Todd,

Yeah, I can call it from the script I showed you. It can connect fine. So what do you think the problem might be ?

- Arun

agn on 05/07/2006 at 10:06 pm

Scraping session was either invalid or has not been set.

Hi Arun,

I think we're narrowing down the problem.

No worries about the warning message you saw. That's just the servlet container indicating that you won't be able to use JSP's.

When you run the server in the fashion I recommended in my previous post, are you able to invoke it from your application? If so, then it could be that the problem is with the wrapper. We use a third-party application to handle running screen-scraper as a daemon, and it could be that we simply need to upgrade a library or two.

Thanks,

Todd

todd on 05/05/2006 at 10:50 am

Scraping session was either invalid or has not been set.

I'm not aware of any other version of JRE on the system. Its the default one that comes with screen-scraper, as far as I know. I tried starting screen-scraper with the command you provided and it says

root@host [/usr/local/screen-scraper]# ./jre/bin/java -jar screen-scraper.jar --start-server --interactive
Initializing screen-scraper server. Please wait...
Ready.
Type "quit" to quit.
? Warning: You're not using a Java Development Kit (SDK) environment so JSP pages can not be compiled.
Starting service LiteWebServer Base Module (lws-base/3.0.3) (with LiteWebServer JSP Module (lws-jsp/1.1.2))

But the script still runs without any output. Does that warning ring a bell ?

-Arun

agn on 05/04/2006 at 10:52 pm

Scraping session was either invalid or has not been set.

Hi Arun,

I just noticed from the log that you're using a 1.5 JRE

Java Version 1.5.0_03-b07 Java HotSpot(TM) Client VM

Did you replace screen-scraper's JRE (which should be 1.4.2) with that one? If so, could you use the JRE we provide? We haven't yet completely tested screen-scraper on 1.5.

Also, unfortunately the log doesn't give any clues as to what's going wrong. You might also try starting the screen-scraper server using this command, to see if it offers any other clues

./jre/bin/java -jar screen-scraper.jar --start-server --interactive

Kind regards,

Todd

todd on 05/04/2006 at 9:18 am

Scraping session was either invalid or has not been set.

Ok Todd. Ok changes made to wrapper.conf

[b]wrapper.logfile.loglevel=DEBUG[/b]
[b]wrapper.console.loglevel=DEBUG[/b]

Started screen-scraper and ran the script and stopped the server. I still don't think there's anything useful in the log. Anyway here it is:

-----------------------------------------------wrapper.log--

DEBUG | wrapper | 2006/05/04 05:12:26 | Spawning intermediate process...
DEBUG | wrapper | 2006/05/04 05:12:26 | Spawning daemon process...
STATUS | wrapper | 2006/05/04 05:12:26 | --> Wrapper Started as Daemon
DEBUG | wrapper | 2006/05/04 05:12:26 | Using system timer.
DEBUG | wrapperp | 2006/05/04 05:12:27 | server listening on port 1777.
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[0] : /usr/local/screen-scraper/jre/bin/java
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[1] : -Xss5M
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[2] : -Xms3m
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[3] : -Xmx256m
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[4] : -Djava.library.path=./:./lib
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[5] : -classpath
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[6] : ./lib/:./:./screen-scraper.jar:./lib/junit.jar:./lib/mail.jar:./lib/jasper-runtime.jar:./lib/jargs.jar:./lib/Tidy.jar:./lib/commons-logging.jar:./lib/naming-common.jar:./lib/naming-resources.jar:./lib/commons-collections-stripped.jar:./lib/commons-httpclient.jar:./lib/rome.jar:./lib/bootstrap.jar:./lib/axis-ant.jar:./lib/servlets-default.jar:./lib/jgi-client.jar:./lib/jaxrpc.jar:./lib/ant-jsp.jar:./lib/activation.jar:./lib/ant.jar:./lib/castor-xml.jar:./lib/wsdl4j.jar:./lib/xerces.jar:./lib/tomcat-util-stripped.jar:./lib/tomcat-coyote.jar:./lib/kunststoff.jar:./lib/bsf.jar:./lib/commons-codec.jar:./lib/saaj.jar:./lib/lws.jar:./lib/lws-jgi.jar:./lib/l2fprod-common-buttonbar.jar:./lib/browser-launcher.jar:./lib/l2fprod-common-directorychooser.jar:./lib/hsqldb.jar:./lib/dom.jar:./lib/catalina-jsp.jar:./lib/jython.jar:./lib/jgoodies.jar:./lib/jakarta-oro.jar:./lib/js.jar:./lib/catalina-stripped.jar:./lib/systray4j.jar:./lib/bsh.jar:./lib/axis.jar:./lib/commons-discovery.jar:./lib/lws-util.jar:./lib/jdom.jar:./lib/jrex.jar:./lib/skinlf.jar:./lib/servlet.jar:./lib/ale.jar:./lib/looks.jar:./lib/freemarker.jar:./lib/servlets-invoker.jar:./lib/jasper-compiler.jar:./lib/log4j.jar:./lib/servlets-common.jar:./lib/wrapper.jar:./lib/tomcat-http11.jar
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[7] : -Dwrapper.key=HZsiOXloyZN8IIxG
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[8] : -Dwrapper.port=1777
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[9] : -Dwrapper.debug=TRUE
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[10] : -Dwrapper.use_system_time=TRUE
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[11] : -Dwrapper.version=3.1.2
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[12] : -Dwrapper.native_library=wrapper
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[13] : -Dwrapper.service=TRUE
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[14] : -Dwrapper.cpu.timeout=10
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[15] : -Dwrapper.jvmid=1
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[16] : org.tanukisoftware.wrapper.WrapperStartStopApp
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[17] : com.screenscraper.controller.ControllerMain
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[18] : 1
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[19] : --start-server
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[20] : com.screenscraper.controller.ControllerMain
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[21] : true
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[22] : 1
DEBUG | wrapper | 2006/05/04 05:12:27 | Command[23] : --stop-server
STATUS | wrapper | 2006/05/04 05:12:27 | Launching a JVM...
INFO | jvm 1 | 2006/05/04 05:12:27 | WrapperManager class initialized by thread: main Using classloader: sun.misc.Launcher$AppClassLoader@133056f
INFO | jvm 1 | 2006/05/04 05:12:27 | Wrapper Manager: JVM #1
INFO | jvm 1 | 2006/05/04 05:12:27 | Wrapper Manager: Registering shutdown hook
INFO | jvm 1 | 2006/05/04 05:12:27 | Wrapper Manager: Using wrapper
INFO | jvm 1 | 2006/05/04 05:12:27 | Loaded native library: libwrapper.so
INFO | jvm 1 | 2006/05/04 05:12:27 | Calling native initialization method.
INFO | jvm 1 | 2006/05/04 05:12:27 | Inside native WrapperManager initialization method
INFO | jvm 1 | 2006/05/04 05:12:27 | Java Version : 1.5.0_03-b07 Java HotSpot(TM) Client VM
INFO | jvm 1 | 2006/05/04 05:12:27 | Java VM Vendor : Sun Microsystems Inc.
INFO | jvm 1 | 2006/05/04 05:12:27 |
INFO | jvm 1 | 2006/05/04 05:12:27 | Wrapper (Version 3.1.2) http://wrapper.tanukisoftware.org
INFO | jvm 1 | 2006/05/04 05:12:27 |
NFO | jvm 1 | 2006/05/04 05:12:27 | WrapperManager.start(org.tanukisoftware.wrapper.WrapperStartStopApp@145d068, args["--start-server"]) called by thread: main
INFO | jvm 1 | 2006/05/04 05:12:27 | Open socket to wrapper...
INFO | jvm 1 | 2006/05/04 05:12:27 | Opened Socket
INFO | jvm 1 | 2006/05/04 05:12:27 | Send a packet KEY : HZsiOXloyZN8IIxG
INFO | jvm 1 | 2006/05/04 05:12:27 | handleSocket(Socket[addr=localhost/127.0.0.1,port=1777,localport=58533])
DEBUG | wrapperp | 2006/05/04 05:12:27 | accepted a socket from 127.0.0.1 on port 58533
DEBUG | wrapperp | 2006/05/04 05:12:27 | read a packet KEY : HZsiOXloyZN8IIxG
DEBUG | wrapper | 2006/05/04 05:12:27 | Got key from JVM: HZsiOXloyZN8IIxG
DEBUG | wrapperp | 2006/05/04 05:12:27 | send a packet LOW_LOG_LEVEL : 1
DEBUG | wrapperp | 2006/05/04 05:12:27 | send a packet PING_TIMEOUT : 30
DEBUG | wrapper | 2006/05/04 05:12:27 | Start Application.
DEBUG | wrapperp | 2006/05/04 05:12:27 | send a packet START : start
INFO | jvm 1 | 2006/05/04 05:12:27 | Received a packet LOW_LOG_LEVEL : 1
INFO | jvm 1 | 2006/05/04 05:12:27 | Wrapper Manager: LowLogLevel from Wrapper is 1
INFO | jvm 1 | 2006/05/04 05:12:27 | Received a packet PING_TIMEOUT : 30
INFO | jvm 1 | 2006/05/04 05:12:27 | Wrapper Manager: PingTimeout from Wrapper is 30000
INFO | jvm 1 | 2006/05/04 05:12:27 | Received a packet START : start
INFO | jvm 1 | 2006/05/04 05:12:27 | calling listener.start()
INFO | jvm 1 | 2006/05/04 05:12:27 | WrapperStartStopApp: start(args)
INFO | jvm 1 | 2006/05/04 05:12:27 | WrapperStartStopApp: invoking start main method
INFO | jvm 1 | 2006/05/04 05:12:29 | Initializing screen-scraper server. Please wait...
INFO | jvm 1 | 2006/05/04 05:12:29 | Ready.
INFO | jvm 1 | 2006/05/04 05:12:29 | The server is in non-interactive mode. Run the "stop server" script to stop it.
INFO | jvm 1 | 2006/05/04 05:12:29 | WrapperStartStopApp: start main method completed
INFO | jvm 1 | 2006/05/04 05:12:29 | WrapperStartStopApp: start(args) end. Main Completed=true, exitCode=null
INFO | jvm 1 | 2006/05/04 05:12:29 | returned from listener.start()
INFO | jvm 1 | 2006/05/04 05:12:29 | Send a packet STARTED :
INFO | jvm 1 | 2006/05/04 05:12:29 | Warning: You're not using a Java Development Kit (SDK) environment so JSP pages can not be compiled.
DEBUG | wrapperp | 2006/05/04 05:12:29 | read a packet STARTED :
DEBUG | wrapper | 2006/05/04 05:12:29 | JVM signalled that it was started.
INFO | jvm 1 | 2006/05/04 05:12:29 | Starting service LiteWebServer Base Module (lws-base/3.0.3) (with LiteWebServer JSP Module (lws-jsp/1.1.2))
DEBUG | wrapperp | 2006/05/04 05:12:31 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:12:31 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:12:31 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:12:31 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:12:31 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:12:35 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:12:35 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:12:35 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:12:35 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:12:35 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:12:39 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:12:39 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:12:39 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:12:39 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:12:39 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:12:43 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:12:43 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:12:43 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:12:43 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:12:43 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:12:47 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:12:47 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:12:47 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:12:47 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:12:47 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:12:51 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:12:51 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:12:51 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:12:51 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:12:51 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:12:55 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:12:56 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:12:56 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:12:56 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:12:56 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:13:00 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:13:00 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:13:00 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:13:00 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:13:00 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:13:04 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:13:04 | Received a packet PING : ping

... [snipped similar ping messages] ...

INFO | jvm 1 | 2006/05/04 05:15:41 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:15:41 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:15:41 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:15:45 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:15:45 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:15:45 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:15:45 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:15:45 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:15:49 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:15:49 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:15:49 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:15:49 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:15:49 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:15:53 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:15:53 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:15:53 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:15:53 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:15:53 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:15:57 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:15:57 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:15:57 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:15:57 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:15:57 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:16:01 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:16:01 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:16:01 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:16:01 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:16:01 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:16:05 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:16:05 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:16:05 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:16:05 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:16:05 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:16:09 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:16:09 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:16:09 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:16:09 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:16:09 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:16:13 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:16:14 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:16:14 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:16:14 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:16:14 | Got ping response from JVM
DEBUG | wrapperp | 2006/05/04 05:16:18 | send a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:16:18 | Received a packet PING : ping
INFO | jvm 1 | 2006/05/04 05:16:18 | Send a packet PING : ok
DEBUG | wrapperp | 2006/05/04 05:16:18 | read a packet PING : ok
DEBUG | wrapper | 2006/05/04 05:16:18 | Got ping response from JVM
DEBUG | wrapper | 2006/05/04 05:16:18 | Signal trapped. Details:
DEBUG | wrapper | 2006/05/04 05:16:18 | signal number=15, source="kill, sigsend or raise"
DEBUG | wrapper | 2006/05/04 05:16:18 | signal generated by PID: 11171 (Session PID: 11023), UID: 0 (root)
STATUS | wrapper | 2006/05/04 05:16:18 | TERM trapped. Shutting down.
DEBUG | wrapper | 2006/05/04 05:16:18 | wrapperStopProcess(0) called.
DEBUG | wrapper | 2006/05/04 05:16:18 | Sending stop signal to JVM
DEBUG | wrapperp | 2006/05/04 05:16:18 | send a packet STOP : NULL
INFO | jvm 1 | 2006/05/04 05:16:18 | Received a packet STOP :
INFO | jvm 1 | 2006/05/04 05:16:18 | Thread, Wrapper-Connection, handling the shutdown process.
INFO | jvm 1 | 2006/05/04 05:16:18 | calling listener.stop()
INFO | jvm 1 | 2006/05/04 05:16:18 | WrapperStartStopApp: stop(0)
INFO | jvm 1 | 2006/05/04 05:16:18 | WrapperStartStopApp: invoking stop main method
INFO | jvm 1 | 2006/05/04 05:16:18 | Stopping server...
INFO | jvm 1 | 2006/05/04 05:16:18 | Stopping service LiteWebServer Base Module (lws-base/3.0.3) (with LiteWebServer JSP Module (lws-jsp/1.1.2))
INFO | jvm 1 | 2006/05/04 05:16:19 | Wrapper Manager: ShutdownHook started
INFO | jvm 1 | 2006/05/04 05:16:19 | WrapperManager.stop(0) called by thread: Wrapper-Shutdown-Hook
INFO | jvm 1 | 2006/05/04 05:16:19 | Thread, Wrapper-Shutdown-Hook, waiting for the JVM to exit.
INFO | jvm 1 | 2006/05/04 05:16:25 | Thread, Wrapper-Shutdown-Hook, continuing after 5 seconds.
INFO | jvm 1 | 2006/05/04 05:16:25 | Wrapper Manager: ShutdownHook complete
DEBUG | wrapperp | 2006/05/04 05:16:26 | socket read no code (closed?).
DEBUG | wrapper | 2006/05/04 05:16:26 | JVM process exited with a code of 0, leaving the wrapper exit code set to 0.
ERROR | wrapper | 2006/05/04 05:16:26 | JVM exited unexpectedly while stopping the application.
STATUS | wrapper | 2006/05/04 05:16:26 | <-- Wrapper Stopped

---------------------------------------------------------------------------------

Still nothing in error.log .

-Arun

agn on 05/03/2006 at 11:27 pm

Scraping session was either invalid or has not been set.

Hi Arun,

Right, let's turn up the verbosity of the logging. To do that, alter the "resource/conf/wrapper.conf" file such that the following settings have these values

wrapper.logfile.loglevel=DEBUG
wrapper.console.loglevel=DEBUG

We've actually been doing a bit of debugging in this area, and, while I think it's unrelated to what you're seeing, I suppose it could be a similar issue. Please try that and let me know if you see any errors or exceptions show up in the wrapper.log file.

Thanks,

Todd

todd on 05/03/2006 at 9:47 am

Scraping session was either invalid or has not been set.

Hi Todd,

There's nothing in error.log. Its empty !! I just downloaded the new tarball and its the same case. Script runs fine without any output. Nothing in logs.

root@host [/usr/local/screen-scraper/log]# ls
./ ../ error.log wrapper.log
root@host [/usr/local/screen-scraper/log]# cat wrapper.log
ERROR | wrapper | 2005/09/08 23:37:12 | JVM exited unexpectedly while stopping the application.
ERROR | wrapper | 2005/09/08 23:47:19 | JVM exited unexpectedly while stopping the application.
ERROR | wrapper | 2005/09/09 11:06:15 | JVM exited unexpectedly while stopping the application.
ERROR | wrapper | 2005/09/09 11:06:48 | JVM exited unexpectedly while stopping the application.
ERROR | wrapper | 2005/09/09 11:11:09 | JVM exited unexpectedly while stopping the application.
root@host [/usr/local/screen-scraper/log]# cat error.log
root@host [/usr/local/screen-scraper/log]#

Can screen-scraper be directed to do more verbose logging ?

-Arun

agn on 05/03/2006 at 12:59 am

Scraping session was either invalid or has not been set.

Hi Arun,

Would you mind sending me your log/error.log file? It may contain some clues that would help us troubleshoot. My email address is my first name at screen-scraper.com.

Thanks,

Todd

todd on 05/02/2006 at 10:50 pm

Scraping session was either invalid or has not been set.

Hi Todd,

I had actually changed the install folder in "resource/conf/screen-scraper.properties" to /usr/local/screen-scraper before as I didn't see it when checking the config files. But it didn't work. Also wrapper.conf has the path "wrapper.java.command=/usr/local/screen-scraper/jre/bin/java" already set by default. Should the path be included anywhere else ? And yeah, I noticed that start-server.sh wasn't working and I used the `server start` to start the server. Anything else that I should look into ?

- Arun

agn on 05/02/2006 at 10:27 pm

Scraping session was either invalid or has not been set.

Hi Siju,

There actually was one error with the tarball installer that we just fixed yesterday--the "resource/conf/screen-scraper.properties" file didn't contain "/usr/local/screen-scraper/" as the default install folder. You could either download the latest tarball, in which it is fixed, or simply ensure that the install folder is correct in these three files

resource/conf/screen-scraper.properties
resource/conf/wrapper.conf
start_server.sh

My apologies for any convenience. Please just let me know if I can help further.

Best wishes,

Todd

todd on 05/02/2006 at 10:39 am

Scraping session was either invalid or has not been set.

Thakyou so much Todd for your continuing support :-)
Arun is out of station so he has asked me to look into this.

The install Instruction says

--------------------
Once the tarball is decompressed into its installation directory a number of files must be changed to reflect the location (note that if you install to "/usr/local/screen-scraper" you can skip this step entirely--screen-scraper is ready to go). These files are as follows:
-------------------------------------------------------------------------

and it is in "/usr/local/screen-scraper"

--------------

[/usr/local]# ls -l |grep scraper
drwxrwxr-x 10 root nobody 4096 Apr 28 04:10 screen-scraper/
[/usr/local]# ls -l screen-scraper/
total 884
drwxrwxr-x 10 root nobody 4096 Apr 28 04:10 ./
drwxr-xr-x 18 root root 4096 Apr 26 07:10 ../
drwxr-xr-x 2 502 mailtrap 4096 Sep 9 2005 cachedir/
-rw-r--r-- 1 502 root 0 Apr 28 04:08 closing_lock
-rwxr-xr-x 1 502 mailtrap 0 Sep 9 2005 command_line_lock*
drwxr-xr-x 3 502 mailtrap 4096 Sep 9 2005 doc/
-rw-r--r-- 1 502 root 2829 Apr 26 12:39 gridconverter.php
drwxr-xr-x 2 502 mailtrap 4096 Apr 26 12:39 import/
-rw-r--r-- 1 502 mailtrap 1177 Sep 9 2005 INSTALL
drwxr-xr-x 7 502 mailtrap 4096 May 6 2005 jre/
-rw-r--r-- 1 502 mailtrap 41559 Sep 9 2005 lax.jar
drwxr-xr-x 3 502 mailtrap 4096 Mar 8 22:13 lib/
-rwxr-xr-x 1 502 mailtrap 10044 Jun 28 2005 license.txt*
drwxr-xr-x 2 502 mailtrap 4096 Sep 9 2005 log/
drwxr-xr-x 5 502 mailtrap 4096 Sep 9 2005 misc/
drwxr-xr-x 7 502 mailtrap 4096 Sep 9 2005 resource/
-rwxr-xr-x 1 502 mailtrap 113 Apr 28 04:08 restart_server.sh*
-rwxr-xr-x 1 502 mailtrap 47887 Sep 9 2005 screen-scraper*
-rwxr-xr-x 1 502 mailtrap 631832 Mar 24 19:17 screen-scraper.jar*
-rwxr-xr-x 1 502 mailtrap 688 Apr 28 04:08 screen-scraper.lax*
-rw-r--r-- 1 root root 6 Apr 28 04:08 screen-scraper.pid
-rwxr-xr-x 1 502 mailtrap 8916 Jul 8 2005 server*
-rwxr-xr-x 1 502 mailtrap 0 Apr 28 04:08 server_lock*
-rwxr-xr-x 1 502 mailtrap 111 Apr 28 04:08 start_server.sh*
-rwxr-xr-x 1 502 mailtrap 110 Apr 28 04:08 stop_server.sh*
-rwxr-xr-x 1 502 mailtrap 0 Apr 28 04:08 workbench_lock*
-rwxr-xr-x 1 502 mailtrap 70577 Oct 1 2004 wrapper*
--------------------------------------------------------------------------

Siju on 05/02/2006 at 8:12 am

Scraping session was either invalid or has not been set.

Hi Arun,

It looks as though you may just need to set the install directories. In the Linux tarball there is an "INSTALL" file that details a few files in which you need to set the path where screen-scraper is installed. Could you double-check that to ensure that they're all correctly set? If it still gives you trouble after that please post back.

Thanks,

Todd

todd on 04/28/2006 at 8:43 am

Scraping session was either invalid or has not been set.

- Yes, its linux. Tried it on a debian and redhat ES box.
- Yes, I have the xml file in import directory.
- Screen-scraper is called through a php file.
- I can't find anything in log/error.log (Its blank). log/wrapper.log has some JVM related warnings.

---------------------------------------------------------
[b]root@host [~]# cd /usr/local/screen-scraper/
root@host [/usr/local/screen-scraper]# ls[/b]
./ closing_lock gridconverter.php jre/ license.txt* resource/ screen-scraper.jar* server_lock* workbench_lock*
../ command_line_lock* import/ lax.jar log/ restart_server.sh* screen-scraper.lax* start_server.sh* wrapper*
cachedir/ doc/ INSTALL lib/ misc/ screen-scraper* server* stop_server.sh*
[b]root@host [/usr/local/screen-scraper]# ls -l[/b]
total 880
drwxrwxr-x 10 root nobody 4096 Apr 26 13:09 ./
drwxr-xr-x 18 root root 4096 Apr 26 07:10 ../
drwxr-xr-x 2 502 mailtrap 4096 Sep 9 2005 cachedir/
-rw-r--r-- 1 root root 0 Apr 26 13:09 closing_lock
-rwxr-xr-x 1 502 mailtrap 0 Sep 9 2005 command_line_lock*
drwxr-xr-x 3 502 mailtrap 4096 Sep 9 2005 doc/
-rw-r--r-- 1 root root 2829 Apr 26 12:39 gridconverter.php
drwxr-xr-x 2 502 mailtrap 4096 Apr 26 12:39 import/
-rw-r--r-- 1 502 mailtrap 1177 Sep 9 2005 INSTALL
drwxr-xr-x 7 502 mailtrap 4096 May 6 2005 jre/
-rw-r--r-- 1 502 mailtrap 41559 Sep 9 2005 lax.jar
drwxr-xr-x 3 502 mailtrap 4096 Mar 8 22:13 lib/
-rwxr-xr-x 1 502 mailtrap 10044 Jun 28 2005 license.txt*
drwxr-xr-x 2 502 mailtrap 4096 Sep 9 2005 log/
drwxr-xr-x 5 502 mailtrap 4096 Sep 9 2005 misc/
drwxr-xr-x 7 502 mailtrap 4096 Sep 9 2005 resource/
-rwxr-xr-x 1 502 mailtrap 113 Apr 26 13:09 restart_server.sh*
-rwxr-xr-x 1 502 mailtrap 47887 Sep 9 2005 screen-scraper*
-rwxr-xr-x 1 502 mailtrap 631832 Mar 24 19:17 screen-scraper.jar*
-rwxr-xr-x 1 502 mailtrap 688 Apr 26 13:09 screen-scraper.lax*
-rwxr-xr-x 1 502 mailtrap 8916 Jul 8 2005 server*
-rwxr-xr-x 1 502 mailtrap 0 Apr 26 13:09 server_lock*
-rwxr-xr-x 1 502 mailtrap 111 Apr 26 13:09 start_server.sh*
-rwxr-xr-x 1 502 mailtrap 110 Apr 26 13:09 stop_server.sh*
-rwxr-xr-x 1 502 mailtrap 0 Apr 26 13:09 workbench_lock*
-rwxr-xr-x 1 502 mailtrap 70577 Oct 1 2004 wrapper*
[b]root@host [/usr/local/screen-scraper]# cd log
root@host [/usr/local/screen-scraper/log]# cat error.log
root@host [/usr/local/screen-scraper/log]# cat wrapper.log [/b]
ERROR | wrapper | 2005/09/08 23:37:12 | JVM exited unexpectedly while stopping the application.
ERROR | wrapper | 2005/09/08 23:47:19 | JVM exited unexpectedly while stopping the application.
ERROR | wrapper | 2005/09/09 11:06:15 | JVM exited unexpectedly while stopping the application.
ERROR | wrapper | 2005/09/09 11:06:48 | JVM exited unexpectedly while stopping the application.
ERROR | wrapper | 2005/09/09 11:11:09 | JVM exited unexpectedly while stopping the application.
ERROR | wrapper | 2006/04/26 13:09:55 | JVM exited unexpectedly while stopping the application.
[b]root@host [/usr/local/screen-scraper/log]# cd ..
root@host [/usr/local/screen-scraper]# cd import/
root@host [/usr/local/screen-scraper/import]# ls[/b]
./ ../ st_Scraping_Session_.xml
[b]root@host [/usr/local/screen-scraper/import]# ls -l[/b]
total 16
drwxr-xr-x 2 502 mailtrap 4096 Apr 26 12:39 ./
drwxrwxr-x 10 root nobody 4096 Apr 26 13:09 ../
-rw-r--r-- 1 root root 5963 Apr 26 12:35 st_Scraping_Session_.xml
[b]root@host [/usr/local/screen-scraper/import]# cd ../resource/conf/
root@host [/usr/local/screen-scraper/resource/conf]# cat screen-scraper.properties [/b]
#This file is manipulated by screen-scraper. Edit it manually at your own risk!
#Sat Sep 04 13:30:59 MDT 2004
DefaultProxySession=
InstallDirectory=
ExternalNTProxyHost=
ExternalProxyPassword=
ServerPort=8778
SaveLargeFields=false
ExternalProxyPort=
MainFrame.LastWidth=800
ExternalProxyUsername=
MaxConcurrentScrapingSessions=5
Version=2.7.2
ExternalNTProxyDomain=
ExternalNTProxyAuthentication=NTfoo\:NTbar
TidyHTML=true
ExternalProxyHost=
MaximumMemoryAllocation=256
ExternalNTProxyPassword=
ConnectionTimeout=15
ExternalProxyAuthentication=foo\:bar
IPAddressesToAllow=192.168,127.0,localhost
DontLogBinaryFiles=true
ExternalNTProxyUsername=
DataExtractorTimeout=1
LastSelectedDirectory=
MainFrame.LastHeight=600
ProxyForceAllHTTPRequestsToHTTPS=false
ProxyPort=8777
Edition=EDITION
MailServerPassword=
MailServerUsername=
MailServerHost=
OutputLogFiles=true
------------------------------------------------------------------------

Screen-scraper is run as root. And the php file is run in a browser. Tried it through console, but same thing. Also sometimes it runs fine, but without creating anything in log directory. And the xml remains in import directory. The php script is coded to output the scraped
data in browser, but nothing happens.

Here's the script:
[b]root@host [/usr/local/apache/htdocs]# cat script.php[/b]
require( 'remote_scraping_session.php' );

$session = new RemoteScrapingSession;

$session->initialize( "st", "70.87.xx.xx", "8778" );

$session->scrape();

if( $session->isError() )
{
echo "An error occurred: " . $session->getErrorMessage() . "
";
exit();
}

$session->setBufferSize( 64000 );

$data_set = $session->getVariable( "DETAILS" );

echo "Finished Scrapping Session for st";
?>

One more thing that I noticed is that, its when I change the IP in the php script to 127.0.0.1 that I get the above mentioned error (session invalid or not set). If I use any other IP assigned to interface, I don't get the error but the script runs without any output.

Thanx
-Arun

agn on 04/27/2006 at 10:17 pm

Scraping session was either invalid or has not been set.

Hi,

I think I'll need a bit more information in order to be of help

- It sounds like you're running Linux. Is this correct?
- Have you deployed your scraping session to your non-GUI/server instance? You would do this by copying the exported scraping session XML file into the "import" folder.
- How are you invoking screen-scraper? I'm guessing you're invoking it from an external application (e.g., Java or PHP).
- Does the "log/error.log" file contain anything? It might indicate errors that occurred when screen-scraper was starting up.

Kind regards,

Todd Wilson

todd on 04/27/2006 at 8:45 am

Search

Community

screen-scraper

User login

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.

Scraping session was either invalid or has not been set.