Page request causes screen-scraper to hang
Making a request to load a page fails (see log below). Screen-scraper hangs and after 10 minutes I had to stop it. Sometimes the first (or second) run will work but multiple attempts will eventually cause a problem.
I also have a single extractor pattern Thanks, Jeremy Starting scraper.
Running scraping session: Test
Processing scripts before scraping session begins.
Processing script: "Test"
=========================================================
=================== Log Variables with Message ===============
screen-scraper Instance Information
=================== Static Values ================
Java Vendor: Oracle Corporation
Java Version: 1.8.0_66
OS Architecture: amd64
OS Name: Windows 8
OS Version: 6.2
Scrape HTTP Client: AsyncNingScrapingHttpClient
SS Connection Timeout: 180 seconds
SS Edition: Professional
SS Extractor Timeout: 30000 milliseconds
SS Max Concurrent Scraping Sessions: 5
SS Maximum Memory: 256 MB
SS Run Mode: Workbench
SS Version: 7.0
======== Message logged at: 07/27/2018 10:09:51.679 CDT ========
=========================================================
Scraping file: "New Scrapeable File"
New Scrapeable File: Requesting URL: https://www.applewoodnissanrichmond.ca/vehicles/2008/Suzuki/SX4/Richmond/BC/JS2YC415785111743/?sale_class=Used
ClassNotFoundException
Now the upgrade is causing this error message: ClassNotFoundException (line 100): com.microsoft.sqlserver.jdbc.SQLServerDriver
100 Class.forName("com.microsoft.sqlserver.jdbc.SQLServerDriver");
101 conn = DriverManager.getConnection("jdbc:sqlserver://" + url + ":" + port + ";"
+ "instance=" + instance + ";databaseName=" + database + ";" +
"userName=" + user + ";password=" + password + ";");
Nothing was changed, just ran the upgrade...
=========================================================
=================== Log Variables with Message ===============
screen-scraper Instance Information
=================== Static Values ================
Java Vendor: Oracle Corporation
Java Version: 1.8.0_66
OS Architecture: amd64
OS Name: Windows 8
OS Version: 6.2
Scrape HTTP Client: AsyncNingScrapingHttpClient
SS Connection Timeout: 180 seconds
SS Edition: Professional
SS Extractor Timeout: 30000 milliseconds
SS Max Concurrent Scraping Sessions: 5
SS Maximum Memory: 256 MB
SS Memory Use: 8%
SS Run Mode: Workbench
SS Version: 7.0.11a
======== Message logged at: 07/30/2018 12:59:10.260 CDT ========
=========================================================
The error message was: ClassNotFoundException (line 100): com.microsoft.sqlserver.jdbc.SQLServerDriver--Sourced file: inline evaluation of: ``//////////////////////////////////////////////////////////// /////////////////// . . . '' : Method Invocation Class.forName
That is very different. Do
That is very different. Do you have a script to connect to a SQL Server database? If you disable that script (or comment out the connection), do you get that error?
Yes I agree that it's not
Yes I agree that it's not related to the original issue. I ran a couple of tests in a different project and it looks like the issue is gone.
This project has to connect to a sql database to get a list of links so I can't completely test it. Also the update will have to go on a production server so the new error message will prevent an upgrade.
I'm using the sqljdbc4.jar placed in the lib/ext directory.
I can think of no reason that
I can think of no reason that wouldn't work. I use the mssql-jdbc-6.4.0.jre8.jar and it is working. That is the right version for Java 8. Would it be worth trying?
Can you send an example of
Can you send an example of the connection code? I tried the mssql-jdbc-6.4.0.jre8.jar and still receive this message:
The error message was: ClassNotFoundException (line 100): com.microsoft.sqlserver.jdbc.SQLServerDriver--Sourced file: inline evaluation of: ``//////////////////////////////////////////////////////////// /////////////////// . . . '' : Method Invocation Class.forName
Class.forName("com.microsoft.sqlserver.jdbc.SQLServerDriver"); // this is line 100 - error
conn = DriverManager.getConnection("jdbc:sqlserver://" + url + ":" + port + ";"
+ "instance=" + instance + ";databaseName=" + database + ";" +
"userName=" + user + ";password=" + password + ";");
I just tested this in v
I just tested this in v 7.0.11a and it worked. Could you update and test? You could also try to change the HTTP client on the session > advanced tab.