screen-scraper support for licensed users

Hi - I have found a type of site I haven't come across before and I can't make SS display the same content as the browser. I have tried a proxy, but this seems to fail, I have used Chrome to inspect the site, but still could not see the path I need to take to see the product listings in SS

https://www.truckstore.co.za/search.html#/currency=ZAR

I have spent a long time and I'm very confused!

Thanks for any suggestions in advance

Jason (the one who knows very little about Screen Scraper, not the other one who does)

After upgrading from pro version 7.0 to 7.0.13a the following line of code causes an error. I checked and the correct drivers are in place. It appears that something with the alpha version is causing this.

Class.forName("com.microsoft.sqlserver.jdbc.SQLServerDriver");

The error message was: ClassNotFoundException (line 140): com.microsoft.sqlserver.jdbc.SQLServerDriver--Sourced file: inline evaluation of: ``//////////////////////////////////////////////////////////// /////////////////// . . . '' : Method Invocation Class.forName

Hi, I've been trying to implement this method: (Save session state)
https://support.screen-scraper.com/documentation/api/session/saveStateToString

By adding the referenced code to a session file after scraping ends which works great.

Then I attempt to retrieve the file before session begins using this method:

https://support.screen-scraper.com/documentation/api/session/loadStateFromString

However I get the error: "not found in class'org.apache.commons.io.FileUtils"

I tried uninstalling and reinstalling according to this:
http://www.screen-scraper.com/blog/2015/04/29/https-connection-issues/

Any idea what the problem might be?

It seems I'm using the latest Java:

I thought I saw a thread that spoke of reading an html file and scraping it.

Is there such a thread on how to do that?

Thanks

Hi

I have been through the documentation and made some guesstimates, but have come up at a loss.

Is it possible to use the CSV writer but to not write the headers in the file?

Here is my initialisation script:
// Set the session variables.
session.setVariable( "NEXT", "1" );

// Create CsvWriter with timestamp
CsvWriter writer = new CsvWriter("OmecoDataIn.txt", '|');

// Create Headers Array

I need advice on how to handle future Java versions which, according to ORACLE, will not be free any more.
Will you recommend upgrading from V8 to V11 or can I stay with V8, which, as far as I know, will remain free.
best regards
Christian Pieler

While testing the proxy server pool, I am getting these messages:

Using proxy: 200.112.213.157:53281 - with credentials
Reporting the current proxy server as bad.
The current proxy server was previously reported as bad.
Reporting the current proxy server as bad.
The current proxy server was previously reported as bad.
BAZAR_FirmenDetails: An input/output error occurred while connecting to 'http://www.bazar.at/haring-group'. The message was Connect to 200.112.213.157:53281 [/200.112.213.157] failed: Connection timed out: connect.

When I try to test the following program accordinmg to your examples (V 6.0.69a):

============================================
import com.screenscraper.util.*;

// Create a new ProxyServerPool object. This object will
// control how screen-scraper interacts with proxy servers.

Pool = new ProxyServerPool();
// session.log("after new Pool ");

Pool.populateFromFile( "proxy_list.txt" );
session.log("after populate: " + Pool.getNumProxyServers());

// Validate proxies up to 25 proxies at a time.
Pool.setNumProxiesToValidateConcurrently( 1 );

Making a request to load a page fails (see log below). Screen-scraper hangs and after 10 minutes I had to stop it. Sometimes the first (or second) run will work but multiple attempts will eventually cause a problem.

I also have a single extractor pattern

Thanks, Jeremy

Starting scraper.
Running scraping session: Test
Processing scripts before scraping session begins.
Processing script: "Test"
=========================================================