screen-scraper support for licensed users
Server.exe lock up (uses 100% of the process)
I have a project that runs every hour. It's been on the same server for a few months now and worked great. In just the last couple of days the server.exe will start to use 100% of the process. I'm using a .net application to connect to the project and run it. Even after closing the .net app, the process still runs at 100% (some times it will drop to 95 and then go back to 100).
Moving projects to new server
Is it possible to move the complete installation (or the project database) to a new server? I have a server with 25 projects and I want to move them to a new server. Do I have to export each one, or can I copy all or a portion of the installation to the new server? I already have the new server setup with the same version of screen-scraper.
RemoteScrapingSession - CharacterSet problems
Hi! :-)
I need to scrape an ISO-8859-1 encoded site.
I am creating the remote session in Java.
*) I have tried setting default charset in setting globally to ISO-8859-1
*) I have tried setting the session settings to ISO-8859-1 encoding
*) I have tried setting encoding in the first script with session.setCharacterSet( "ISO-8859-1" );
Nothing works. I still get stuff like "Fj?rde generation" back to my Java.
What to do?
/Gustav
Bug: Keyboard stops responding
This is an odd one. I haven't used screenscraper much since version 5 came out but I'll be needing it quite a bit in future so I've only just dusted it off and started using again.
I've got the latest version 5.5.37a running on 64 bit Ubuntu 10.04 LTS
MS SQL Server Identity Column
Hello Screen Scraper pros
I am working on a project right now where I am using screen-scraper to log in and download a report. I would like to save every line from the report in a database. I am doing that currently using an extractor pattern to pull out the datarecord and then manually applying 2 other patterns to the record to extract transactions and adjustments using a script.
I have included the relavent sections of my script that runs on each pattern match (the pattern being a section of transactions and adjustments).
Multiple Instances of tor
I have been having trouble setting up multiple instances of tor on one machine. I am scraping a large project and tor really bogs down when there is too much of a load on it. Has anyone done this? I have already made new directories and changed the torrc file.
Solved: 5.5.35a - Made a fix for "deflate" content encoding. - doesn't seem to work
Update:
I found out that I was able to change the setting in Session->advanced tab to the correct encoding. (global settings didn't do it for me)
If someone has this problem, try out that before you post on the forum making an a** of yourself like me :-)
According to the newest alpha changelog a fix was added for "deflate" content encoding, but it seems that the deflate content encoding is still not working. At least not for me.
I still get UTF-8 (i think) data with unreadable signs in my extractions when I scrape sites with gzip enabled, and ISO-8859-1 encoded data.
Concurrent Scrape: Out of memory
I'm having memory problems when running concurrent scrapes.
Here is my set up.
win 7
4 gig ram
quad 2.6ghz
1 gig max memory allocation in screen scraper
I'm invoking screen scraper via java.
Java side:
Read input from file and save it to list. Close stream.
//loops for around 50 keywords
//this spawns 50 scrapes
for (String keyword : keyList)
{
try
{
RemoteScrapingSession remoteScrapingSession = new RemoteScrapingSession("TEST");
remoteScrapingSession.setVariable("KEYWORD", keyword );
remoteScrapingSession.setDoLazyScrape( true );
Make RemoteScrapingSession Assembly ComVisible
Can you regenerate the DotNET RemoteScrapingSession assembly in the "C:\Program Files\screen-scraper professional edition\misc\dotNET" folder using the steps outlined in the following article [http://www.codeproject.com/Articles/42307/Grant-Access-to-your-Assembly-from-COM-Objects] to make it ComVisible and, therefore, accessible from excel, vbscript and so on? The current version lacks a "Strong Name" and is not visible in COM applications!
matekus
While Scraping a DWR Site i got an Error like this..
throw 'allowScriptTagRemoting is false.';
//#DWR-INSERT
//#DWR-REPLY
dwr.engine.remote.handleCallback("7","0",[{applyNowUrl:null,city:null,county:null,dateAddedToCart:null,degreeName:"High School