screen-scraper public support
new version V4.5 with Scraping sessions from command line
hi guys
Congratulations to the new version.Great work.
I just played around with it , and found something a bit strange with the command line
when i trying to use
jre\bin\java -jar screen-scraper.jar -s "xxx" -p "xxx" from linux, after the scraping session finished
the command prompt doesn't come back. Seems the script still running.Even though it says it finished in the log file.
any1 else got the same situation?
br
//Max
[OUT OF TOPIC] I can't access the faq
Hello, I can't access the faq section on the site. Access is denied. What's the matter?
... please delete the doublepost
Can someone help me with downloading images plz
Hello every one,
I am having a problem with a test script that I am making to see if this program can do what I am hoping to.
This is the code I am trying to use.
session.downloadFile( "http://www.someURL/" + session.getVariable ("IMAGEURL"), "C:/images/" + session.getVariable ("IMAGENAME") + ".jpg" );
This code works if I would enter the full URL manually instead of trying to use the ~@IMAGEURL@~. So the code will save the images as long as I manually type in the entire URL. But I need to be able to scrape the url and download the image automatically.
more wierdness with session vars
I've been coming across all sorts of inconsistent behaviour with session variables lately... The latest problem is that I have an initialize script which sets a number of session variables that need to be referred to in varous scripts throughout the session.
In particular I've set the following:
session.setVariable("MAX_POSTS",50);
now in some scripts I can access the variable directly as a parameter for another method i.e. session.setVariable("Iterations",session.getVariable("MAX_POSTS"));
sub extractor not working the same as normal pattern
I'm trying to extract the following snippet froma phpBB forum. I've seen this in a few different places on the site...
<option value="187">another group</option><br />
<option value="39">CVI Moderators</option><br />
<option value="74">Grey Hole</option><br />
<option value="40">Private discussion area</option><br />
<option value="133">Read general only</option><br />
<option value="55">Void Dwellers</option><br />
</select>
I've created a main extractor pattern:
Tutorial Help
I downloaded SS and been trying to get the tutorial working.
I get everything working (from the Tutorial Hello World), until
http://community.screen-scraper.com/Tutorial_1_page_6
No where does it say: "~@FORM_SUBMITTED_TEXT@~". So when I try clicking Apply Pattern to Last Scraped Data, nothing happens.
Any thoughts?
Is there a way to get rid of a session variable?
I see the session.clearAllVariables() method but is there a way to clear just one? i.e. so it disappears entirely not just nulling the value it holds.
weird typing issue
I have a bit of a bizzare problem with my interpreted java script. It's behaving oddly with recognising various datatypes.
I've set the following session variables at various points in the scraping sessions (not in the same script as I'm calling them back). The only difference between the problem ones (the first two) and the other is how they are set:
Tried everything, couldn't scrap SSL site.
Hello All,
I wanted to know if someone could succesfully scrap an SSL site.
I've tried with the following browsers (using Ubuntu/ Professional trial of screen-scraper for Linux)
Firefox 2.0
IE 6
Opera 9.5b
And I still couldn't succesfully get content. It works perfectly for non Secure sites, but with SSL was imposible to make it work.
The site I was trying to work with is:
www.merca**.es (An spanish supermarket site)
Option to run Screen Scraper slowly?
Hello,
How can I adjust screen scraper to run slowly to minimize the strain on the server?
thanks,