screen-scraper public support
cannot write to file (in interpreted Java)
For some reason, I can create a file but cannot write to it using FileWriter, when coding in interpreted Java. I do the following:
<br />
file.write( "just some text" );<br />
<br />
file.close();
This creates file.txt but does not write the text to it. However, when I code the following in normal Java, it works just fine, meaning it creates and writes to file.txt:
Check for existance of script
I'm changing the way my global scripts work and I'm wondering if there's a way to know if a script exists.
I have a global script that all scrapes run when starting. I want it to look for a script with the name of the scrape with ".required" appended to it. So "general.info" scrape would have a script called "general.info.required". I would like the existance of the script to be optional. Some scrapes are simple, others need preprocessing.
So: How do I most efficiently check if a script exists? try/catch a session.executeScript, or is there a way to explicitly check?
iframe removed by tidy up of html code ?
Hi,
What kind of changes does the screenscraper when tidying up the html code ?
my feedback about forum
Wonderful forum!
Never visited so informative resourse.
Does it helpful for you also?
DropDown Looping extraction
Hi all
I'm new to screen-scraping and before I spend hours going through the tutorials I just wanted to know if screen-scraper can do what I need it to do.
Proxy Session
I am having trouble getting a couple of websites to respond once I start the proxy server and change the browser connection settings (I am using port 6777 since 8777 is used by something else). If I set it up for your site I have no problem. One of the sites is www.autozone.com and the other is www.oreillyauto.com.
script not running
When I call an extractor pattern from a script, another script that is associated with that called extractor pattern to run after each patterm application, does not run.:(
After having suspicions about the script not being run, I put the following line as the first line in the script:
When I ran the scraping session, that above string did not output to the session log.
Using data in proxy server log
Hi, im trying to retrive a url that only ever appears in the PRoxy server log file. I believe this to be GET data? (although I may be barking up the wrong tree) Basically when I send a session to
i want to retrieve this URL
NullPointerException error for dataRecord
I have no idea why I am getting this error for my script, especially since it is running after each pattern application - at which time dataRecord should be in scope :x
Details:
In my script the following first line produces an error:
The error displayed in the session's log (under the log tab):
forum engine
Hello !
Sorry to bother you. I found this forum when looking through google for forums to use. I need
to install a forum on my website but I cannot find where it is sold.
Where did you get this one
Thanks for any assistance