screen-scraper public support
Disabling Javascript Execution
I have a site that I am scraping that runs a quick Javascript cookie test before loading the page and if the javascript fails, it redirects to the no cookie error page. I am pretty sure that the data I want is actually there, but is there a way to make screen-scraper simply not execute the javascript so I can scrape the page?
Dates in Scripts
Hi there-
I have been working with screen scraper for awhile now and LOVE it! Quick question though. I am new to the java language and don't know the correct syntax to use for this. I have a script where I have to change the date variable each day to pull in that days information. Is there a way to write some sort of IIf statement in java so it will go back one day vs me having to change the date each day. Just thought I would ask.
Jason
How to set number of retries when loading an url?
Hello, thanks for a great product.
Is there a way to set the number of reties a scrapesession should try to fetch an URL, before failing?
Can't seem to find a way to set it :-(
Also, is there a way to add some errorhandling with that?
Best regards gustav
Overwrite export file
I have a screen scraper script setup to write to a text file after each patter application. Is it possible to modify the output script to overwrite the file each time vs. appending to it. I run it everyday and need it to overwrite the same text file so it will not append to it.
Session variable used in DownloadFile command
I have a scraping session that extracts the URL for a download file and saves in a session variable.
How can I reference this variable in the script below - this is not working??
session.downloadFile( "~#url#~", "C:/file.csv", 5, true );
Tommie
HTTPS websites not showing in proxy
The proxy server doesn't seem to be logging any HTTPS sites, which I can access just fine through the browser. Other sites are being logged just fine. Any ideas why?
No Export and No Restore options
I'm not sure if I'm missing something, but I can see an option to import, but no option to export and there's an option to Backup, but no option to restore. I would like to be able to wrap up a project and start a new one, but I'm afraid I'll loose my project. Is this a limitation of the free version?
Thanks
Extractor Pattern for HTML
Hi Guys-
I hope you can help on this one. I have this bit of HTML that is returned after you submit a tracking request, but can't figure out how for the life of me to write a proper extractor pattern for this? I really only need one bit of information from it.
The only part I need is the
Here is a snippet of the HTML that is returned.
sometimes trouble reading file
Using ScreenScraper 2.6 professional edition.
Workstation A: has an "M" drive pointing to local volume, shared out
Workstation B: has an "M" drive pointing to that shared volume on A
(I.e. A & B are reading/writing to same storage)
Workstation A & B have the same ScreenScraper scrapes/code. In the code there is a part that checks to see if a file on the M drive exists (using Java File.exists()).
When running the scrapes on either workstation directly from ScreenScraper GUI, both work and can read the file.
Strange question, but is it doable in screen scraper
I am finally working toward an end to the program I have been writing and have a big question. Currently the website I am scraping allows us to put in up to 1000 tracking numbers to track in one session. I currently have all the tracking numbers in a csv file that reads in and loops to the next. Is it possible for screen scraper to read in 1000 tracking numbers vs one by one?
Jason