screen-scraper public support

Questions and answers regarding the use of screen-scraper. Anyone can post. Monitored occasionally by screen-scraper staff.

Disabling Javascript Execution

I have a site that I am scraping that runs a quick Javascript cookie test before loading the page and if the javascript fails, it redirects to the no cookie error page. I am pretty sure that the data I want is actually there, but is there a way to make screen-scraper simply not execute the javascript so I can scrape the page?

Dates in Scripts

Hi there-

I have been working with screen scraper for awhile now and LOVE it! Quick question though. I am new to the java language and don't know the correct syntax to use for this. I have a script where I have to change the date variable each day to pull in that days information. Is there a way to write some sort of IIf statement in java so it will go back one day vs me having to change the date each day. Just thought I would ask.

Jason

How to set number of retries when loading an url?

Hello, thanks for a great product.

Is there a way to set the number of reties a scrapesession should try to fetch an URL, before failing?
Can't seem to find a way to set it :-(
Also, is there a way to add some errorhandling with that?

Best regards gustav

Overwrite export file

I have a screen scraper script setup to write to a text file after each patter application. Is it possible to modify the output script to overwrite the file each time vs. appending to it. I run it everyday and need it to overwrite the same text file so it will not append to it.

Session variable used in DownloadFile command

I have a scraping session that extracts the URL for a download file and saves in a session variable.

How can I reference this variable in the script below - this is not working??

session.downloadFile( "~#url#~", "C:/file.csv", 5, true );

Tommie

HTTPS websites not showing in proxy

The proxy server doesn't seem to be logging any HTTPS sites, which I can access just fine through the browser. Other sites are being logged just fine. Any ideas why?

No Export and No Restore options

I'm not sure if I'm missing something, but I can see an option to import, but no option to export and there's an option to Backup, but no option to restore. I would like to be able to wrap up a project and start a new one, but I'm afraid I'll loose my project. Is this a limitation of the free version?

Thanks

Extractor Pattern for HTML

Hi Guys-

I hope you can help on this one. I have this bit of HTML that is returned after you submit a tracking request, but can't figure out how for the life of me to write a proper extractor pattern for this? I really only need one bit of information from it.

The only part I need is the

 ursa-code "CUCYMA"
I need to extract what is in the quotations.

Here is a snippet of the HTML that is returned.

sometimes trouble reading file

Using ScreenScraper 2.6 professional edition.

Workstation A: has an "M" drive pointing to local volume, shared out
Workstation B: has an "M" drive pointing to that shared volume on A

(I.e. A & B are reading/writing to same storage)

Workstation A & B have the same ScreenScraper scrapes/code. In the code there is a part that checks to see if a file on the M drive exists (using Java File.exists()).

When running the scrapes on either workstation directly from ScreenScraper GUI, both work and can read the file.

Strange question, but is it doable in screen scraper

I am finally working toward an end to the program I have been writing and have a big question. Currently the website I am scraping allows us to put in up to 1000 tracking numbers to track in one session. I currently have all the tracking numbers in a csv file that reads in and loops to the next. Is it possible for screen scraper to read in 1000 tracking numbers vs one by one?

Jason