screen-scraper support for licensed users
How to activate my professional version licence.
Hi,
Initially we have used screen scraper professional version trial.
We found it is very useful, and purchased it now.
But we dont know how to activate our licence.
The most important thing is we are running in a GUI less Linux environment.
So help us to activate the licence.
Sorry Friends, after posting this i had gone through the site and found the answer.
I got my answer from FAQ section. It is great,
Scheduled Scraping Sessions Halting
I have a group of scrapes that are scheduled to run every morning at the same time, specifically 18 scrapes, 14 of which are produced from the same runnable scrape, each with unique parameters. I have set the maximum concurrent scrapes to 10. At the scheduled start time, ten of the scrape begin - as they should. Several of the scrapes will finish successfully, anywhere between 3-6. However, at different points in time the remaining scrapes halt and do not finish processing.
Can't read page - SS drops parameters
I'm trying to scrape a category page in asp.net - the url looks like "http://www.example.com/category.aspx?CategoryID=12345". If I type that URL into a browser, I get a particular subcategory page. However, when I scrape it (using 'strict mode' or extracting the parameters) I get the top-level category page, which is the same URL but without any parameters.
Any idea why I can't scrape this page?
string.replaceAll()
I am having problems eliminating "$" from my record set.
I tried;
string.replaceAll("$","") but it did nothing.
also
string.replace('$','') which threw an error.
Can you tell me the best way to clean my data using replace?
Extractor Pattern with Vars
I am trying to scrap a site which is very lengthy. I know already the small area I want to scrap. I am trying something like this in my pattern.
<tr id="Row~#ACCOUNT#~-~#ROWID#~-L"~@DATARECORD@~<br /></tr>
Because I already know the account number and the row ID.
I then have a sub extractor pattern which gets me exactly what I need from the pattern.. If I hard code the vars it works.
I read this node here that references this as invalid.
Error when importing
I'm trying to import a scraping session, and I'm getting the following error: unable to find FieldDescriptor for 'logging_level' in ClassDescriptor of scraping session.
It's a session I've imported and used previously, but I've never seen this error before. Any help you can give to resolve the problem would be appreciated.
Loop through array
Hi,
I need to call a scrape file for each day of the year so I've constructed a list of dates but I need a little help in constructing (and understanding the syntax) something to store these in (an array?) and writing a loop to use this information.
Something like
For each (date) in (array)
call scrapefile
rgds/alex
Redirect to secure site
Hi,
I'm trying to scrape http://www.thebmc.co.uk/Pages.aspx?page=51 which redirects to the secure site https://www.thebmc.co.uk/Pages.aspx?page=51. Screen Scraper does not follow the redirect, any ideas?
Alex
screen-scraper freezes
I'm trying to build a scraping session to capture a list of doctors from the following site: http://www.molinahealthcare.com/. I have no problem walking through the steps in a proxy session; all the pages are recorded. But when I select one in order to move it into a scraping session, I get a gray screen and the application freezes. I end up having to shut down the app, and I can't figure out why it's getting hung up. Any ideas?
Dynamic Parameter List
I'm trying to pull a list of doctors from the Medicare site (http://www.medicare.gov/Physician/Home.asp?bhcp=1), and I'm running into a problem with the parameter list for the scrapeable file.
Once the criteria are entered, the site compiles a list of IDs which it sends to the results page. When I add the results page to my scraping session, I see that there is a separate parameter for each ID. The number of IDs changes depending on the criteria entered.