screen-scraper public support
Passing a URL from a PHP script?
I am using a registered copy of screen-scraper professional 2.7.2.
I am invoking screen-scraper externally, from a PHP script, and I would like to pass a URL to screen scraper. (I am reading the URL from a file into the PHP script.)
Could you share the appropriate code to pass the URL to screen-scraper?
Appreciatively,
Peter
Can I scrape from Excel
Hi,
I need to migrate a large amount of data from a standard Excel spreadsheet to existing columns within a databased CRM application.
Is it simple to set up Screen Scraper to do this task?
Thanks in advance
Graham
Associating Log Files with scrapes
Do the log file name mean something? Are they a version of a timestamp? I'm trying to associate a log file with a particular scrape that happened. I'll be passing some sort of identifier to the scrapes from now on, so I can search on that parameter in the logs, but for past logs and general knowledge -- what do the log file names (after the scrape name) mean?
Simple addition
Got a quick one for you all. I am trying to set up a counter in a session variable so that I know when the current page is less than the total pages. ("on page 3 of 16"). I can't get the script to add these as int.
if ( Integer.parseInt(session.getVariable("PAGE")) < Integer.parseInt(session.getVariable("TOTALPAGES")) ){
int thenextpage = Integer.parseInt(session.getVariable("PAGE")) + 1;
session.setVariable( "PAGE", thenextpage);
session.scrapeFile("search results");
}
thanks
problem writing data to txt file
Many thanks in advance for help on this. I have been struggling with this problem for a while. The write script below worked on the first few runs but is now creating only a blank text file. I also see the values in the log file that should go into the txt file, but they don't appear in the latter.
The script is below. In particular I'm getting a error message each time I call the write script:
"Writing data to a file.
An error occurred while writing the data to a file: null"
The script I'm using is:
FileWriter out = null;
Trouble downloading images
I LOVE this product and have been making great strides with it so far in my evaluation of the professional edition. I am having difficulties, however, downloading images.
SKU (6-digit number) and IMG_SOURCE (full http://.... URL of image)are tokens extracted from a DATARECORD. After each pattern application of the DATARECORD I am invoking a script which calls
session.downloadFile( session.getVariable( "IMG_SOURCE" ), "D:\Images\" + session.getVariable( "SKU" ) = ".jpg");
Extractor tokens - next page
Hi Kalyan
In the session you sent me you have included an extractor ~@Page_Code@~
Last pattern created twice
Hi :) ,
I have a very basic question. I am trying out this product by building a little spider for our company site. Goal of the test is to store the title and meta tag off several pages in a text file. All works fine except the latest webpage is stored twice in the text file. I have no clue why :? . Some advice would be helpful :wink: .
Your sincerely,
Nebu 8)
--LOG FILE ---
How to invoke screen-scraper from Python?
does anyone know how to invoke screen-scraper from Python like java or php?
Sub - extractor patterns
I need a little help - and I'm a real newbie! And coding and scripting is almost a foreign language . . . . so please first principles!
After I've created an extractor pattern from a section of code taken from a scraper session using the Last Response tab - I inserted the token ~@datarecord@~ and generated an Extracted Data list with all the extracted code I want to scrape with a number of sub-extractor patterns (or do I use just one sub-extractor pattern - insert one line of code and populate it with a number of tokens??)