screen-scraper public support

Questions and answers regarding the use of screen-scraper. Anyone can post. Monitored occasionally by screen-scraper staff.

Regarding Downnload images from the site

Hi
I want to download images from flipkart.com to my folder and i made a scraper script.
Also i does not want to download a single image , i want to download all the images which is running with paging and for this i made a script which is running fine to get the record from the site but in the case of downloading image it will create problem.even no any single image is being download.

I have made download script as follows

currentURL = "http://"+session.getVariable("IMAGE_FIRST")+".fkcdn.com/img/"+session.getVariable("IAMGE_SECOND")+".jpg";

session.log(currentURL);

Regarding datarecord pattern and download script

Sir
I am using screen scraper for taking the data from flipkart.com.I have a problem when i take the images from this site using the script

currentPage = session.getVariable("IMAGE_URL");
 image_name =  session.getVariable("IMAGE_NUMBER");
  session.downloadFile( currentPage, "C:/Users/nutsuser/Desktop/images/"+ image_name +".jpg", 5, true )

and the html of this download is as follows
<meta name="og_image" property="og:image" content="http://img4.fkcdn.com/img/942/9781416548942.jpg" />

Download images through screen scraper in folder

Hi
I have made a pattern to fetch the data from flipkart.com in which i also fetch the url of the respective image.But i want to download these image from flipkart.com to my folder as the script run.How can it possible through screen scraper.
Also when i fetch the data from flipkart.com which is near about 10 lacs then after running after some times in the log there is a msg shown "execution stop because full of 50 stack" and execution of scraping stops.Is this problem occurs because of screen scraper trial version or something else?
Please specify it.
Waiting for your kind response.

Regarding extracting data from screen scraper

Sir
I have created a script using screen scraper.I want the author name, Book title,details ,price from the website www.flipkart.com .

I have created a script using your script file given in tutorial 2(http://community.screen-scraper.com/Tutorial_2_Overview) which is used for scraping the data from ecommerce site.
I have created all the script but there is the problem in the details page scrap in which there is nothing in the last responce so that i can not make the extractor pattern for it.

Adding to ecommerce tutorial

Hey guys, I'm updating the ecommerce tutorial to include 2 text files. One for letters a, b, and c, and the other that contains the 1000 most common last names. I'm trying to search the first name and last name fields of a search form. However, what is happening is it takes the first last name (aaron for example) and loops through the file a, b, and c, correctly.

Problem with post parameters

Hi,

Sorry I have posted quite a few questions in the last week or so. I am having a problem with a site I am trying to scrape. There are two parameters.

Key Value
callCount 1 page=/direct/product/car.htm?_flowId=motor-flow
_flowExecutionKey Long Parameter(click to edit)

I don't have to change the callCount parameter
But I do need to alter the _flowExecutionKey
This looks like this when I click it

e2s1
httpSessionId=0000x05QtZyaf9MvkzOtss1Wpti:10qr9lql8
scriptSessionId=7D5639DB092D5BEE65178280C26DC9B8352
c0-scriptName=VehicleSearchDelegate

How can I save a global Variable

I have one page with:

activity: ~@ACTIVITY@~ (occour one time)

Companie = ~@NAME@~
address = ~@ADDRESS@~
phone = ~@PHONE@~

Companie = ~@NAME@~
address = ~@ADDRESS@~
phone = ~@PHONE@~

Companie = ~@NAME@~
address = ~@ADDRESS@~
phone = ~@PHONE@~

When I scrap the page the Activity appear only one time, than when I save in database activity save only in the first record.

How can I save ~@ACTIVITY@~ in a Global variable ?

Dynamic extractor patterns, or session/other variables' values inserted into extractor patterns...

Goal is to deploy very specific extractor patterns that select, for example, text on either side of a known string such as "Quercus rubra". This is the latin name for the common name of Red Oak, but there are many other common names used. The goal would be to have a pattern such as ~#LATINNAME#~ that reads in the session variable "Quercus rubra" that has been set from .txt file.

The .txt file would include hundreds if not thousands of other latin names, i.e.:
Acer negundo
Acer rubrum
Acer saccharinum
Acer saccharum
Amelanchier canadensis
Betula lutea
Betula nigra

Tutorial Output Disappeared

Everything in the tutorial seemed fine.

But, when I got to the point where my scrape was supposed to be outputted to a text file in my installation directory ... and there was no new file there.

Yet, this log doesn't seem to indicate an error:

Starting scraper.
Running scraping session: Hello World
Processing scripts before scraping session begins.
Scraping file: "Form Submission"
Form Submission: Preliminary URL: http://www.screen-scraper.com/tutorial/basic_form.php
Form Submission: Using strict mode.

Pass Dataset to scraping session from .net program

Hi,

I am trying to pass a Screenscraper dataset as a session variable from a .net c# program. Is this possible or will I have to use just text session variables? It would be easier to be able to pass a dataset into the session as a variable and then delete datarecords from the dataset. I don't see a method for adding a datarecord from the screenscraper.dataset in c# .Net.
And if you can then when you add a datarecord to a dataset is the datarecord stored in the last position of the dataset or the first?

Thanks in advance,
Seamus