screen-scraper public support

Hi, this is slightly related to my previous post. How can I save the search term along with the data I am scraping?

In the example below, I am trying to save the session variable SEARCH along with the data I am extracting from the web page. However, it just returns null value.

Thanks,

Bhavesh

Hi,

I want to extend the features Tutorial 7 and wanted to know if it was possible.

The tutorial shows one search term per line.

Is there a way to add a variable to it that will be used in the outputting of a file? Let me explain.

I want to scrape a website with multiple search terms, but I also want to record the context of the search terms. For example:

the search file would be set up something like this:

IMCL, Imclone
Hsp90, Imclone
MEK, Array
MEK, AstraZeneca
AZD, AstraZeneca

on a page i have

[quote]---PAGE CONTENT---

---PAGE CONTENT---

---PAGE CONTENT---

---PAGE CONTENT---[/quote]

Hi,

I am trying to run a scraping session and I have come quite far. In fact, I feel that I am nearly done setting it up.

However, I am having a very strange problem. A search results yields 4 pages.

Screen scraper properly brings up Pages 1, 2, and 4, but page 3 gets a different page.

When I copy and paste the raw URLs into any of several web browsers on different machines, I get the expect result. But with SS, it consistently does not get page 3 correct.

Here are the links:

page 1:

I have two conditions to decide if continue going to the next page.
One is
48

The other one is
class="pagerNotCurrent">Next