screen-scraper support for licensed users

Questions and answers regarding the use of screen-scraper. Only licensed Professional and Enterprise Edition users can post; anyone can read. Licensed users please contact support with your registered email address for access. This forum is monitored closely by screen-scraper staff. Posts are generally responded to in one business day.

How to select the check box and Ok button

Hello Jason,

I am trying to select the check box " I agree with the brand terms and conditions." and Proceed button on this page http://www.magnoliahomefurniture.com/Terms.aspx
I gave some Parameter like "ID" , "value" but do't know how to get on-click javascript value ?
Please suggest me some solution.

Thanks

Not able to get records from next page

I am trying to capture next page records for Tamworth council
URL - http://planning.tamworth.gov.uk/northgate/planningexplorer/generalsearch.aspx

I have passed all the parameters and patterns , getting the records from result page but when I click Display response in browser for Next page getting the error as below -

Planning
Planning Application Search Results
The Results have expired. Please resubmit the search.

parameters for next page -

PT Planning Applications On-Line 1 GET
PS ~#PS#~ 2 GET
XMLLoc ~#XMLLOC#~ 3 GET
FT Planning Application Search Results 4 GET

Getting status code 500

Hi Jason,

I am trying to scrape the URL http://furnitureclassics.com/product/category/151843 but when add this URL in scrape file then it shows an error message :- "Warning! Received a status code of: 500" .

Thanks
Shyam

Infinite Redirect Loop

Specs: Screen-Scraper v.7.0 Enterprise Edition, Windows 7 64 bit

Screen-scraper is getting stuck in an infinite loop when attempting to scrape a blank/non functioning URL. Is there any way to stop this redirect loop and move on to the next datarecord?

A dataSet of URL's is extracted from a main page, and then the next page is scraped after each pattern match of the DATARECORD.
When screen-scraper encounters a URL with non functioning webpage, it gets stuck looping in redirects. This same loop appears to occur when attempting to view the website link within a browser as well.

Input/output error from HTTPS url: "unable to find valid certification path"

In case this helps someone else, I was receiving an error message when scraping an HTTPS site:

An input/output error occurred....sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target.

In the session's Advanced tab, changing the HTTP client from Apache to Ning solved the problem.

Test Pattern shows only 20 Sequences in a list

Hi Jason,

I am trying to scrap the info of all the collection values but when I run the scraping of http://www.fairmontdesigns.com/home/products/living-room/living-collections/ URL, it shows only 20 sequences in a list in the test pattern. but there are 62 values are there.

why it is showing less value in the Test Pattern.

Thanks
Shyam

How to do Empty Cart

Hello ,

I am scraping the data of a shopping cart site and I am calling SKU of each URL one by one but each time when I click to "ADD to Cart" button , the OLD SKU is also existing in the CART using screen scraper . so I want to do "EMPTY CART" after scraping the data of each SKU.

Here are some of the URLS which are in my CSV file which I am calling while doing scraping.

http://customstudiow.microdinc.com/iteminformation.aspx?sku=1000-01FF&catalog=2000
http://customstudiow.microdinc.com/iteminformation.aspx?sku=1000-01L&catalog=2000

Not able to capture Oadby council URl

Hi
Not able to caputure Oadby council URL -

https://pa.oadby-wigston.gov.uk/online-applications/simpleSearchResults.do?action=firstPage

getting the error as -

This site can’t provide a secure connection
pa.oadby-wigston.gov.uk sent an invalid response.
Try:
Reloading the page
Learn more about this problem.
ERR_SSL_PROTOCOL_ERROR

could you please help us for same

The message was Connection reset

Hello, I receive an error while trying to open a single page. See below and let me know if you have any questions.

Thanks, Jeremy

--------------------------------------------------
--------------------------------------------------
--------------------------------------------------

Starting scraper.
Running scraping session: test
Processing scripts before scraping session begins.
Processing script: "Test - Init"
=========================================================
=================== Log Variables with Message ===============
screen-scraper Instance Information

Bridgend council

Hi
I am not able to write the data from next page of Bridgend council
URL is - http://planning.bridgend.gov.uk/

Total no of pages pattern is as below -

1
2
3
4

Regards