screen-scraper support for licensed users

Questions and answers regarding the use of screen-scraper. Only licensed Professional and Enterprise Edition users can post; anyone can read. Licensed users please contact support with your registered email address for access. This forum is monitored closely by screen-scraper staff. Posts are generally responded to in one business day.

How to enable JavaScript?

Hello,

Have you ever received from the server error like "Please enable JavaScript to view the page content"? I set all cookies and html headers and it still doesn`t work.
Please let me know how to enable javaScript in this case.

https://ccmspa.pinellascounty.org/PublicAccess/default.aspx

I checked on windows 7 and ubuntu 14.04

Thanks in advanced,
Mariusz

Sending POST request on Investing.com returns HTTP 200 OK instead of what was requested

Using Windows 7, SS Pro 7.0.
Trying to scrape historical bond data from Investing.com with beginning and ending dates. Changing the date range requires sending an HTTP POST request with the new dates. I am having trouble sending the correct info for the POST request. I have used the "compare last request" feature. The URL and the POST data (parameters) are the same, but the Cookies and Headers are always different. Is this normal?
Investing.com server sends '200 OK' message and redirects to Investing.com's home page.
What is missing?

This is the raw request:

Problem extracting values from html

I'm trying to use the following pattern:

<div class="address" data-reactid="~@Junk@~"><a href="~@url@~" title="~@title@~" data-reactid="~@Junk@~">~@Street@~</a>

The pattern is only grabbing data for ~@Street@~, the rest of them return null. I've never run into this before.

This is a sample of the source:
 

Not getting any result for Barnsley council

I am not getting any records for Barnsley council
when I run the same council locally, I am able to get the records

local screen scrapper version - 7.0
server screen scrapper version - 6.0.65a

council URL - https://wwwapplications.barnsley.gov.uk/PlanningExplorerMVC/Home/AdvanceSearch

I am getting the error as -

Starting scraper.
Running scraping session: Barnsley_Scraping_Session
Processing scripts before scraping session begins.
Scraping file: "Barnsley - Landing Page"
Barnsley - Landing Page: Processing scripts before a file is scraped.

Not able to get the images from image library

Hello friends,

I am trying to download all the images from the image library. but when I reached to all product page then its each product URL is in java script form.
Please help me how I can download all the images near about 3885 images.

Here are the details :-

https://kincaid.widencollective.com/

Thanks
Shyam

VPN - changing ip

Hi,

I am trying to use HMA vpn for changing ip address. When I run session using vpn everythink is okey but after changing ip screen scraper use my ip - not from VPN. Is it possible to use ip only from vpn automatically?

Thank you in advance
Mariusz

Trailing section

getting this error, what does it mean?
While attempting to import a script the following error occurred: Content is not allowed in trailing section.
org.exolab.castor.xml.MarshalException: Content is not allowed in trailing section.{File: [not available]; line: 7; column: 1}

Failure to access Google Geocoding API

Since switching to version 6.0.69a in preparation to moving to V7, I cannot access Google's Geocoding API. This is what happens:

GEO_test: Requesting URL: https://maps.googleapis.com/maps/api/geocode/xml?address=1090%20Wien%20Tendlergasse%203&key=myGoogleKey

GEO_test: An input/output error occurred while connecting to 'https://maps.googleapis.com/maps/api/geocode/xml'. The message was Host name 'maps.googleapis.com' does not match the certificate subject provided by the peer (CN=*.googleapis.com, O=Google Inc, L=Mountain View, ST=California, C=US).

Data is not getting in Last Response

Hello Guys,

I am trying to scrape the Data from a site but after traversing the site pages from Home Page to Details Page, I am not getting detail value in Last Response Tab.
So I am not able to create Extract Pattern.
Here I have mention the traversing link from Home Page to Details Page.

1. https://www.stickley.com/
2. https://www.stickley.com/OurProducts_Results.cfm?Collection=Mission&view=all
3. https://www.stickley.com/OurProducts_Details.cfm?id=1377&Collection=Mission&view=all&view=complex&finish=

I am traversing from 1. to 3

Thanks
Shyam

Not able to get the data under "More Results" link

Hello friend,

In this link http://www.feiss.com/Vanity-Lights.htm there are total 375 SKUs but I am able to get the SKUs under the "More Result" link.
Please help me out , how I can get the value after under the More Result link.

Thanks
Shyam