Not able to capture South Hams and West Devon council
Hi
I am not able to capture the South Hams and West Devon council website
We captured the page but when we click on Display Response in Browser, it is not showing us the result. It is just showing as searching and it shows as it is loading
website URL for South Hams is - http://southhams.gov.uk/planningsearch
website URL for West Devon is - http://southhams.gov.uk/planningsearch
We are using screen scrapper version - 6.0.65a
Let us know if you need any more information for this
Thank you
I could use lots more
I could use lots more information. Could you add log.logScreenScraperInformation() to a script at the beginning and post the log for me? Mine:
Running scraping session: Test
Processing scripts before scraping session begins.
Processing script: "General - log init"
Debugging mode is enabled.
=========================================================
=================== Log Variables with Message ===============
screen-scraper Instance Information
=================== Static Values ================
Java Vendor: Oracle Corporation
Java Version: 1.8.0_45
OS Architecture: amd64
OS Name: Windows 7
OS Version: 6.1
Scrape HTTP Client: ApacheScrapingHttpClient
SS Connection Timeout: 180 seconds
SS Edition: Enterprise
SS Extractor Timeout: 30000 milliseconds
SS Max Concurrent Scraping Sessions: 25
SS Maximum Memory: 512 MB
SS Memory Use: 6%
SS Run Mode: Workbench
SS Version: 6.0.67a
======== Message logged at: 12/14/2015 09:38:00.113 MST ========
=========================================================
Scraping file: "New Scrapeable File"
New Scrapeable File: Requesting URL: http://southhams.gov.uk/planningsearch
Processing scripts after scraping session has ended.
Processing scripts always to be run at the end.
Scraping session "Test" finished.
Same Problem
I'm having the same problem while trying to scrape http://www.fitnessfactorygym.com/. Here's my log output.
The response shows up in my last response tab (truncated).
Trying to view the complete response via the Display Last Response button results in a blank white screen.
Starting scraper.
Running scraping session: Fitness Factory
Processing script: "Log Screen Scraper"
=========================================================
=================== Log Variables with Message ===============
screen-scraper Instance Information
=================== Static Values ================
Java Vendor: Oracle Corporation
Java Version: 1.7.0_51
OS Architecture: amd64
OS Name: Windows 7
OS Version: 6.1
Scrape HTTP Client: ApacheScrapingHttpClient
SS Connection Timeout: 300 seconds
SS Edition: Enterprise
SS Extractor Timeout: 300000 milliseconds
SS Max Concurrent Scraping Sessions: 5
SS Maximum Memory: 1024 MB
SS Memory Use: 11%
SS Run Mode: Workbench
SS Version: 6.0.67a
======== Message logged at: 01/19/2016 10:05:56.162 PST ========
=========================================================
Scraping file: "Main Page"
Main Page: Requesting URL: http://www.fitnessfactorygym.com/
Scraping session "Fitness Factory" finished.
When I request that URL, the
When I request that URL, the response isn't very long at all.
Running scraping session: Test
Processing scripts before scraping session begins.
Processing script: "General - log init"
Debugging mode is enabled.
=========================================================
=================== Log Variables with Message ===============
screen-scraper Instance Information
=================== Static Values ================
Java Vendor: Oracle Corporation
Java Version: 1.8.0_45
OS Architecture: amd64
OS Name: Windows 7
OS Version: 6.1
Scrape HTTP Client: AsyncNingScrapingHttpClient
SS Connection Timeout: 180 seconds
SS Edition: Enterprise
SS Extractor Timeout: 30000 milliseconds
SS Max Concurrent Scraping Sessions: 25
SS Maximum Memory: 512 MB
SS Memory Use: 7%
SS Run Mode: Workbench
SS Version: 6.0.67a
======== Message logged at: 01/20/2016 10:20:08.351 MST ========
=========================================================
Processing script: "Test - set user agent"
Scraping file: "New Scrapeable File"
New Scrapeable File: Requesting URL: http://www.fitnessfactorygym.com/
Processing scripts after scraping session has ended.
Processing scripts always to be run at the end.
Scraping session "Test" finished.