screen-scraper support for licensed users

Hi
I have managed to get the urls that I need from the search results and I have set up a product page DATARECORD template and sub-extractors.

However, the problem seems to be that after the first product, the Wix widget does not load on subsequent product pages. I assume there is a setting but I have been unable to debug.

I have uploaded the SSS file - hopefully it will explain better my issue?

Thanks for your help here

Jason

Hi
I am trying to scrape this site: https://www.littlermachinery.co.uk/stock/ and I understand that I have to use SetRequestEntity but I have no idea how this works (in laymans terms.)

I assume that I take the JSON at the bottom of the first page, use it to set the entity (although not sure how) and what happens after it is set?

Would I also need to work out the pagination from the {"page":1,"per_page":10,"total_rows":20,"total_pages":2} part?
Many thanks for your help here

Jason

Hi
Trying to scrape these pages, but just come up against a JS script that I can't get past?
http://www.butterfieldplant.com/stock.php

It is not calling another file with json data, it is an old site That uses this script for a navbar and rollover functions or something odd?

The page works fine when I take it from the proxy. I am sure there is something simple that I have missed?

I just need to get past it to access the html.

I assume it is a cookie thing - never really had to work with them before.

Thanks for your help in advance
Jason

Hi
Trying to scrape these pages, but just come up against a JS script that I can't get past?
http://www.butterfieldplant.com/stock.php

It is not calling another file with json data, it is an old site That uses this script for a navbar and rollover functions or something odd?

The page works fine when I take it from the proxy. I am sure there is something simple that I have missed?

I just need to get past it to access the html.

I assume it is a cookie thing - never really had to work with them before.

Thanks for your help in advance
Jason

I know it's a silly question but how would I play a midi or mp3 file when the session completes? I'm using the SERVER via web browser and not the app itself.

Just curious what the simplest way to trigger running a screen-scraper session named "Example1" on a desktop computer running Windows 10 would be?

The session writes the output file to a shared directory on Onedrive, so the challenge is remotely starting the screen scraping session. I'm open to installing 3rd party apps if needed, whatever is the easiest.

Hi

I am trying to scrape these products:
smvcommercials.co.uk/used-vehicles/page-1/default/-1/-1.aspx

This page returns fine and I can grab the product page URLS. The problem is that when SS attempts to read these pages they are blank. I have run a proxy transaction and there are some differences in the cookies and headers, but I am not sure what is important and how to set them (never encountered this issue before)

Thanks
Jason

Hi
I am trying to scrape www.euroauctions.com but when I inspect the site in Chrome I can find the URL that provides the data for the search results, but cannot seem to get it to run on SS.

I keep getting 500 server errors.
This is the URL and it has 3 parameters: filters, page & node ID (although there appears to be two records in the filter parameter (auctionId and masterCategoryId)

I am hoping there is a straightforward solution to this problem as it looks (relatively) straightforward thereafter?

Thanks for any help you can let me have in advance.

Jason

I think I've got it. Deleted question.

Hi

I had a scrape running well, but I want to make some changes to it.

The site has added an extra level to it and I need to automate.

There is now:
1) a list of auctions with a link to each. This is dynamic and auctions expire and new ones get added. This page links to the individual auction listing pages (2) below) https://www.cva-auctions.co.uk/auctions/

2) Standard Listing page - I have the scraping of the productid/url sorted. As it uses an API I have been using the code below for pagination. https://www.cva-auctions.co.uk/stock?saleid=47