Home » Forums » screen-scraper » screen-scraper public support

UnFair

I've been trying to scrape odds from www.betfair.co.uk
however it seems that they hide the information cleverly in javascript do you guys know of any ways around this?

‹ A Whole Heap of Issues The value "null" was passed to the "scrapeFil ›
serial-scrapist on 05/25/2006 at 2:07 pm

UnFair

Right , I'll keep you posted as to how i progess.

It seems that alot of the information is added dynamically, using DOM manipulation similar to an AJAX paradigm.

I'll keep hacking!

Cheers!

S-S

 serial-scrapist on 05/30/2006 at 3:08 am

UnFair

Hi,

I have no doubt that this could be done, but I agree that it looks like a bit of a maze. I proxied it a bit, and it looks pretty complicated. If I were handling this one I'd probably traverse to the exact page I wanted to scrape, then see if I could request just that page. Failing that, I'd work backward to see what the site truly needs in terms of cookies being set and such.

This one definitely looks interesting. Good luck!

Kind regards,

Todd Wilson

 todd on 05/26/2006 at 10:27 am