A Comprehensive RP Card Scrape

[sinbad]

Horse racing web pages are often very dynamic and contain data that changes very frequently. Many of these websites use client-side dynamic scripting such as JavaScript, and AJAX (Asynchronous JavaScript and XML). The RP website is no exception and uses a great deal of this type of scripting. What does this mean? In a nutshell, it means the RP website is a pain to scrape!! However, it can certainly be done. The multi-sheet xls file attached is an example of a scrape of todays cards. The file is intended for importing into a database. It contains raw data and is not really suitable for viewing as is. More later on how I do this....coming soon.

 

[Ferdy]

Will be interested to see how this works out.

 

[SteveT]

Cant wait

 

[chaz95]

Hello Sinbad, any news regarding how you did this? Python scrape?

 

[Behemoth18]

Following this with interest.

 

[Patem2]

Hi sinbad I’m trying to learn Python and have been playing around with Scrapy to give me something exactly like this on a daily basis, in all honesty I’m not getting very far as I’m a total novice but I’m trying.

I’d love to see how you’ve got on with this to be fair as I’m sure a number of others would too