Skip to content

valots12/strava-scraping

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Near real-time scraping from Strava.com using Selenium and Kafka

Part of the Data Management project | UniMiB

The purpose of the project is to create a collection of Strava activities and make them available according to user's sport preference through Kafka (possible topics are: Running, Cycling, Water sports and Other).

Copy of Add a subheading_page-0001 (2)

Note: to avoid the Too Many Requests status code, there's random time sleep after the scraping of each activity. It avoids the error, but increases the time needed for each ID; to keep scraping in real-time it is possible to change the difference between IDs from 1 to 100, like in scraping_producer.py.

About

Near real-time scraping from Strava.com using Selenium and Kafka

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages