Skip to content

This is a very quick scrape of Aldi's online product list using Python and Scrapy

Notifications You must be signed in to change notification settings

clicktechnology/aldi-scrape

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Aldi-scrape

This is a very quick scrape of Aldi's online product list using Python and Scrapy

How to

First, clone the repo and install the requirements.

cd aldi-scrape
python -m pip install -r requirements.txt
source venv/bin/activate

Now run the scrape..

scrapy crawl basic

The data is in the aldi/spiders subdirectory as output_data.csv, so cd in there.

cd aldi/spiders

The scraped data is in output_data.csv, ready to use.

About

This is a very quick scrape of Aldi's online product list using Python and Scrapy

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages