oreader1996 / lufy-scrapy-redis Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Improve the function of scrapy to make it easier to debug

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 9 Commits
iscrapy		iscrapy
.gitignore		.gitignore
README.md		README.md
docker-compose.yml		docker-compose.yml
main.py		main.py
requirements.txt		requirements.txt
scrapy.cfg		scrapy.cfg

Repository files navigation

lufy-scrapy

基于scrapy-redis的可用的分布式scrapy

相关功能

新增main.py文件，方便调试
新增随机生成UserAgent下载中间件

About

Improve the function of scrapy to make it easier to debug

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 100.0%