1.初始化数据库
python manage.py rebuild_db
2.爬取
python manage.py crawl [num]
num:(可选)表示要爬取的页数，默认为100
3.环境
xpath、lxml、SQLAlchemy、postgresql
注：爬取代码所使用的自动获取代理脚本地址：ProxyPool
-
Notifications
You must be signed in to change notification settings - Fork 0
Azlx/crawl_book
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
爬取豆瓣书单
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published