Skip to content

liaoque/python-scrapy-article

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

使用到的插件
fake-useragent  #随机useragent
scrapy_proxies  #ip代理 免费
scrapy-crawlera  #ip代理 收费

pip install mysqlclient
pip install scrapy_proxies
pip install fake-useragent


pip install django

sudo wget http://prdownloads.sourceforge.net/ta-lib/ta-lib-0.4.0-src.tar.gz
tar -xzf ta-lib-0.4.0-src.tar.gz (or sudo tar -xzf ta-lib-0.4.0-src.tar.gz)
cd ta-lib/
sudo ./configure (if gcc is missing, install it by doing “apt-get install build-essential”)
sudo make
sudo make install
pip install ta-lib


brew install mysql-client
echo 'export PATH="/usr/local/opt/mysql-client/bin:$PATH"' >> ~/.bash_profile
export PATH="/usr/local/opt/mysql-client/bin:$PATH"
pip install mysqlclient


热门金属列表
http://ai.10jqka.com.cn/commodity/stocklinkage/info/getdetail

热门商品咨询
http://ai.10jqka.com.cn/commodity/stocklinkage/info/getconsultation?indexid=S002981544

历史价格
http://ai.10jqka.com.cn/commodity/stocklinkage/info/commodityhistory?indexid=S004242721&daynum=60

关联股票
http://ai.10jqka.com.cn/commodity/stocklinkage/info/stocklink?commodityid=301

About

python-scrapy爬各种段子

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published