由于底层scrapyd-deploy的模块‘scrapy.utils.http’已经弃用,建议更新为w3lib.http
替代
from scrapy.utils.project import inside_project
#from scrapy.utils.http import basic_auth_header
from w3lib.http import basic_auth_header
from scrapy.utils.python import retry_on_eintr
from scrapy.utils.conf import get_config, closest_scrapy_cfg
scrapyd-deploy -l
如果没有项目
1.启动scrapyd
2.配置
[settings]
default = weatherspider.settings
[deploy]
url = http://localhost:6800/
project = weatherspider
网友评论