410
0
Scrapy多个爬虫批量运行
from scrapy.crawler import CrawlerProcess
from scrapy.utils.project import get_project_settings
settings = get_project_settings()
crawler = CrawlerProcess(settings)
crawler.crawl('爬虫1')
crawler.c...
- 阅读全文 -