Scrapy 调度算法研究
背景Scrapy 是基于 Python 的自动爬虫框架，用户通过编写 Spider 类来定义爬取的行为，即提取内容并产生若干个
"Any problem in Computer Science can be solved with another level of indirection."
—— David Wheeler
"Any problem in Computer Science can be solved with another level of indirection."
—— David Wheeler
背景Scrapy 是基于 Python 的自动爬虫框架，用户通过编写 Spider 类来定义爬取的行为，即提取内容并产生若干个