Python framework for large scale web scraping and web crawling.

Learn more

First released 26 June 2008
Latest stable version 2.5.1

Interesting facts

Scrapy project architecture is built around "spiders", which are self-contained crawlers that are given a set of instructions


Development by

Sign up for updates
straight to your inbox