glossarytech.com

Scrapy

Python framework for large scale web scraping and web crawling.

First released26 June 2008
Latest stable version2.5.1

Interesting facts

Scrapy project architecture is built around "spiders", which are self-contained crawlers that are given a set of instructions

Sign up for updates
straight to your inbox

Subscribe