← Back
scrapy

scrapy/scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

View on GitHub ↗https://scrapy.org ↗
crawlercrawlingframeworkhacktoberfestpythonscrapingweb-scrapingweb-scraping-python
Stars
64.5K
Forks
12K
Watchers
64.5K
Open issues
316
Contributors
747
Language
Python
License
BSD 3-Clause "New" or "Revised" License
Default branch
master
Created Feb 22, 2010Updated Oct 1, 2026

Star growth

Today—
This week—
This month—

Star history will appear here once this repo has been tracked for a couple of days.

README

Scrapy

PyPI Version Supported Python Versions Tests Coverage report Conda Version Ask DeepWiki

Scrapy is a web scraping framework to extract structured data from websites. It is cross-platform, and requires Python 3.10+. It is maintained by Zyte (formerly Scrapinghub) and many other contributors.

Install with:

pip install scrapy

And follow the documentation to learn how to use it.

If you wish to contribute, see Contributing.