Skip to content

qCrawl Documentation

qCrawl is a fast async web crawling & scraping framework for python, used to crawl websites and extract structured data from their pages. It can be applied to various tasks, such as data mining, monitoring, and automated testing.

  • Start in 10 minutes

    Install qcrawl for your favorite OS and get up and running in minutes.

    Getting started

  • Blazing fast

    Async-first design, efficient downloader, high-performance backends, and fine-grained concurrency controls.

    Architecture

  • Helpful community

    Join our Discord community and get answers to your web scraping questions.

    Let us dig

  • Get qCrawl

    QCrawl is licensed under MIT and available on GitHub, PyPI, Conda Forge and as OS packages.

    Installation