Top Python Web Scrapers 2025

GitHub Libraries Python Web Scrapers

scrapy/scrapy 54K +160

Added by sizovs added 1 week ago

Scrapy, a fast high-level web crawling & scraping framework for Python.

microsoft/playwright-python 12K

Added by sizovs added 1 day ago

Python version of the Playwright testing and automation library.

seleniumbase/seleniumbase 9K

Added by sizovs added 1 day ago

Python APIs for web automation, testing, and bypassing bot-detection.

mherrmann/helium 7K

Added by sizovs added 1 day ago

Lighter web automation with Python

Join libs.tech

...and unlock some superpowers

GitHub

We won't share your data with anyone else.