dev.club — where best developers and top companies connect.

dev.club — where best developers and top companies connect.Invite only

Request invite

New Python Web Automation Libraries 2026

GitHub Libraries → Python → Web Automation Libraries
▼

unclecode/crawl4ai 41K +1423

added 1 year ago

Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper.

microsoft/playwright-python 15K +11

added 1 year ago

Python version of the Playwright testing and automation library.

seleniumbase/seleniumbase 13K +23

added 1 year ago

Python APIs for web automation, testing, and bypassing bot-detection.

mherrmann/helium 8K +6

added 1 year ago

Lighter web automation with Python

scrapy/scrapy 64K +131

added 1 year ago

Scrapy, a fast high-level web crawling & scraping framework for Python.

Join libs.tech

...and unlock some superpowers

GitHub

We won't share your data with anyone else.