Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 18,423
Awesome lists tracked: 132
Current results: 9

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

9 repos shown

Topic: webscraping

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

firecrawl/firecrawl

The context API to search, scrape, and interact with the web at scale. 🔥

AI dev

Stack

TypeScript Astro Express Next.js pytest Bundler Cargo Composer

GitHub topics

#ai #ai-agents #ai-crawler #ai-scraping #ai-search #crawler

Updated: 2026-09-16
Lists: 2 list mentions
First commit: 2024-04-15
History: 146 history points
License: AGPL-3.0
Issues: 626 open

180,946

stars

Forks: 9,811
Commits: 6,303 commits
Star growth, last 7 days: +2,482 +1.4%
Commit velocity, last 7 days: +21 +0.3%

Website GitHub

D4Vinci/Scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

Stack

Python pytest Scrapy PEP 517 pip

GitHub topics

#ai #ai-scraping #automation #crawler #crawling #crawling-python

Updated: 2026-08-10
Lists: 1 list mention
First commit: 2024-10-13
History: 60 history points
License: BSD-3-Clause
Issues: 0 open

73,436

stars

Forks: 7,333
Commits: 1,583 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

huginn/huginn

Create agents that monitor and act on your behalf. Your agents are standing by!

Stack

Ruby Ruby on Rails Svelte Bundler npm

GitHub topics

#agent #automation #feed #feedgenerator #huginn #monitoring

Updated: 2026-08-15
Lists: 3 list mentions
First commit: 2013-03-10
History: 8 history points
License: MIT
Issues: 696 open

49,820

stars

Forks: 4,291
Commits: 4,112 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

ScrapeGraphAI/Scrapegraph-ai

Python scraper based on AI

AI dev

Stack

Python LangChain uv

GitHub topics

#ai-crawler #ai-scraping #ai-search #crawler #data-extraction #firecrawl-alternative

Updated: 2026-09-07
Lists: 1 list mention
First commit: 2024-01-27
History: 42 history points
License: MIT
Issues: 16 open

30,982

stars

Forks: 3,119
Commits: 2,955 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

assafelovic/gpt-researcher

An autonomous agent that conducts deep research on any data using any LLM providers

AI dev

Stack

Python Express FastAPI LangChain Next.js npm pip Poetry

GitHub topics

#agent #ai #automation #deepresearch #llms #mcp

Updated: 2026-08-27
Lists: 6 list mentions
First commit: 2023-05-12
History: 148 history points
License: Apache-2.0
Issues: 96 open

29,473

stars

Forks: 4,009
Commits: 3,109 commits
Star growth, last 7 days: +91 +0.3%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

jaypyles/Scraperr

Self-hosted webscraper.

Archived

Stack

TypeScript FastAPI Next.js pytest React npm PDM Yarn

GitHub topics

#docker #helm #kubernetes #opensource #playwright #python

Updated: 2025-10-12
Lists: 0 list mentions
First commit: 2024-05-18
History: 60 history points
License: MIT
Issues: 4 open

4,913

stars

Forks: 245
Commits: 243 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

Stack

Python LangChain Streamlit pip

GitHub topics

#ai-scraping #gemini-api #llm #llm-scraper #openai #scraper

Updated: 2026-08-20
Lists: 1 list mention
First commit: 2024-08-17
History: 1 history point
License: MIT
Issues: 3 open

3,252

stars

Forks: 356
Commits: 107 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

jamesturk/scrapeghost

👻 Experimental library for scraping websites using OpenAI's GPT API.

Stack

Python pytest Poetry

GitHub topics

#gpt #openai-api #webscraping

Updated: 2026-01-14
Lists: 1 list mention
First commit: 2023-03-18
History: 40 history points
License: NOASSERTION
Issues: Disabled

1,443

stars

Forks: 86
Commits: 204 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

openzim/zimit

Make a ZIM file from any Web site and surf offline!

Stack

Python pytest PEP 517

GitHub topics

#docker #scraper #webscraping #zim

Updated: 2026-07-31
Lists: 1 list mention
First commit: 2016-01-09
History: 6 history points
License: GPL-3.0
Issues: 82 open

827

stars

Forks: 49
Commits: 518 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing