Sign in
← Back to search
github Active

Repository profile

D4Vinci/Scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

Python BSD-3-Clause main Stack scanned README.md
Sign in to like D4Vinci/Scrapling
Open website Open GitHub
Stars
69,810
Forks
6,915
Watchers
256
Issues
4
Commits
1,532
Awesome lists
1

Repository updates

Follow repository updates

Get generated D4Vinci/Scrapling development summaries by email, or follow the weekly and monthly RSS feeds.

Weekly RSS Monthly RSS

Sign in to subscribe by email. RSS feeds are public.

Sign in to subscribe

Activity and growth

Tracked growth, recent movement, and commit velocity from stored repository snapshots.

Latest capture 2026-07-17 04:31

Star growth, last 7 days
+750 +1.1%
Commit velocity, last 7 days
+17 +1.1%
Stars since baseline
+11395
Snapshot coverage
42

Tracked growth

42 captures since 2026-06-02

Stars from baseline +11395

Time horizon

All tracked data

Stars history

Total stars

Commits history

Default branch commits

Detected stack

Frameworks, package managers, ecosystems, and dependency manifests found during catalog scans.

Scanned 2026-07-17 04:31

Stack signals
0
Package managers
2
Manifest files
4
Dependencies
0

Frameworks and tools

  • No framework dependencies detected.
PEP 517 pip python

Dependency files

4 manifests
  • pyproject.toml python ecosystem, 0 dependencies
  • setup.cfg python ecosystem, 0 dependencies
  • docs/requirements.txt python ecosystem, 0 dependencies
  • tests/requirements.txt python ecosystem, 0 dependencies

Classification

Searchable topics, generated tags, and stack labels that explain where this repository fits.

Topics
20
Tags
0
Stacks
0

Topics

#ai #ai-scraping #automation #crawler #crawling #crawling-python #data #data-extraction #mcp #mcp-server #playwright #python #scraping #selectors #stealth #web-scraper #web-scraping #web-scraping-python #webscraping #xpath

Generated tags

No generated tags yet.

Stack labels

No stack labels yet.

AI development signals

Agent instructions and tool configuration paths found in the repository tree.

0 paths
No AI development config files detected.

Similar repositories

Nearest indexed repositories by embedding similarity.

Pyx-Corp/spectrawl

The unified web layer for AI agents. Search (8 engines), stealth browse, auth, and act on 24 platforms. One npm install, self-hosted.

26 stars
JavaScript 1 awesome list

bighippoman/intercept-mcp

MCP server with multi-tier fallback chain for fetching web content as clean markdown

8 stars
TypeScript 1 awesome list

unclecode/crawl4ai

🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN

72,998 stars
Python 2 awesome lists

AIMLPM/markcrawl

Fast Python web crawler for RAG and AI ingestion. Extracts clean Markdown from any site for LLMs and vector stores.

2 stars
Python 1 awesome list

goodreasonai/ScrapeServ

A self-hosted API that takes a URL and returns a file with browser screenshots.

1,183 stars
Python 0 awesome lists

apify/crawlee-python

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

9,330 stars
Python 1 awesome list

Metadata

Language
Python
License
BSD-3-Clause
Default branch
main
Created
2024-10-13
First commit
2024-10-13
Last pushed
2026-07-15
GitHub updated
2026-07-17
Last synced
2026-07-17 04:31
Stack detected
2026-07-17 04:31
Archived
no

Links and files

GitHub Website

https://scrapling.readthedocs.io/en/latest/

README

403 Forbidden | https://api.github.com/repos/D4Vinci/Scrapling/readme | message=API rate limit exceeded for user ID 8257474. If you reach out to GitHub Support for help, please include the request ID 841C:276133:137CBB2:12BB902:6A59B015 and timestamp 2026-07-17 04:31:17 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https | rate_limit_remaining=0 | rate_limit_reset=1784264421

Appears in

1