Sign in
Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list
Repos indexed
17,373
Awesome lists tracked
125
Current results
3

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Clear 1 refinement
Search mode
Tune results
More filters Topics, generated tags, stack, files, age, archive status, and growth.
Ecosystem
Files

Choose a suggestion or use commas to require multiple files.

Health

Uses known first-commit dates.

Momentum
Filters by observed commit-count growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Filters by observed GitHub star growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Reset filters
3 repos shown
Topic: spider
Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

postmodern/spidr

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Stack
Ruby Sinatra Bundler
GitHub topics
#crawler #ruby #scraper #spider #spider-links #web
Updated
2026-01-12
Lists
1 list mention
First commit
2008-05-19
History
3 history points
License
MIT
Issues
16 open
Sign in to like postmodern/spidr
836
stars
Forks
107
Commits
898 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
GitHub