danielmiessler/RobotsDisallowed

danielmiessler/RobotsDisallowed has 1,498 GitHub stars and 304 forks. GitHot measured 0 stars in 24 hours. Last checked 2026-11-05 09:38 UTC. Last push 2022-08-22.

How these counts are measured

A curated list of the most common and most interesting robots.txt disallowed directories.

1,498 stars 304 forks

Measured star growth

in 24h: 0
in 7 days: Collecting history
in 15 days: Collecting history
in 1 month: Collecting history

Net star changes over overlapping periods, not daily totals. Missing measurements are left blank. Stars measure attention, not software quality.

README.md

Original

Read the README on GitHub

Explore related projects

codecrafters-io/build-your-own-x

Master programming by recreating your favorite technologies from scratch.

560,001 stars

public-apis/public-apis

A collective list of free APIs

496,250 stars

morluto/rea

Reverse engineer anything with agents, from app behavior down to native binaries.

432,789 stars

openclaw/openclaw

The AI that really does things. Any OS. Any Platform. The lobster way. 🦞

393,950 stars