danielmiessler/RobotsDisallowed
A curated list of the most common and most interesting robots.txt disallowed directories.
1,474
ShellStars
1,474
Updated
Nov 24, 2025
Stars Over Time
Top Contributors
Related Repositories
Track developers from danielmiessler/RobotsDisallowed
Join 1,000+ companies finding quality developer leads