Add dynamically generated robots.txt from MarkDown

This commit is contained in:
Raven Scott
2024-09-26 04:32:47 -04:00
parent da0de2464e
commit 8e7aef938e
2 changed files with 38 additions and 0 deletions

11
me/robots.md Normal file
View File

@ -0,0 +1,11 @@
### Production
- User-agent: *
- Allow: /
- Sitemap: https://raven-scott.fyi/sitemap.xml
### Development
- User-agent: *
- Disallow: /