enpaul/enpaul.net
1
0
Fork 0
Code Issues Pull Requests Releases Activity

Add sitemap and document robots.txt

Browse Source
This commit is contained in:
Ethan Paul
2020-01-09 00:54:38 -05:00
parent cf37d2fe47
commit 84da3a2353
2 changed files with 37 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
robots.txt
View File

@@ -1,7 +1,12 @@
# Allow all bots
User-agent: *
# Disallow access to non-content directories
Disallow: /_archive
Disallow: /_error
Disallow: /css
Disallow: /fonts
Disallow: /img
Disallow: /js
Sitemap: https://enpaul.net/sitemap.xml