diff options
| author | leafee98 <leafee98@hotmail.com> | 2022-05-18 13:51:15 +0800 |
|---|---|---|
| committer | leafee98 <leafee98@hotmail.com> | 2022-05-18 13:51:15 +0800 |
| commit | e526a8d6ca683cb90eec474778e06d88a0b20cb5 (patch) | |
| tree | 3d5845d15c1c298ab8223ff694a409aab14164d6 | |
| parent | 5b7390b5c2195b3deabbc867595574577d9d5076 (diff) | |
allow whole site for spider at robots.txt
| -rw-r--r-- | layouts/robots.txt | 6 |
1 files changed, 1 insertions, 5 deletions
diff --git a/layouts/robots.txt b/layouts/robots.txt index 21f331f..20f541f 100644 --- a/layouts/robots.txt +++ b/layouts/robots.txt @@ -1,8 +1,4 @@ User-agent: *
-Allow: /posts/
-Allow: /tags/
-Allow: /categories/
-Allow: /about/
+Allow: *
-Disallow: *
Sitemap: {{ .Site.BaseURL }}sitemap.xml
|