Allow robots to see the userlist (but not index it) · aced07fa48 - git.nibbletools.com by Gogs

Allow robots to see the userlist (but not index it)

Otherwise, robots have problems accessing user profile pages.

Visman 2 years ago

parent

4a32811d33

commit

aced07fa48

1 changed files with 0 additions and 1 deletions

Split View Show Diff Stats

						
							+ 0
							
							- 1
						
public/robots.txt
							 
								View File
							
				@@ -4,6 +4,5 @@ Disallow: /log
			
				 Disallow: /mod
			
				 Disallow: /reg
			
				 Disallow: /search
			
				-Disallow: /userlist
			
				 Disallow: /post
			
				 Disallow: /forum/scroll