[Author Prev][Author Next][Thread Prev][Thread Next][Author Index][Thread Index]
[or-cvs] r22627: {website} update robots.txt to make it valid. (website/trunk)
Author: phobos
Date: 2010-07-12 18:35:11 +0000 (Mon, 12 Jul 2010)
New Revision: 22627
Modified:
website/trunk/robots.txt
Log:
update robots.txt to make it valid.
Modified: website/trunk/robots.txt
===================================================================
--- website/trunk/robots.txt 2010-07-11 02:54:33 UTC (rev 22626)
+++ website/trunk/robots.txt 2010-07-12 18:35:11 UTC (rev 22627)
@@ -1,3 +1,4 @@
Sitemap: http://www.torproject.org/sitemap.xml
Sitemap: https://www.torproject.org/sitemap.xml
User-Agent: *
+Allow: /