[Author Prev][Author Next][Thread Prev][Thread Next][Author Index][Thread Index]
[or-cvs] r20082: {website} update robots.txt with sitemap, thanks to BarkerJr (website/trunk)
Author: phobos
Date: 2009-07-18 16:46:15 -0400 (Sat, 18 Jul 2009)
New Revision: 20082
Modified:
website/trunk/robots.txt
Log:
update robots.txt with sitemap, thanks to BarkerJr
Modified: website/trunk/robots.txt
===================================================================
--- website/trunk/robots.txt 2009-07-18 20:22:44 UTC (rev 20081)
+++ website/trunk/robots.txt 2009-07-18 20:46:15 UTC (rev 20082)
@@ -1 +1,3 @@
+Sitemap: http://www.torproject.org/sitemap.xml
+Sitemap: https://www.torproject.org/sitemap.xml
User-Agent: *