[tor-commits] [onionoo/master] Allow robots to index the .html files.

[karsten@xxxxxxxxxxxxxx]

commit f5b85859b09ff8164acc82dbea27fb15cb713bc8
Author: Karsten Loesing <karsten.loesing@xxxxxxx>
Date:   Tue Aug 12 16:15:27 2014 +0200

    Allow robots to index the .html files.
---
 web/robots.txt |    7 ++++++-
 1 file changed, 6 insertions(+), 1 deletion(-)

diff --git a/web/robots.txt b/web/robots.txt
index 6ffbc30..9b19f8f 100644
--- a/web/robots.txt
+++ b/web/robots.txt
@@ -1,3 +1,8 @@
 User-agent: *
-Disallow: /
+Disallow: /summary
+Disallow: /details
+Disallow: /bandwidth
+Disallow: /weights
+Disallow: /clients
+Disallow: /uptime
 

_______________________________________________
tor-commits mailing list
tor-commits@xxxxxxxxxxxxxxxxxxxx
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-commits