[Author Prev][Author Next][Thread Prev][Thread Next][Author Index][Thread Index]

Re: [tor-talk] Hidden Services



-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

On 18/09/12 17:23, grarpamp wrote:

>>> similar features to facilitate indexing of visited TorHs by
>>> 3rd
>> If you do this, please honour peoples robots.txt files.
> 
> No, they are publishing a list of onions/urls visited, not doing 
> the indexing themselves, robots has nothing to do with t2w.

People use robots.txt to indicate that they don't want their site to
be added to indexes. If you want to ignore the site owners
wishes/intentions, you can of course pretend that robots.txt doesn't
apply to your particular indexing method because of some technicality.
That's not very polite though.

- -- 
Mike Cardwell  https://grepular.com/     http://cardwellit.com/
OpenPGP Key    35BC AF1D 3AA2 1F84 3DC3  B0CF 70A5 F512 0018 461F
XMPP OTR Key   8924 B06A 7917 AAF3 DBB1  BF1B 295C 3C78 3EF1 46B4
-----BEGIN PGP SIGNATURE-----

iQGGBAEBCgBwBQJQWL0LMBSAAAAAACAAB3ByZWZlcnJlZC1lbWFpbC1lbmNvZGlu
Z0BwZ3AuY29tcGdwbWltZTgUgAAAAAAVABpwa2EtYWRkcmVzc0BnbnVwZy5vcmdt
aWtlLmNhcmR3ZWxsQGdyZXB1bGFyLmNvbQAKCRCdJiMBwdHnBNmTB/965EaPAfsb
cqk7jESzaQ+uPBWoUxZjnA71i2Vq3UR0S6kqCllssD37N5sJDb49rPBDhBQpx/SQ
6XxYy1rdh8EXNcsOHlTukW+7XKK9s8ysNsMAq9dqe4ZCjCW9PL/RENJJMbnLRHNA
zbm1alVzM0zOwT1yfazFouha0LrC/ohBvUfluM0GDaZIB6W2ZfpM+swTb/5YzIgx
rAgfNi1gjgWSQYKBDdJAOPdXHOnRXsKDDTaHzEVmPIlPiLHXIzgQMkDiNLL8DKv2
Ot1ynWXJe+w6VkWvHWJap+tWBxc1YhfsCjotp9uHLJBE3X0zv8gpUVC6jQd5Xtj6
t72eMSsbiZ/0
=g8mD
-----END PGP SIGNATURE-----
_______________________________________________
tor-talk mailing list
tor-talk@xxxxxxxxxxxxxxxxxxxx
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-talk