Re: [tor-talk] tor2web - How can I get my hidden service indexed?

[tor@xxxxxxxxxxxxxxxxxx]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

On 14/02/13 10:55, Fabio Pietrosanti (naif) wrote:

> Tor2web software by default: - setup a robots.txt to prevent search
> engine scraping - block a wide set of Crawler UA to further block
> search activities - prevent hotlinking (from an internet resource
> to do <img src="https://blahblah.tor2web.org/image.jpg";>

This seems like a strange default to me. I can see why people would
want to create hidden services that can be discovered using ordinary
channels on the Internet such as search engines.

If a hidden service operator actually wanted to block search engines,
they'd know to create their own robots.txt file, or to add appropriate
meta tags to their HTML, or to simply block based on the User-Agent
header...

- -- 
Mike Cardwell  https://grepular.com/     http://cardwellit.com/
OpenPGP Key    35BC AF1D 3AA2 1F84 3DC3  B0CF 70A5 F512 0018 461F
XMPP OTR Key   8924 B06A 7917 AAF3 DBB1  BF1B 295C 3C78 3EF1 46B4
-----BEGIN PGP SIGNATURE-----

iQGGBAEBCgBwBQJRHVcLMBSAAAAAACAAB3ByZWZlcnJlZC1lbWFpbC1lbmNvZGlu
Z0BwZ3AuY29tcGdwbWltZTgUgAAAAAAVABpwa2EtYWRkcmVzc0BnbnVwZy5vcmdt
aWtlLmNhcmR3ZWxsQGdyZXB1bGFyLmNvbQAKCRCdJiMBwdHnBLOwCACCs2fUrRcc
AZG/g0XGrJ08cZT+yHpWz0W9hpX4OZNmSIeoEB3HXVZImJLF7SLYa2PUFWyo5tbG
nFzk3lQOv7NWH01o8cqKhyT24onj4J52b1yTHN7zEPArVKqPIiIoQDEGITInbc3a
fbkvK4ToMqinCLphfGMWPLdg0JPOu/TCH1l72m9vi5CIowlRIZndWkgI8U1QpExC
Gy7wx2sObsgCSwRmlJtQvcIg1WEIE0Ewh6MLraMdqzDHjV0AbZY2qS9hPy3AU8er
9dYLScx/UvMTJCXMAm0BC4jHZBOH3a5aXtDjKH0m8zmUHcWQH/+Grz3dlm5dq139
cAc9PDN9/1Ol
=lMQy
-----END PGP SIGNATURE-----
_______________________________________________
tor-talk mailing list
tor-talk@xxxxxxxxxxxxxxxxxxxx
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-talk