[Author Prev][Author Next][Thread Prev][Thread Next][Author Index][Thread Index]

Re: [tor-talk] Load Balancing/High Availability Hidden Services

Hash: SHA1

I can talk all day about optimising and making a HS faster, but
nothing matches a DNS-round-robin pool for example in that respect.
Most optimisations you can make will be down to software you run and
splitting loads. So for example, if you have a high traffic site, you
can pan it out to 2-3 hidden services. So HS1 serves the general
requests, HS2 serves the static/cached content like images, and you
perhaps run the heavy downloads from HS3, so high load on any
particular one won't effect others and also split the web page loads
between several HS addresses and it won't be very noticeable to the user.

Use my XMPP (below in my signature) to get in touch if you want to
discuss in more detail. I have my own hidden service projects open
right now and in development to handle high loads so we can exchange
notes and release our info with others once we know what does and
doesn't work in each particular use case.


On 11/03/2015 15:27, MacLemon wrote:
> Hoi!
> I'm looking into ideas for creating “load balanced” or “high
> availability” hidden services. Mostly pertaining to web servers
> serving large-ish static files. (Let's say 5-100MB each.)
> Load balanced as in not all requests end up at the same box to
> speed up downloads. High availability as in the service is still
> available if one box goes down or is taken offline for
> maintenance.
> So, not exactly your usual distributed-cluster setup.
> From what I understand it would not make sense to run the same HS
> Key on multiple boxes since the descriptors would overwrite each
> other every few minutes.
> I don't think one can do something like Round-Robin DNS with HS.
> So the only way I can imagine this to work is a central redirection
> node that know about all the nodes and more or less
> intelligently/randomly 302 redirects each file request to a
> known-to-it server.
> This still leaves a single-point-of-failure in form of the
> redirection server but would at least distribute the traffic load
> across multiple servers and cope for nodes coming and going.
> Has anyone done something like this?
> Thanks a bunch! MacLemon

- -- 
Activist, anarchist and a bit of a dreamer.
Keybase: https://keybase.io/thomaswhite

PGP Keys: https://www.thecthulhu.com/pgp-keys/
Current Fingerprint: BA81 407C BD61 CD15 E5D9 ADA9 5FA2 426F F34E 0FD4
Master Fingerprint: DDEF AB9B 1962 5D09 4264 2558 1F23 39B7 EF10 09F0

Twitter: @CthulhuSec
XMPP: thecthulhu at jabber.ccc.de
XMPP-OTR: 4321B19F A9A3462C FE64BAC7 294C8A7E A53CC966
Version: GnuPG v2

tor-talk mailing list - tor-talk@xxxxxxxxxxxxxxxxxxxx
To unsubscribe or change other settings go to