Re: Anonymity-preserving collection of usage data of a hidden service authoritative directory

[Roger Dingledine <arma@xxxxxxx>]

On Tue, May 01, 2007 at 11:52:42AM +0200, Karsten Loesing wrote:
> Cool. :) Looking forward to evaluating the first statistics file --
> whenever that will be.

Here are early results from moria1:

publish-total-history 2007-05-01 10:25:27 (900 s) 257,312,304,318,348,314,293,461,279,369,334,357,229,285,429,304,278,332,307,409,366,302,332,426,237,338,374,398,308,406,373,382,226,412,347,330,288,364,367,410,368,370,374
publish-novel-history 2007-05-01 10:25:27 (900 s) 196,161,128,173,6,2,11,8,4,4,2,1,9,4,3,3,0,2,3,1,1,5,2,3,3,6,2,6,3,3,6,4,3,3,2,3,2,3,6,3,2,7,4
publish-top-5-percent-history 2007-05-01 10:25:27 (900 s) 47,64,58,66,60,57,64,87,56,72,58,69,53,54,86,61,52,74,67,74,56,56,76,100,55,78,76,86,67,91,93,70,39,67,66,62,52,75,84,91,66,83,78
publish-top-10-percent-history 2007-05-01 10:25:27 (900 s) 71,94,91,94,93,90,94,138,82,111,93,102,74,80,133,85,82,106,93,113,95,86,105,139,79,114,112,129,100,137,129,110,64,108,103,98,82,111,121,133,105,119,118
publish-top-20-percent-history 2007-05-01 10:25:27 (900 s) 101,136,129,122,149,136,123,212,120,171,139,141,97,113,201,112,124,149,132,177,155,130,149,201,115,152,166,189,143,199,180,164,96,174,153,141,120,161,179,189,169,170,175
fetch-total-history 2007-05-01 10:25:27 (900 s) 51,46,34,56,99,88,82,77,50,43,22,16,25,13,23,21,53,31,16,18,13,8,20,24,17,17,21,29,14,17,21,16,29,17,20,26,41,30,29,49,52,75,38
fetch-successful-history 2007-05-01 10:25:27 (900 s) 1,10,4,17,24,23,19,16,12,6,18,11,12,4,12,9,20,8,10,4,5,5,5,12,6,5,9,15,6,8,10,4,9,5,7,7,17,10,15,15,16,14,17
fetch-top-5-percent-history 2007-05-01 10:25:27 (900 s) 13,10,10,17,52,40,56,41,29,31,5,4,3,5,6,5,17,11,6,5,6,3,4,7,3,2,8,5,4,5,3,3,15,10,7,6,8,5,8,14,12,19,12
fetch-top-10-percent-history 2007-05-01 10:25:27 (900 s) 20,16,15,20,58,48,60,45,32,31,10,4,6,5,8,8,23,16,6,7,6,3,7,12,6,4,11,9,6,7,5,5,18,10,9,10,11,8,11,18,16,28,15
fetch-top-20-percent-history 2007-05-01 10:25:27 (900 s) 29,26,22,28,66,63,64,53,35,35,12,7,10,8,12,10,30,19,8,9,8,5,9,15,8,6,13,13,7,9,7,7,21,11,10,14,17,12,14,25,26,44,19
desc-total-history 2007-05-01 10:25:27 (900 s) 196,357,485,658,664,666,677,685,689,693,695,696,705,709,712,715,715,717,720,721,722,727,729,732,735,741,743,749,752,755,761,765,768,771,773,776,778,781,787,790,792,799,803

The novel descriptors, and failed fetches, are high at the beginning
because it had just started up so it didn't have any yet. Hard to
guess what steady-state will be. But the first thing to note is that
the total number of fetches are really not that high. The second thing
to note is to start wondering why a few services publish so often --
is it because their intro circuits break often, maybe because they have
a poor network connection, so they feel the need to republish? And the
third is to remember that hidden services suck right now, so we shouldn't
take the current usage pattern to be the requirements for future hidden
services. :)

> Last time I forgot to include the (few) changes to the man page in the
> SVN patch. They are at the bottom of this mail.

Added. Thanks!
--Roger