[Author Prev][Author Next][Thread Prev][Thread Next][Author Index][Thread Index]

Re: [tor-bugs] #16750 [Onionoo]: Add improved family measure to Onionoo



#16750: Add improved family measure to Onionoo
--------------------------------+--------------------
     Reporter:  virgilgriffith  |      Owner:
         Type:  enhancement     |     Status:  new
     Priority:  normal          |  Milestone:
    Component:  Onionoo         |    Version:
   Resolution:                  |   Keywords:  roster
Actual Points:                  |  Parent ID:
       Points:                  |
--------------------------------+--------------------

Comment (by karsten):

 Thanks for looking, virgilgriffith.  I have a tested-but-not-reviewed
 implementation in
 [https://gitweb.torproject.org/user/karsten/onionoo.git/log/?h=task-16750
 branch task-16750 in my public repository] that produces details documents
 like the following (pretty-printed using JSONLint):

 {{{
         {
             "nickname": "torpidsFRovh",
             "fingerprint": "91D23D8A539B83D2FB56AA67ECD4D75CC093AC55",
             "or_addresses": [
                 "37.187.20.59:443",
                 "[2001:41d0:a:143b::1]:993"
             ],
             "dir_address": "37.187.20.59:80",
             "last_seen": "2015-08-20 07:00:00",
             "last_changed_address_or_port": "2015-08-04 12:00:00",
             "first_seen": "2015-08-04 12:00:00",
             "running": true,
             "flags": [
                 "Fast",
                 "Guard",
                 "HSDir",
                 "Running",
                 "Stable",
                 "V2Dir",
                 "Valid"
             ],
             "country": "fr",
             "country_name": "France",
             "latitude": 48.86,
             "longitude": 2.35,
             "as_number": "AS16276",
             "as_name": "OVH SAS",
             "consensus_weight": 16900,
             "host_name": "37-187-20-59.kimsufi.com",
             "last_restarted": "2015-04-27 22:25:33",
             "bandwidth_rate": 6291456,
             "bandwidth_burst": 7340032,
             "observed_bandwidth": 7126582,
             "advertised_bandwidth": 6291456,
             "exit_policy": [
                 "reject *:*"
             ],
             "exit_policy_summary": {
                 "reject": [
                     "1-65535"
                 ]
             },
             "contact": "torpids AT yahoo dot com -
 1JYHfzVFVD7n2Sezz3DEHDFgGYjQWpDjqF",
             "platform": "Tor 0.2.6.7 on Linux",
             "family": [
                 "$0E3DE4D738C91A8BB56432EF2DA7C28D4108F4A2",
                 "$169019BFFECBBB9A35878BCF4C7AE1FF37AD8452",
                 "$231C2B9C8C31C295C472D031E06964834B745996",
                 "$29FA22A7AEE4D8AAEA5BF9271834642EEDA849D7",
                 "$3EE7D6BEAE015552C05E6AA40EBBCC69B251EC23",
                 "$4C7AA094EF5072F08C89A72353227FACBE58092F",
                 "$4C7BF55B1BFF47993DFF995A2926C89C81E4F04A",
                 "$530E1038C3D2F746657B51F97831F9F422747180",
                 "$552996B383110A00DE456E010E3E74A4E54E54B0",
                 "$580A91DAE04CD402AE70E85E01C3B1FD5BE5136E",
                 "$5CC55AF14792CE805CA486A2CA1EC25A4016474A",
                 "$6A97482F1B228AF847A8FE83C75F68902C2DCA4D",
                 "$6B7191639E179965FD694612C9B2C8FB4267B27D",
                 "$7589D87E6669A04EE9EA081342006E2E5571AD43",
                 "$79D6A70B5E42DB93563074E8A385EDDB46FBB6DA",
                 "$8B3D6AB6A692C8C92AC33E47C6F75C593F5AAF42",
                 "$935BABE2564F82016C19AEF63C0C40B5753BA3D2",
                 "$93E8D956042F1C3572EFF87313F4794910584D3C",
                 "$9643FE742A609FBE332E4D512A88DECF2E5207C2",
                 "$A37C47B03FF31CA6937D3D68366B157997FE7BCD",
                 "$A55D07F6D78CE790E7D75DE665DF8365866BA870",
                 "$A703C8DB0466AB16375403D798005F568372E2D8",
                 "$A705EFD586626F690A71A215E6233D7E8581C374",
                 "$A99ED2CC51850744D8CFF194CF6B06900B8B13AD",
                 "$BD5899EA64D83F7E885B2495DE0842F1A77E99AF",
                 "$C9933B3725239B6FAB5227BA33B30BE7B48BB485",
                 "$CEDD9C7C371E753CDD14D292BCE1C7B8F4734D25",
                 "$E26AFC5F718E21AC502899B20C653AEFF688B0D2",
                 "$ECC17C0BA74113FB7A4F58DAF2FF1EE23CE5DF06",
                 "$FB40DC3C724E5AA6ECD3EA1F64C0F559B48F21B5",
                 "$FC37A7B1C264497BA01A08BF6D2C982A99D5B963"
             ],
             "effective_family": [
                 "$169019BFFECBBB9A35878BCF4C7AE1FF37AD8452",
                 "$231C2B9C8C31C295C472D031E06964834B745996",
                 "$29FA22A7AEE4D8AAEA5BF9271834642EEDA849D7",
                 "$3EE7D6BEAE015552C05E6AA40EBBCC69B251EC23",
                 "$4C7BF55B1BFF47993DFF995A2926C89C81E4F04A",
                 "$6B7191639E179965FD694612C9B2C8FB4267B27D",
                 "$935BABE2564F82016C19AEF63C0C40B5753BA3D2",
                 "$A37C47B03FF31CA6937D3D68366B157997FE7BCD",
                 "$C9933B3725239B6FAB5227BA33B30BE7B48BB485",
                 "$CEDD9C7C371E753CDD14D292BCE1C7B8F4734D25",
                 "$E26AFC5F718E21AC502899B20C653AEFF688B0D2",
                 "$ECC17C0BA74113FB7A4F58DAF2FF1EE23CE5DF06",
                 "$FB40DC3C724E5AA6ECD3EA1F64C0F559B48F21B5",
                 "$FC37A7B1C264497BA01A08BF6D2C982A99D5B963"
             ],
             "extended_family": [
                 "$0B454C7EBA58657B91133A587C1BDAEDC6E23142",
                 "$0C77421C890D16B6D201283A2244F43DF5BC89DD",
                 "$169019BFFECBBB9A35878BCF4C7AE1FF37AD8452",
                 "$231C2B9C8C31C295C472D031E06964834B745996",
                 "$29FA22A7AEE4D8AAEA5BF9271834642EEDA849D7",
                 "$3EE7D6BEAE015552C05E6AA40EBBCC69B251EC23",
                 "$4436A57FFE36F09368718BCFFF750EB86A4E00B9",
                 "$4C7BF55B1BFF47993DFF995A2926C89C81E4F04A",
                 "$5A551BF2E46BF26CC50A983F7435CB749C752553",
                 "$6A29FD8C00D573E6C1D47852345B0E5275BA3307",
                 "$6A37488DD4321F0A649F6F3A77E896FAD6930C99",
                 "$6B7191639E179965FD694612C9B2C8FB4267B27D",
                 "$6D3A3ED5671E4E3F58D4951438B10AE552A5FA0F",
                 "$70C55A114C0EF3DC5784A4FAEE64388434A3398F",
                 "$75C4495F4D80522CA6F6A3FB349F1B009563F4B7",
                 "$8073670F8F852971298F8AF2C5B23AE012645901",
                 "$935BABE2564F82016C19AEF63C0C40B5753BA3D2",
                 "$A37C47B03FF31CA6937D3D68366B157997FE7BCD",
                 "$B35C5739C8C5AB72094EB2B05738FD1F8EEF6EBD",
                 "$BAACCB29197DB833F107E410E2BFAE5009EE7583",
                 "$C9933B3725239B6FAB5227BA33B30BE7B48BB485",
                 "$CEDD9C7C371E753CDD14D292BCE1C7B8F4734D25",
                 "$E11B6AE135B5A43244656C27ECEE0C09DE9E286B",
                 "$E26AFC5F718E21AC502899B20C653AEFF688B0D2",
                 "$E6E18151300F90C235D3809F90B31330737CEB43",
                 "$ECC17C0BA74113FB7A4F58DAF2FF1EE23CE5DF06",
                 "$FB40DC3C724E5AA6ECD3EA1F64C0F559B48F21B5",
                 "$FC37A7B1C264497BA01A08BF6D2C982A99D5B963"
             ],
             "consensus_weight_fraction": 0.00052586454,
             "guard_probability": 0.00086917344,
             "middle_probability": 0.00055606465,
             "exit_probability": 0,
             "recommended_version": true,
             "measured": true
         }
 }}}

 However, I wonder if it wouldn't be smarter to avoid repeating
 fingerprints to save space.  Suggestion:
  - We keep the `effective_family` field unchanged as the set of relays
 that are in a direct, mutual family relationship with the relay.
  - We don't add the `extended_family` field as planned but instead add an
 `indirect_family` field (is there a better name?) that only contains
 relays that are ''not'' part of `effective_family` but that the relay is
 indirectly connected with by following mutual family relationships.  One
 would simply compute the union of `effective_family` and `indirect_family`
 to obtain the originally proposed `extended_family` set.
  - We add a new field `alleged_family` (or is there a better name?) that
 contains all relays that the relay believes are in its family but which
 don't believe that it's in their family.  This field would also contain
 nicknames if the relay still uses them to define its family.
  - In two months from now we remove the `family` field.  It will be easy
 to re-create it by computing the union of `effective_family` and
 `alleged_family`.  But we'll have to give Onionoo client developers some
 time to make this code change.

 Here's how the document above would look like if we implemented that
 suggestion:

 {{{
         {
             "nickname": "torpidsFRovh",
             "fingerprint": "91D23D8A539B83D2FB56AA67ECD4D75CC093AC55",
             "or_addresses": [
                 "37.187.20.59:443",
                 "[2001:41d0:a:143b::1]:993"
             ],
             "dir_address": "37.187.20.59:80",
             "last_seen": "2015-08-20 07:00:00",
             "last_changed_address_or_port": "2015-08-04 12:00:00",
             "first_seen": "2015-08-04 12:00:00",
             "running": true,
             "flags": [
                 "Fast",
                 "Guard",
                 "HSDir",
                 "Running",
                 "Stable",
                 "V2Dir",
                 "Valid"
             ],
             "country": "fr",
             "country_name": "France",
             "latitude": 48.86,
             "longitude": 2.35,
             "as_number": "AS16276",
             "as_name": "OVH SAS",
             "consensus_weight": 16900,
             "host_name": "37-187-20-59.kimsufi.com",
             "last_restarted": "2015-04-27 22:25:33",
             "bandwidth_rate": 6291456,
             "bandwidth_burst": 7340032,
             "observed_bandwidth": 7126582,
             "advertised_bandwidth": 6291456,
             "exit_policy": [
                 "reject *:*"
             ],
             "exit_policy_summary": {
                 "reject": [
                     "1-65535"
                 ]
             },
             "contact": "torpids AT yahoo dot com -
 1JYHfzVFVD7n2Sezz3DEHDFgGYjQWpDjqF",
             "platform": "Tor 0.2.6.7 on Linux",
             "alleged_family": [
                 "$0E3DE4D738C91A8BB56432EF2DA7C28D4108F4A2",
                 "$169019BFFECBBB9A35878BCF4C7AE1FF37AD8452",
                 "$4C7AA094EF5072F08C89A72353227FACBE58092F",
                 "$530E1038C3D2F746657B51F97831F9F422747180",
                 "$552996B383110A00DE456E010E3E74A4E54E54B0",
                 "$580A91DAE04CD402AE70E85E01C3B1FD5BE5136E",
                 "$5CC55AF14792CE805CA486A2CA1EC25A4016474A",
                 "$6A97482F1B228AF847A8FE83C75F68902C2DCA4D",
                 "$7589D87E6669A04EE9EA081342006E2E5571AD43",
                 "$79D6A70B5E42DB93563074E8A385EDDB46FBB6DA",
                 "$8B3D6AB6A692C8C92AC33E47C6F75C593F5AAF42",
                 "$93E8D956042F1C3572EFF87313F4794910584D3C",
                 "$9643FE742A609FBE332E4D512A88DECF2E5207C2",
                 "$A55D07F6D78CE790E7D75DE665DF8365866BA870",
                 "$A703C8DB0466AB16375403D798005F568372E2D8",
                 "$A705EFD586626F690A71A215E6233D7E8581C374",
                 "$A99ED2CC51850744D8CFF194CF6B06900B8B13AD",
                 "$BD5899EA64D83F7E885B2495DE0842F1A77E99AF"
             ],
             "effective_family": [
                 "$169019BFFECBBB9A35878BCF4C7AE1FF37AD8452",
                 "$231C2B9C8C31C295C472D031E06964834B745996",
                 "$29FA22A7AEE4D8AAEA5BF9271834642EEDA849D7",
                 "$3EE7D6BEAE015552C05E6AA40EBBCC69B251EC23",
                 "$4C7BF55B1BFF47993DFF995A2926C89C81E4F04A",
                 "$6B7191639E179965FD694612C9B2C8FB4267B27D",
                 "$935BABE2564F82016C19AEF63C0C40B5753BA3D2",
                 "$A37C47B03FF31CA6937D3D68366B157997FE7BCD",
                 "$C9933B3725239B6FAB5227BA33B30BE7B48BB485",
                 "$CEDD9C7C371E753CDD14D292BCE1C7B8F4734D25",
                 "$E26AFC5F718E21AC502899B20C653AEFF688B0D2",
                 "$ECC17C0BA74113FB7A4F58DAF2FF1EE23CE5DF06",
                 "$FB40DC3C724E5AA6ECD3EA1F64C0F559B48F21B5",
                 "$FC37A7B1C264497BA01A08BF6D2C982A99D5B963"
             ],
             "indirect_family": [
                 "$0B454C7EBA58657B91133A587C1BDAEDC6E23142",
                 "$0C77421C890D16B6D201283A2244F43DF5BC89DD",
                 "$4436A57FFE36F09368718BCFFF750EB86A4E00B9",
                 "$5A551BF2E46BF26CC50A983F7435CB749C752553",
                 "$6A29FD8C00D573E6C1D47852345B0E5275BA3307",
                 "$6A37488DD4321F0A649F6F3A77E896FAD6930C99",
                 "$6D3A3ED5671E4E3F58D4951438B10AE552A5FA0F",
                 "$70C55A114C0EF3DC5784A4FAEE64388434A3398F",
                 "$75C4495F4D80522CA6F6A3FB349F1B009563F4B7",
                 "$8073670F8F852971298F8AF2C5B23AE012645901",
                 "$B35C5739C8C5AB72094EB2B05738FD1F8EEF6EBD",
                 "$BAACCB29197DB833F107E410E2BFAE5009EE7583",
                 "$E11B6AE135B5A43244656C27ECEE0C09DE9E286B",
                 "$E6E18151300F90C235D3809F90B31330737CEB43"
             ],
             "consensus_weight_fraction": 0.00052586454,
             "guard_probability": 0.00086917344,
             "middle_probability": 0.00055606465,
             "exit_probability": 0,
             "recommended_version": true,
             "measured": true
         }
 }}}

 Thoughts?

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/16750#comment:3>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online
_______________________________________________
tor-bugs mailing list
tor-bugs@xxxxxxxxxxxxxxxxxxxx
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs