Re: [tor-bugs] #13731 [Ooni]: Brainstorm ideas for possible visualisations

["Tor Bug Tracker & Wiki" <blackhole@xxxxxxxxxxxxxx>]

#13731: Brainstorm ideas for possible visualisations
-------------------------+---------------------
     Reporter:  hellais  |      Owner:  hellais
         Type:  project  |     Status:  new
     Priority:  normal   |  Milestone:
    Component:  Ooni     |    Version:
   Resolution:           |   Keywords:
Actual Points:           |  Parent ID:
       Points:           |
-------------------------+---------------------

Comment (by kudrom):

 Hi,

 The first set of visualisations should be one that would allow us to think
 about all the reports collected thus far. Right now it's nearly impossible
 to have a general idea of the data recorded: the kind of reports that are
 collected, where and when. Therefore it's impossible to pick one (or a
 group of) nettest/s and build some thoughtful visualization with it.

 So i'll work on a simple set of interactive visualizations that will
 present in the first place a histogram of nettests' reports recorded
 and...

 1) if you click on a bar (a nettest), a pie with the distribution of
 countries and a timeline of when the data was recorded will be drawn.

 1.1) if you click on a country, a timeline for that country will be drawn.

 2) Links to the nettest specs will be provided when the user selects a
 nettest in the point !#1.

 3) Probably it could be useful to provide some help to query the mongodb
 database that will be updated with each user selection, for example the
 fields that filter the data selected.

 The country pie could be replaced with a heat map, but at the moment it's
 more simple to draw a pie and see how the data behaves.

 This way the user of this visualization (for the moment us) can take the
 decission of what nettest he's going to use for his visualization.

 I'll start in a couple of days so any feedback is appreciated.

 I need to know if the mongodb is up and running and where and also a fully
 populated reports table, so maybe this is a good oportunity to expand the
 sanitise and import scripts to work with all the ooni data and not only
 the bridge reachability reports. Nonetheless, ÂI saw that a
 reports.{json,yaml} is in the root of the collector, so maybe i can play
 with that data until the mongodb reports table is fully populated.

 Also, the visualization is kind of splitted in two halves, the first one
 is the export phase of the current pipeline architecture, in which i
 aggregate the mongodb data in a useful format for my visualization; Âthe
 second one is the proper visualization, in which i use the exported data
 and build some pretty graphics with it. I think this two phases are the
 same for every visualization build with ooni, so i think that some
 documentation should be written to ease the future analysts the use of
 ooni to extract and aggregate data.

 ciao

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/13731#comment:1>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online
_______________________________________________
tor-bugs mailing list
tor-bugs@xxxxxxxxxxxxxxxxxxxx
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs