[tor-bugs] #18768 [Analysis]: Calculate the fraction of dist.torproject.org traffic for Tor Browser downloads and updates

["Tor Bug Tracker & Wiki" <blackhole@xxxxxxxxxxxxxx>]

#18768: Calculate the fraction of dist.torproject.org traffic for Tor Browser
downloads and updates
--------------------------+-----------------
     Reporter:  karsten   |      Owner:
         Type:  task      |     Status:  new
     Priority:  Medium    |  Milestone:
    Component:  Analysis  |    Version:
     Severity:  Normal    |   Keywords:
Actual Points:            |  Parent ID:
       Points:            |   Reviewer:
      Sponsor:            |
--------------------------+-----------------
 We'd like to know what fraction of dist.torproject.org traffic is caused
 by updates, because it would be easy to move that traffic elsewhere.

 Here's one way to find out: We go through sanitized web server logs from
 dist.torproject.org written by aroides in March 2016.  This time frame
 covers a large and a small (in terms of incremental update size) Tor
 Browser release on March 8 and 18 respectively.  We sum up response bytes
 by file extension, where .exe, .tar.xz, and .dmg are counted as Tor
 Browser downloads, .mar as Tor Browser updates, and other extensions as
 being unrelated to Tor Browser.

 {{{
 $ cat dist.torproject.org-access.log-201603?? | cut -d" " -f7,10 | grep "
 [0-9]*$" > dist.torproject.org-access.log-201603-part
 $ cat dist.torproject.org-access.log-201603-part | grep "\.exe " | cut -d"
 " -f2 | paste -sd+ - | bc
 62650080788327
 $ cat dist.torproject.org-access.log-201603-part | grep "\.tar\.xz " | cut
 -d" " -f2 | paste -sd+ - | bc
 12497704216145
 $ cat dist.torproject.org-access.log-201603-part | grep "\.dmg " | cut -d"
 " -f2 | paste -sd+ - | bc
 8352205765328
 $ cat dist.torproject.org-access.log-201603-part | grep "\.mar " | cut -d"
 " -f2 | paste -sd+ - | bc
 29958084372393
 $ cat dist.torproject.org-access.log-201603-part | cut -d" " -f2 | paste
 -sd+ - | bc
 113689403444481
 }}}

 Results:
 ||=Extension =||= Bytes=||= Fraction=||
 ||.exe || 62650080788327|| 55%||
 ||.tar.xz || 12497704216145|| 11%||
 ||.dmg || 8352205765328|| 7%||
 ||.mar || 29958084372393|| 26%||
 ||other || 231328302288|| 0%||
 ||total || 113689403444481|| 100%||

 In words, 73% of dist.torproject.org traffic is caused by downloads, 26%
 by updates.

 Thoughts?

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/18768>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online
_______________________________________________
tor-bugs mailing list
tor-bugs@xxxxxxxxxxxxxxxxxxxx
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs