Re: [tor-bugs] #25908 [Core Tor/Tor]: make test suite coverage more deterministic

["Tor Bug Tracker & Wiki" <blackhole@xxxxxxxxxxxxxx>]

#25908: make test suite coverage more deterministic
-------------------------------------------------+-------------------------
 Reporter:  catalyst                             |          Owner:  (none)
     Type:  project                              |         Status:  new
 Priority:  Medium                               |      Milestone:  Tor:
                                                 |  0.3.4.x-final
Component:  Core Tor/Tor                         |        Version:
 Severity:  Normal                               |     Resolution:
 Keywords:  tor-ci, tor-tests-coverage, tor-     |  Actual Points:
  tests-unit                                     |
Parent ID:                                       |         Points:
 Reviewer:                                       |        Sponsor:
                                                 |  Sponsor3-can
-------------------------------------------------+-------------------------

Comment (by nickm):

 I ran the tests another 450 times, with all of the deterministic-coverage
 fixes so far applied to it.  I found only one case in which the coverage
 was different, and opened #26008 to track it.

 To reproduce at home, build Tor with coverage enabled; create a "coverage-
 raw" directory, and then run:
 {{{
 while true; do
   make reset-gcov
   CD=coverage-raw/coverage-`date +%s`
   mkdir -p $CD
   make -j5 check
   ./scripts/test/coverage $CD
 done
 }}}

 Then, once you have enough runs in coverage-raw, use the cov-diff tool to
 see if they have any coverage differences.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/25908#comment:6>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online

_______________________________________________
tor-bugs mailing list
tor-bugs@xxxxxxxxxxxxxxxxxxxx
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs