[Author Prev][Author Next][Thread Prev][Thread Next][Author Index][Thread Index]

[tor-bugs] #29693 [Core Tor/Tor]: Decrease probability of stochastic failures in test-slow



#29693: Decrease probability of stochastic failures in test-slow
-------------------------------+----------------------------------------
     Reporter:  teor           |      Owner:  (none)
         Type:  defect         |     Status:  new
     Priority:  High           |  Milestone:  Tor: 0.4.0.x-final
    Component:  Core Tor/Tor   |    Version:  Tor: 0.4.0.1-alpha
     Severity:  Normal         |   Keywords:  tor-ci, tor-test, 040-must
Actual Points:                 |  Parent ID:
       Points:  0.5            |   Reviewer:
      Sponsor:  Sponsor2-must  |
-------------------------------+----------------------------------------
 Our stochastic tests are supposed to fail around 1 in 100 runs. But when
 I'm doing a backport to 0.2.9, there are up to 14 jobs times 9 branches,
 each of which runs a test instance.

 So let's decrease the probability to about 1 in (100 * 14 * 9).

 Here's what the output looks like:
 {{{
 slow/prob_distr/stochastic_uniform: [forking] fail uniform sampler
   FAIL src/test/test_prob_distr.c:1209: assert(ok)
 NOTE: This is a stochastic test, and we expect it to fail from
 time to time, with some low probability. If you see it fail more
 than one trial in 100, though, please tell us.
 Seed: 5DB9A3B32C29B76D7A0032700DD142BB
   [stochastic_uniform FAILED]
 }}}
 https://travis-ci.org/torproject/tor/jobs/503432646#L5845

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/29693>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online
_______________________________________________
tor-bugs mailing list
tor-bugs@xxxxxxxxxxxxxxxxxxxx
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs