Opened 6 months ago

Last modified 6 months ago

#29847 new defect

Improve our handling of stochastic tests

Reported by: asn Owned by:
Priority: Medium Milestone: Tor: unspecified
Component: Core Tor/Tor Version:
Severity: Normal Keywords: prob-distr math tor-test 041-proposed
Cc: Actual Points:
Parent ID: Points: 2
Reviewer: Sponsor:

Description

We have cool stochastic tests for our probability distributions but we are not handling very well their stochastic nature.

As part of #29693 we greatly reduced their false positive rate, but that also reduces their use.

There might be other approaches we could take to make them more useful for us. examples: https://trac.torproject.org/projects/tor/ticket/29693#comment:4

Child Tickets

Change History (2)

comment:1 Changed 6 months ago by teor

Keywords: 041-must added
Milestone: Tor: unspecifiedTor: 0.4.1.x-final

Our failure rates for merge forwards, and complex pull requests, will become unacceptable once we split off maint-0.4.1:
https://trac.torproject.org/projects/tor/ticket/29693#comment:11

So we need to do something about this issue in 0.4.1.

comment:2 Changed 6 months ago by teor

Keywords: 041-proposed added; 041-must removed
Milestone: Tor: 0.4.1.x-finalTor: unspecified

We adjusted #29693 so that the false positive rate is acceptable, even if the tests run in every supported release series.

Note: See TracTickets for help on using tickets.