Changes between Initial Version and Version 2 of Ticket #20617


Ignore:
Timestamp:
Nov 9, 2016, 10:14:04 AM (3 years ago)
Author:
teor
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • Ticket #20617 – Description

    initial v2  
    11Some unit tests succeed at random with a certain probability, so we need to repeat them a number of times until the failure rate is acceptable.
    22
    3 Typically, we make sure the failure rate is less than the memory bit flip rate.
     3Typically, we make sure the failure rate is less than the hardware bit error rate.
    44
    55But we could standardise this, by taking the following inputs:
    66* test function with success/fail return value,
    77* the probability of success regardless of whether the code actually works,
    8 * the desired overall probability of failure by chance (for example, the bit flip rate).
     8* the desired overall probability of failure by chance (for example, the bit error rate).
    99
    10 The abstraction would then repeat the test enough times to make sure the failure rate is less than the bit flip rate.
     10The abstraction would then repeat the test enough times to make sure the failure rate is less than the bit error rate.
    1111
    1212We might also want to check that the distribution of returned values is uniform, but I think that's a separate (and more complex) ticket.