• Yaowu Xu's avatar
    Prevent negative variance · ef665996
    Yaowu Xu authored
    Due to rounding used computation, HDB variance computation may produce
    slightly negative values. This commit adds clamping to make sure
    output variance values for 10 and 12 to be non-negative.
    
    Change-Id: Id679aa55a4c201958c4c7d28cd8733b9246a71c8
    ef665996
variance.c 21.6 KB