• Jerome Jiang's avatar
    vp9: Reduce stack usage of choose_partioning. · cc472311
    Jerome Jiang authored
    Change type of sum_square_error from int64_t to uint32_t.
    Change type of sum_error from int64_t to int32_t.
    
    This reduces the stack usage from ~131K to ~87K.
    
    BUG=b/68362457
    
    Change-Id: I147d7c7b226bceb4f0817bb86848e1fa9d9ac149
    cc472311
vp9_encodeframe.c 187 KB