This prevents frame allocation overflows, and fixed fate-h264-conformance-mr3_tandberg_b with 2 threads.