Reduce the number of files that are kept for performance tests forever
Reduce the number of builds that are kept for performance warmup
Consider moving build artifacts elsewhere (S3)
Only keep perf test results that pass
We need to think whether each option above makes sense and think of more.