this improves perf in the case where we're not doing any sorting as we avoid allocating memory and converting scores into numeric terms