from Hacker News

Ask HN: Are your code benchmarks statistically valid?

by DenisM on 4/25/25, 8:30 PM with 3 comments

It appears that some benchmarking tools provide average or percentile values but no information about statistical validity of the result. What did you observe or do in your career?
  • by Magma7404 on 4/25/25, 8:37 PM

    I haven't got a clue since I have never used any benchmark tool in my whole life. Could you tell us in which professional context you would use that kind of tool?