Skip to content

Latest commit

 

History

History
49 lines (38 loc) · 2.3 KB

README.md

File metadata and controls

49 lines (38 loc) · 2.3 KB

Benchmarking Java Streams

Benchmarks Report

The results of running benchmarks are stored in .csv files. To ease the download of reports, there is a separate .zip file named reports.zip that contains all the .csv files with data.

Reports Directory Structure

Reports directories are structured on a per-size basis with three special reports for all input sizes:

  • report_classic - all input sizes for classic stream
  • report_forkjoin - all input sizes for fork/join stream
  • report_whole - all input sizes for both classic and fork/join stream

Each report directory from the above contains 3 separate files:

  • averagetime.csv - results for average time mode benchmarks
  • throughput.csv - results for throughput mode benchmarks
  • total.csv - combined results for both modes

Report Formats

For the particular reports, I have two formats:

  • averagetime.csv, throughput.csv share one format, called the modes format.
  • total.csv has a separate format, called the total format.
Modes Format

The modes report contains eight columns:

  1. Label - name of the benchmark
  2. Input Size - benchmark input size
  3. Threads - number of threads used in benchmark from set {1, 4, 7, 8, 16, 19, 32}
  4. Mode - benchmark mode, either average time or throughput
  5. Cnt - the number of benchmark iterations, should always be equal to 20
  6. Score - actual results of benchmark
  7. Score Mean Error - benchmark measurement error
  8. Units - units of benchmark, either ms/op (for average time) or ops/ms (for throughput)
Total Format

The total report contains ten columns:

  1. Label - name of the benchmark
  2. Input Size - benchmark input size
  3. Threads - number of threads used in benchmark from set {1, 4, 7, 8, 16, 19, 32}
  4. Cnt - the number of benchmark iterations, should always be equal to 20
  5. AvgTimeScore - actual results of benchmark for average time mode
  6. AvgTimeMeanError - benchmark measurement error for average time mode
  7. AvgUnits - units of benchmark for average time mode in ms/op
  8. ThroughputScore - actual results of benchmark
  9. ThroughputMeanError - benchmark measurement error for throughput mode
  10. ThroughputUnits - units of benchmark for throughput mode in ops/ms