Skip to content

Releases: huggingface/inference-benchmarker

v1.1.0

28 Mar 09:58
5290f9b

Choose a tag to compare

What's Changed

  • fix: Fix results dashboard by @Hugoch in #6
  • chore: Bump up dependencies versions + cosmetic fixes. by @Hugoch in #7

Full Changelog: v1.0.0...v1.1.0

v1.0.0

07 Feb 22:39
0d9fa51

Choose a tag to compare

What's Changed

  • Benchmark profiles and multi-turn conversations by @Hugoch in #1

Full Changelog: v0.2.0...v1.0.0

v0.2.0

28 Nov 14:45
754aeb8

Choose a tag to compare

New features

  • Results dashboard
  • k8s Helm chart
  • Slurm example
  • Results table shown in console at end of benchmark

Bug fixes

  • Fix TTFT average computation
  • Handle backend connection drops
  • Fix token count in responses

Full Changelog: v0.1.0...v0.2.0

v0.1.0

09 Oct 11:25
b7c3347

Choose a tag to compare

First release

Features

  • Benchmark modes: sweep, rate, throughput
  • Custom prompt/decode options
  • JSON report output
  • Custom prompts via HF dataset