Skip to content

Commit 57e0c93

Browse files
committed
Update README.md
1 parent 01ab8d1 commit 57e0c93

1 file changed

Lines changed: 15 additions & 0 deletions

File tree

README.md

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -290,6 +290,21 @@ All L0 types have corresponding Pydantic models: `StateModel`, `RetryModel`, `Ti
290290
- **Pure asyncio** - No compatibility layers, native Python async
291291
- **Own retry logic** - No tenacity, full control over behavior
292292

293+
## Performance
294+
295+
Benchmarks on Apple M1 Max, Python 3.13, zero-delay mock streams (2000 tokens):
296+
297+
| Scenario | Tokens/s | Avg Duration | TTFT |
298+
| ------------------------ | ----------- | ------------ | ----------- |
299+
| Baseline (raw streaming) | 1,406,390 | 1.42 ms | 0.02 ms |
300+
| L0 Core (no features) | 596,086 | 3.36 ms | 0.10 ms |
301+
| L0 + JSON Guardrail | 557,550 | 3.59 ms | 0.09 ms |
302+
| L0 + All Guardrails | 547,991 | 3.65 ms | 0.09 ms |
303+
| L0 + Drift Detection | 114,935 | 17.41 ms | 0.10 ms |
304+
| **L0 Full Stack** | **114,895** | **17.43 ms** | **0.10 ms** |
305+
306+
Full stack = JSON + Markdown + zero-output guardrails + drift detection + checkpointing. See [BENCHMARKS.md](./BENCHMARKS.md) for details.
307+
293308
## Documentation
294309

295310
| Guide | Description |

0 commit comments

Comments
 (0)