Commit 4359a24
committed
fix(serving): confirm ONNX session before status
Add a status reconciliation guard to the ONNX serving adapter. After the Rust ONNX session manager reports a successful load, the adapter now lists sessions and verifies the requested model is available before recording backend served status.
If the session list does not include the model or cannot be read, serving returns a non-critical provider-load failure instead of publishing stale loaded state. This keeps durable serving state behind the provider-owned session truth.
Update the ONNX Runtime serving plan with M4 status, verification evidence, and remaining serving gaps.
Verification: cargo fmt --manifest-path rust/Cargo.toml --all -- --check; cargo test --manifest-path rust/crates/pumas-rpc/Cargo.toml serving; cargo test --manifest-path rust/crates/pumas-core/Cargo.toml serving1 parent 3506464 commit 4359a24
3 files changed
Lines changed: 49 additions & 4 deletions
File tree
- docs/plans/onnx-runtime-embedding-serving
- rust/crates/pumas-rpc/src/handlers
Lines changed: 9 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
454 | 454 | | |
455 | 455 | | |
456 | 456 | | |
| 457 | + | |
| 458 | + | |
| 459 | + | |
| 460 | + | |
| 461 | + | |
| 462 | + | |
| 463 | + | |
| 464 | + | |
| 465 | + | |
457 | 466 | | |
458 | 467 | | |
459 | 468 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
578 | 578 | | |
579 | 579 | | |
580 | 580 | | |
581 | | - | |
| 581 | + | |
582 | 582 | | |
583 | 583 | | |
584 | 584 | | |
| |||
608 | 608 | | |
609 | 609 | | |
610 | 610 | | |
611 | | - | |
612 | | - | |
613 | | - | |
| 611 | + | |
| 612 | + | |
| 613 | + | |
| 614 | + | |
| 615 | + | |
614 | 616 | | |
615 | 617 | | |
616 | 618 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
50 | 50 | | |
51 | 51 | | |
52 | 52 | | |
| 53 | + | |
53 | 54 | | |
54 | 55 | | |
55 | 56 | | |
| |||
65 | 66 | | |
66 | 67 | | |
67 | 68 | | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
68 | 81 | | |
69 | 82 | | |
70 | 83 | | |
| |||
176 | 189 | | |
177 | 190 | | |
178 | 191 | | |
| 192 | + | |
| 193 | + | |
| 194 | + | |
| 195 | + | |
| 196 | + | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
| 201 | + | |
| 202 | + | |
| 203 | + | |
| 204 | + | |
| 205 | + | |
| 206 | + | |
| 207 | + | |
| 208 | + | |
| 209 | + | |
| 210 | + | |
| 211 | + | |
| 212 | + | |
0 commit comments