File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change 22
33Train in Python. Serve in Rust.
44
5+ [ ![ CI] ( https://github.com/jordandelbar/edgeflow/actions/workflows/ci.yml/badge.svg )] ( https://github.com/jordandelbar/edgeflow/actions/workflows/ci.yml )
6+ [ ![ License: Apache 2.0] ( https://img.shields.io/badge/license-Apache--2.0-blue.svg )] ( LICENSE )
7+ [ ![ MSRV] ( https://img.shields.io/badge/MSRV-1.88-orange.svg )] ( Cargo.toml )
8+
59Edgeflow is an MLflow-compatible experiment tracker, model registry, and
610inference server, built for people who can't afford the memory tax of a
711Python serving stack. Models run as ONNX (ort or tract), pre/post
812processing runs as WASM, and deployments hot-swap without downtime.
913
10- ## Quickstart
14+ ![ Edgeflow deployment detail: live throughput, p50/p95/p99 latency, per-pod memory and health] ( docs/screenshots/deployment-detail.png )
15+
16+ ## What you get
17+
18+ - MLflow-compatible tracking and model registry
19+ - ONNX inference (ort or tract backend)
20+ - Hot-swap deploys with no downtime
21+ - WASM pre/post processing
22+ - Runs on Kubernetes (multi target deployments) or plain docker-compose (single target deployment)
23+ - OpenTelemetry metrics and traces out of the box
24+
25+ ## Demo Quickstart
1126
1227Bring up a local server and one inference pod:
1328
You can’t perform that action at this time.
0 commit comments