Skip to content

Commit bb2f10b

Browse files
support llamacpp backends now (#85)
1 parent 0aabb8f commit bb2f10b

54 files changed

Lines changed: 5089 additions & 190 deletions

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

Cargo.lock

Lines changed: 15 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

Cargo.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -34,7 +34,7 @@ axum = "0.8"
3434
tower = "0.4"
3535
tower-http = { version = "0.5", features = ["cors", "timeout"] }
3636
hyper = { version = "1", features = ["client", "http1"] }
37-
reqwest = { version = "0.11", features = ["json"] }
37+
reqwest = { version = "0.11", features = ["json", "stream"] }
3838

3939
# Configuration management / 配置管理
4040
figment = { version = "0.10", features = ["toml", "env"] }

README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -109,10 +109,10 @@ SPEARlet can import models from a local Ollama on startup and materialize them a
109109

110110
## Web Admin
111111

112-
Web Admin provides Nodes/Tasks/Files/Backends pages.
112+
Web Admin provides Nodes/Tasks/Files/AI Models pages.
113113

114-
- Backends supports an aggregated view across nodes.
115-
- Clicking a backend row opens a detail dialog with Raw JSON.
114+
- AI Models provides an aggregated view across nodes, split into Local/Remote.
115+
- Local AI Models supports creating/deleting model deployments on a node.
116116

117117
Docs:
118118

README.zh.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -109,10 +109,10 @@ SPEARlet 支持在启动时从本机 Ollama 导入模型并生成对应的 LLM b
109109

110110
## Web Admin
111111

112-
Web Admin 提供 Nodes/Tasks/Files/Backends 等页面。
112+
Web Admin 提供 Nodes/Tasks/Files/AI Models 等页面。
113113

114-
- Backends 提供跨节点聚合视图
115-
- 点击某个 backend 行会弹出详情窗口(Raw JSON)
114+
- AI Models 提供跨节点聚合视图,并区分 Local/Remote
115+
- Local AI Models 支持在节点上创建/删除 model deployment
116116

117117
文档:
118118

assets/admin/main.css

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

assets/admin/main.js

Lines changed: 23 additions & 23 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

build.rs

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -23,6 +23,7 @@ fn main() -> Result<(), Box<dyn std::error::Error>> {
2323
"proto/sms/task.proto",
2424
"proto/sms/placement.proto",
2525
"proto/sms/mcp_registry.proto",
26+
"proto/sms/model_deployment_registry.proto",
2627
],
2728
&["proto"],
2829
)?;

0 commit comments

Comments
 (0)