exposed controls, VLM import, prompt customization and related experiments - #631
Open
CCSSNE wants to merge 244 commits into
Open
exposed controls, VLM import, prompt customization and related experiments#631CCSSNE wants to merge 244 commits into
CCSSNE wants to merge 244 commits into
Conversation
Updated README to reflect changes in GPU unloading layers and template matching optimization.
Added a template selector switch for chat formatting options.
- Android 原生 HTTP/SSE 传输(Kotlin ServerSocket,零新增依赖) - GET /v1/models 与 POST /v1/chat/completions(流式 SSE + 非流式) - 工具调用透传 + 老版 functions/function_call 转译,思维链 reasoning_content 输入输出 - MCP 工具注册表与命名空间合并,客户端 MCP 经标准 tool 循环透明支持 - FIFO 排队与 UI 聊天互斥;Bearer/x-api-key 鉴权默认开启 - 侧边栏新增 API 服务页:启停、局域网地址复制、端口/Key/自启动、请求日志
Added a notice about the project being discontinued and the focus on separating frontend and backend responsibilities.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Since the majority of the users of this application are those who wish to gain a deeper understanding of large models, I place greater emphasis on learning and exploration. I try to provide more parameters for users to debug, with easy recovery from incorrect adjustments, while exposing as much of the pipeline as possible so users can clearly see the model’s inputs, outputs, and adjustment methods. Because the chain is fully controllable, when the model encounters issues, configurations can be adjusted directly instead of waiting for code-level changes, making experimentation more flexible.
This branch represents a working implementation that I have been using and testing on my side.
I intentionally squashed this into a single commit, since the original commit history mostly reflected the development process and was quite messy, making it unsuitable for review.
If some of the directions here seem useful or aligned with the project, I can help isolate and clean those parts into proper commits or smaller PRs later.
This fork mainly reflects my own usage needs.
Main changes in this fork include:
One thing I originally intended to add but did not complete:
The README in my fork also summarizes the general direction of these changes.
Platform Affected
Checklist