Skip to content

添加OpenAI兼容HTTP服务可访问应用内的模型、增加BGE嵌入代理支持 ,记忆库可调用内部llama.嵌入模型。Add an OpenAI-compatible HTTP service to access in-app models, add support for a BGE embedding proxy, and enable the memory library to call the internal llama embedding model.#527

Open
feikukuai wants to merge 2 commits into
AAswordman:mainfrom
feikukuai:main

Conversation

@feikukuai
Copy link
Copy Markdown
Contributor

@feikukuai feikukuai commented May 12, 2026

-添加OpenAI兼容HTTP服务可访问应用内的模型、增加BGE嵌入代理支持 ,记忆库可调用内部llama.嵌入模型。
-Add an OpenAI-compatible HTTP service to access in-app models, add support for a BGE embedding proxy, and enable the memory library to call the internal llama embedding model
591282152-309afb4d-94af-4528-9959-de279a1b66cd
591282187-884142dd-ceaa-42f7-b2eb-ed8ddb61e522

feihu added 2 commits May 13, 2026 00:24
- 新增 OpenAiCompatHttpServer: 完整的OpenAI兼容API服务
  - /v1/chat/completions (流式+同步)
  - /v1/completions (legacy格式)
  - /v1/embeddings (MNN/LLaMA/Cloud)
  - /v1/models (模型列表)
  - 完整CORS支持,多种认证方式
  - SSE流式+模拟流式双模式
- MNNProvider: 添加视觉/音频模型自动检测
- ModelListFetcher: 改进模型列表获取
- MNNLlmSession: 添加嵌入模型检测和嵌入生成
- MNNLlmNative: 新增嵌入相关JNI接口
- mnnllmnative.cpp: 新增嵌入向量计算native实现
- LlamaSession/LlamaNative: 同步嵌入接口
- FloatingChatService/WindowManager: 浮窗服务改进
- 新增 OpenAiCompatPreferences.kt, OpenAiCompatModels.kt, OpenAiCompatSettingsScreen.kt
- 新增 OnnxVoiceProvider.kt (ONNX语音引擎)
- 更新服务核心: AIForegroundService, ChatServiceCore, ApiConfigDelegate
- 更新工具系统: JsEngine, ToolPkgParser, ToolPkgCommonBridgePlugin 等
- 更新市场UI: Market/Artifact/Skill/MCP 管理页面
- 更新多语言资源 strings.xml (6种语言)
- 更新 ChatViewModel, AIChatScreen, SettingsScreen 等UI组件
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant