vllm模式下运行minicpm-o-4.5 无法进行tts

[cannonnbbbbb]

目前已通过源码编译VLLM：
Name: vllm
Version: 0.1.dev13681+g55b7b04a3.precompiled
Summary: A high-throughput and memory-efficient inference and serving engine for LLMs
Home-page: https://github.com/vllm-project/vllm
Author: vLLM Team
Author-email:
License-Expression: Apache-2.0
Requires: aiohttp, anthropic, blake3, cachetools, cbor2, cloudpickle, compressed-tensors, depyf, diskcache, einops, fastapi, filelock, flashinfer-python, gguf, grpcio, grpcio-reflection, ijson, lark, llguidance, lm-format-enforcer, mcp, mistral_common, model-hosting-container-standards, msgspec, ninja, numba, numpy, openai, openai-harmony, opencv-python-headless, outlines_core, partial-json-parser, pillow, prometheus-fastapi-instrumentator, prometheus_client, protobuf, psutil, py-cpuinfo, pybase64, pydantic, python-json-logger, pyyaml, pyzmq, ray, regex, requests, sentencepiece, setproctitle, tiktoken, tokenizers, torch, torchaudio, torchvision, tqdm, transformers, typing_extensions, watchfiles, xgrammar
Required-by:

但是无法实现音频输出，请问有官方的TTS推理代码吗？

[tc-mb]

您好，vllm 目前支持音频输入的理解推理，但暂不支持 TTS 音频输出。如需 TTS 功能，可以参考 transformers 方式进行推理，或使用 C++ llama-server 方案（详见 https://github.com/tc-mb/llama.cpp-omni ）。如有其他问题欢迎继续交流。