feat: add fastllm worker for high-performance inference#3828

crawfordxx wants to merge 1 commit into

lm-sys:mainlm-sys/FastChat:mainfrom

crawfordxx:feat-fastllm-workercrawfordxx/FastChat:feat-fastllm-workerCopy head branch name to clipboard