feat: add GGUF/GGML model worker using llama-cpp-python#3827

crawfordxx wants to merge 1 commit into

lm-sys:mainlm-sys/FastChat:mainfrom

crawfordxx:feat-gguf-model-supportcrawfordxx/FastChat:feat-gguf-model-supportCopy head branch name to clipboard