Skip to content

Fix logprobs when multiple tokens are returned at once.#141

Open
zewt wants to merge 2 commits into
theroyallab:mainfrom
zewt:logprobs
Open

Fix logprobs when multiple tokens are returned at once.#141
zewt wants to merge 2 commits into
theroyallab:mainfrom
zewt:logprobs

Logprobs fixes for streaming chat/completions.

958e222
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs