Skip to content

[Engine] OpenAI logprobs / top_logprobs / allowed_token_ids for the CUDA/HIP engine - #3200

Closed
xiezhipeng-git wants to merge 17 commits into
Niko1221:mainfrom
xiezhipeng-git:feat/openai-logprobs
Closed

[Engine] OpenAI logprobs / top_logprobs / allowed_token_ids for the CUDA/HIP engine#3200
xiezhipeng-git wants to merge 17 commits into
Niko1221:mainfrom
xiezhipeng-git:feat/openai-logprobs

[Engine] score generated token logprobs on GPU (#2)

3b6145f
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs