Skip to content
This repository was archived by the owner on Mar 21, 2026. It is now read-only.

Pull requests: huggingface/text-generation-inference

39 Open 1,673 Closed
39 Open 1,673 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Remove dead bitsandbytes CxB code from 8-bit inference path
#3356 opened Feb 16, 2026 by TimDettmers Loading…
1 task
test(config): add comprehensive tests for router config utilities
#3349 opened Dec 27, 2025 by yurekami Loading…
2 tasks
Upgrade GitHub Actions to latest versions
#3348 opened Dec 20, 2025 by salmanmkc Loading…
Upgrade GitHub Actions for Node 24 compatibility
#3347 opened Dec 20, 2025 by salmanmkc Loading…
fix: don't use kernel layernorm on Blackwell architecture to avoid "no kernel image" error
#3343 opened Dec 11, 2025 by AdamPalaxo Loading…
1 of 5 tasks
feat: prefer latest outlines core and compile grammar in router
#3340 opened Nov 14, 2025 by drbh • Draft
fix: bump flake and update grammar logit processor
#3338 opened Nov 6, 2025 by drbh • Draft
feat: expose GPU energy consumption (mJ) in responses
#3315 opened Aug 28, 2025 by JulienDelavande Loading…
2 of 5 tasks
1
Add dedicated CPU-only Dockerfile and update documentation for CPU/…
#3310 opened Aug 7, 2025 by jakubgajski Loading…
2 of 5 tasks
support qwen3 on nvidia
#3302 opened Jul 23, 2025 by icyxp Loading…
4
Retrieve the correct cached model batch size in Neuron config checker for Neuron Backend
#3300 opened Jul 19, 2025 by jimburtoft Loading…
3 tasks
Attempt to fix CI errors
#3292 opened Jul 8, 2025 by danieldk Loading…
5 tasks
fix: enable defs references in tool calls
#3291 opened Jul 7, 2025 by drbh Loading…
Update quantization kernels
#3288 opened Jul 7, 2025 by danieldk • Draft
5 tasks
feat: allow json_schema in response format and add test
#3276 opened Jun 25, 2025 by drbh Loading…
3
Disable mamba in CPU platform
#3266 opened Jun 13, 2025 by casassg Loading…
3 of 5 tasks
feat: improve llava next pooling for granite vision
#3255 opened Jun 4, 2025 by drbh Loading…
Trtllm backend improvements
#3231 opened May 17, 2025 by leejuyuu Loading…
1 of 5 tasks
1
3
Fix typos
#3210 opened May 6, 2025 by omahs Loading…
1 of 5 tasks
feat: lock updated kernel versions
#3201 opened Apr 29, 2025 by drbh Loading…
Set uv UV_PYTHON_INSTALL_DIR explicitly
#3197 opened Apr 27, 2025 by sebastianliebscher Loading…
1 of 5 tasks
2
2
README: minimum Python version is 3.10
#3194 opened Apr 25, 2025 by Frenzie Loading…
1 of 5 tasks
feat: support logit bias in chat request
#3186 opened Apr 22, 2025 by drbh Loading…
29
Fix flashinfer plan call to use positional arguments for #3165
#3166 opened Apr 11, 2025 by ruckc Loading…
2 of 5 tasks
1
1
Update to flashinfer 0.2.5
#3164 opened Apr 11, 2025 by danieldk • Draft
5 tasks
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.