Skip to content

Add nvidia-l40s as a valid TRT compilation target in inference-cli#2121

Merged
PawelPeczek-Roboflow merged 6 commits intomainfrom
kai/l40s-trt-compilation
Apr 3, 2026
Merged

Add nvidia-l40s as a valid TRT compilation target in inference-cli#2121
PawelPeczek-Roboflow merged 6 commits intomainfrom
kai/l40s-trt-compilation

Conversation

@mkaic
Copy link
Copy Markdown
Contributor

@mkaic mkaic commented Mar 16, 2026

What does this PR do?

Following the recent addition of an L40S TRT compilation service running on Crusoe, this PR adds L40S as a valid compilation target to inference-cli, allowing users to kick off L40S TRT compilation jobs from the terminal.

Type of Change

  • New feature (non-breaking change that adds functionality)

Testing

  • I have tested this change locally
  • I have added/updated tests for this change

Test details:
Successfully kicked off an L40S compilation from my terminal.

Checklist

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code where necessary, particularly in hard-to-understand areas
  • My changes generate no new warnings or errors
  • I have updated the documentation accordingly (if applicable)

Additional Context

N/A

@mkaic mkaic marked this pull request as ready for review April 1, 2026 23:27
@mkaic mkaic changed the title allow nvidia-l40s as trt compilation target in inference-cli (will run on crusoe) Add nvidia-l40s as a valid TRT compilation target in inference-cli Apr 3, 2026
@PawelPeczek-Roboflow PawelPeczek-Roboflow merged commit 2bcb887 into main Apr 3, 2026
43 of 45 checks passed
@PawelPeczek-Roboflow PawelPeczek-Roboflow deleted the kai/l40s-trt-compilation branch April 3, 2026 18:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants