Skip to content

[Other] add legacy /v1/completions for raw-prompt clients #2277

Open

Description

@kossum

Area

Other

What do you want to do?

Use /v1/completions with clients that already build their own prompts. They need to send a string without having the server apply another chat template, and get the legacy OpenAI response format back (text_completion, cmpl- IDs and token usage). Both streaming and non-streaming requests are needed.

I checked the routes on main e88ee39d (0.2.0-beta). There is still no /v1/completions handler without the changes from #2278. I checked this in the source; I haven't repeated the request against an unmodified live release.

For now, the client has to be adapted to the chat API or used with another server that supports raw-prompt completions.

The implementation is in #3332, which replaces #2278 after GitHub wouldn't reopen it. The earlier review and fixes are in #2278.

Activity

  1. added a commit that references this issue on Oct 13, 2026
  2. Niko1221 commented on Oct 19, 2026

    @Niko1221
    Owner

    Thanks for taking the time to report this.

    We're resetting the tracker for 0.2.0-beta. There are more than 1,300 open issues and pull requests, too many for us to read properly, so we're closing everything that isn't being worked on right now. Closed here does not mean rejected.

    To reopen it takes about two minutes:

    1. Re-test on 0.2.0-beta. It may already be fixed. Write down what you see.
    2. Start the title with its area: [Engine], [GUI], [TUI], [Benchmark], [Docs] or [Other].
    3. Fill in the parts of the issue form: what happened, the Strata version, your graphics card, memory and system.
    4. Comment /reopen. A check runs and either reopens the issue or lists what is still missing.

    The rules are in CONTRIBUTING.md.

  3. changed the title [-]Feature: legacy completions on /v1/completions (raw-prompt clients)[/-] [+][Other] add legacy /v1/completions for raw-prompt clients[/+] on Oct 20, 2026
  4. kossum commented on Oct 20, 2026

    @kossum
    ContributorAuthor

    /reopen

  5. github-actions commented on Oct 20, 2026

    @github-actions

    Reopened, thank you. A maintainer will pick it up from here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions