Skip to content

feat: add Cheaper Inference as a named AI provider - #589

Open
aiapienthusiast wants to merge 1 commit into
di-sukharev:masterfrom
aiapienthusiast:cheaperinference-provider
Open

aiapienthusiast wants to merge 1 commit into
di-sukharev:masterfrom
aiapienthusiast:cheaperinference-provider

Conversation

@aiapienthusiast

Copy link
Copy Markdown

What

This PR adds Cheaper Inference as a named AI provider.
It uses the same pattern as #582.

Cheaper Inference is an OpenAI-compatible LLM gateway.

Cheaper Inference is one of the fastest-growing AI routers.
Each model costs 15–60% less than the list price of its lab.

How to use

oco config set OCO_AI_PROVIDER=cheaperinference OCO_API_KEY=<key>

The default model is gpt-5.4-mini.

Details

Changes:

  • New CheaperInferenceEngine. It extends OpenAiEngine.
  • Provider in the enum, config, setup wizard, error hints and model cache.
  • The model cache keeps only text models.
  • README section and unit tests.
  • out/cli.cjs rebuilt with npm run build.

Tests:

  • npm run lint: passed.
  • npm run format:check: passed.
  • npm run test:unit: 190 passed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant