Cloudeflare AI gateway intregation like openrouter

[biplabroy-1]

Feature Type

Nice to have

Feature Description

livekit have openai extended plugin like openai.with_openrouter
so like this way it will be openai.with_cloudflare

Workarounds / Alternatives

No response

Additional Context

No response

[mcdgavin]

Opened #6131 to add this.

It adds openai.LLM.with_cloudflare(...), routing through the Cloudflare AI Gateway's unified OpenAI-compatible (/compat) endpoint:

from livekit.plugins import openai

llm = openai.LLM.with_cloudflare(model="openai/gpt-4o")  # account_id + token from env

• Builds the gateway URL from account_id (env CLOUDFLARE_ACCOUNT_ID) + gateway_id (default "default"), with a base_url override.
• Dual auth: cf_aig_token → cf-aig-authorization, api_key → Authorization (BYOK).
• Optional gateway_options for per-request caching / retries / timeout / metadata / custom cost, mapped to the cf-aig-* headers.

Feedback welcome.