[Feature]: Multiple providers using the same model, create a combo to handle load balancing.

[guigeng]

Problem to solve

Multiple providers offering the same model can create aliases or combos that point to multiple backend providers.

Proposed solution

--

Alternatives considered

No response

Additional context

No response

[Wibias]

Yea, i know what ur talking about. I am doing two other things atm at this project, but thats something I also wanted to implement very soon.

[Wibias]

@guigeng Since I already had a concept for this in mind, can you please also give me some type of concept for what u wish for?

[guigeng]

Create a group, for example, named "free". When creating the group, you need to specify the backend model, such as Claude, GPT, or Deepseek. Client requests are sent to the model named "free" within this group. When the OCX receives the request, it forwards it to the backend model using load balancing strategies such as round-robin or weighted selection.

[Wibias]

@guigeng Alright. Will be the next one after i finish another little branch. Any Free Tier Providers u wish for to be implemented next?