Skip to content

Commit 2effd41

Browse files
committed
docs: Add Mistral and Moonshot provider documentation
Add complete documentation for Mistral and Moonshot LLM providers: - Add provider cards with authentication and vision support details - Add configuration sections with environment variables - Add API usage examples for both providers - Update architecture diagrams to include both providers - Update provider lists in API reference - Regenerate search index and sitemap Signed-off-by: Eden Reich <eden.reich@gmail.com>
1 parent 1abb0e4 commit 2effd41

6 files changed

Lines changed: 120 additions & 14 deletions

File tree

markdown/api-reference.mdx

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -73,7 +73,7 @@ Get a list of available models for a specific provider.
7373
GET /v1/models?provider={provider}
7474
```
7575

76-
where `{provider}` is one of: `openai`, `anthropic`, `cohere`, `groq`, `cloudflare`, `ollama`, `deepseek`.
76+
where `{provider}` is one of: `openai`, `anthropic`, `cohere`, `groq`, `cloudflare`, `ollama`, `deepseek`, `mistral`, `moonshot`.
7777

7878
**Response**:
7979

@@ -476,6 +476,7 @@ curl -X POST http://localhost:8080/v1/chat/completions \
476476
- Ollama (LLaVA, Llama 4, Llama 3.2 Vision)
477477
- Groq (vision models)
478478
- Mistral (Pixtral)
479+
- Moonshot (vision models)
479480

480481
**Note:** When `ENABLE_VISION=false` (default), requests containing image content will be rejected even if the model supports vision. This is disabled by default for performance and security reasons.
481482

markdown/architecture-overview.mdx

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -30,6 +30,8 @@ graph TD
3030
P --> H1["💬 Cohere"]
3131
P --> H2["🧠 Anthropic"]
3232
P --> H3["🐋 DeepSeek"]
33+
P --> H4["🌟 Mistral"]
34+
P --> H5["🌙 Moonshot"]
3335
3436
%% Define styles
3537
classDef client fill:#9370DB,stroke:#333,stroke-width:1px,color:white;
@@ -41,7 +43,7 @@ graph TD
4143
class A client;
4244
class Auth auth;
4345
class IG1,IG2,IG3,P gateway;
44-
class C,D,E,G,H1,H2,H3 provider;
46+
class C,D,E,G,H1,H2,H3,H4,H5 provider;
4547
```
4648

4749
## Kubernetes Setup
@@ -103,6 +105,8 @@ graph TD
103105
Ext5["💬 Cohere"]
104106
Ext6["🚀 Groq"]
105107
Ext7["🐋 DeepSeek"]
108+
Ext8["🌟 Mistral"]
109+
Ext9["🌙 Moonshot"]
106110
end
107111
end
108112
@@ -121,7 +125,7 @@ graph TD
121125
class Pod1,Pod2,Pod3 pod;
122126
class Prometheus,Grafana monitoring;
123127
class SM monitor;
124-
class Ext1,Ext2,Ext3,Ext4,Ext5,Ext6,Ext7 externalSvc;
128+
class Ext1,Ext2,Ext3,Ext4,Ext5,Ext6,Ext7,Ext8,Ext9 externalSvc;
125129
class IG1,IG2,IG3,PG1,PG2,PG3 service;
126130
class InternalClients,InternalAgents internalClient;
127131
class ExternalProviders extProviders;

markdown/configuration.mdx

Lines changed: 28 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -239,6 +239,32 @@ Configure access to various LLM providers. At minimum, you should configure the
239239
]}
240240
/>
241241

242+
#### Mistral
243+
244+
<ConfigTable
245+
rows={[
246+
{
247+
variable: 'MISTRAL_API_URL',
248+
description: 'Mistral AI API URL',
249+
defaultValue: 'https://api.mistral.ai/v1',
250+
},
251+
{ variable: 'MISTRAL_API_KEY', description: 'Mistral AI API Key', defaultValue: '""' },
252+
]}
253+
/>
254+
255+
#### Moonshot
256+
257+
<ConfigTable
258+
rows={[
259+
{
260+
variable: 'MOONSHOT_API_URL',
261+
description: 'Moonshot AI API URL',
262+
defaultValue: 'https://api.moonshot.ai/v1',
263+
},
264+
{ variable: 'MOONSHOT_API_KEY', description: 'Moonshot AI API Key', defaultValue: '""' },
265+
]}
266+
/>
267+
242268
### Model Context Protocol (MCP) Settings
243269

244270
These settings control MCP integration for external tool access:
@@ -431,6 +457,8 @@ GOOGLE_API_URL=https://generativelanguage.googleapis.com/v1beta/openai
431457
GOOGLE_API_KEY=
432458
MISTRAL_API_URL=https://api.mistral.ai/v1
433459
MISTRAL_API_KEY=
460+
MOONSHOT_API_URL=https://api.moonshot.ai/v1
461+
MOONSHOT_API_KEY=
434462
```
435463

436464
## Configuration Best Practices

markdown/supported-providers.mdx

Lines changed: 78 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -102,12 +102,40 @@ The following LLM providers are currently supported:
102102
</div>
103103
</div>
104104

105+
<div className="border p-4 rounded-md">
106+
<h3>Google</h3>
107+
<p>Access Google's Gemini models for text generation and understanding.</p>
108+
<div>
109+
<strong>Authentication:</strong> Bearer Token
110+
</div>
111+
<div>
112+
<strong>Default URL:</strong> https://generativelanguage.googleapis.com/v1
113+
</div>
114+
<div>
115+
<strong>Vision Support:</strong> ✅ Yes (Gemini 2.5)
116+
</div>
117+
</div>
118+
119+
<div className="border p-4 rounded-md">
120+
<h3>Mistral</h3>
121+
<p>Access Mistral AI's models including vision-capable Pixtral.</p>
122+
<div>
123+
<strong>Authentication:</strong> Bearer Token
124+
</div>
125+
<div>
126+
<strong>Default URL:</strong> https://api.mistral.ai/v1
127+
</div>
128+
<div>
129+
<strong>Vision Support:</strong> ✅ Yes (Pixtral)
130+
</div>
131+
</div>
132+
105133
<div className="border p-4 rounded-md">
106-
<h3>Google</h3>
107-
<p>Access Google's Gemini models for text generation and understanding.</p>
134+
<h3>Moonshot</h3>
135+
<p>Use Moonshot AI's models for natural language and vision tasks.</p>
108136
<div><strong>Authentication:</strong> Bearer Token</div>
109-
<div><strong>Default URL:</strong> https://generativelanguage.googleapis.com/v1</div>
110-
<div><strong>Vision Support:</strong> ✅ Yes (Gemini 2.5)</div>
137+
<div><strong>Default URL:</strong> https://api.moonshot.ai/v1</div>
138+
<div><strong>Vision Support:</strong> ✅ Yes</div>
111139
</div>
112140
</div>
113141

@@ -130,6 +158,7 @@ ENABLE_VISION=true
130158
- **Ollama**: LLaVA, Llama 4, Llama 3.2 Vision
131159
- **Groq**: Vision models
132160
- **Mistral**: Pixtral
161+
- **Moonshot**: Vision models
133162

134163
### Example Vision Request
135164

@@ -167,7 +196,7 @@ Each provider requires specific configuration through environment variables:
167196
- `PROVIDER_API_URL`: The base URL for the provider's API
168197
- `PROVIDER_API_KEY`: The authentication key for the provider
169198

170-
Replace "PROVIDER" with the provider name (uppercase): OPENAI, ANTHROPIC, COHERE, GROQ, CLOUDFLARE, OLLAMA, GOOGLE, DEEPSEEK.
199+
Replace "PROVIDER" with the provider name (uppercase): OPENAI, ANTHROPIC, COHERE, GROQ, CLOUDFLARE, OLLAMA, GOOGLE, DEEPSEEK, MISTRAL, MOONSHOT.
171200

172201
### API Endpoints
173202

@@ -402,3 +431,47 @@ curl -X POST http://localhost:8080/v1/chat/completions?provider=google \
402431
]
403432
}'
404433
```
434+
435+
### Mistral Provider
436+
437+
Generate content with Mistral AI models:
438+
439+
```bash
440+
curl -X POST http://localhost:8080/v1/chat/completions?provider=mistral \
441+
-H "Content-Type: application/json" \
442+
-d '{
443+
"model": "mistral-large-latest",
444+
"messages": [
445+
{
446+
"role": "system",
447+
"content": "You are a helpful assistant."
448+
},
449+
{
450+
"role": "user",
451+
"content": "Explain the differences between supervised and unsupervised learning."
452+
}
453+
]
454+
}'
455+
```
456+
457+
### Moonshot Provider
458+
459+
Generate content with Moonshot AI models:
460+
461+
```bash
462+
curl -X POST http://localhost:8080/v1/chat/completions?provider=moonshot \
463+
-H "Content-Type: application/json" \
464+
-d '{
465+
"model": "moonshot-v1-8k",
466+
"messages": [
467+
{
468+
"role": "system",
469+
"content": "You are a helpful assistant."
470+
},
471+
{
472+
"role": "user",
473+
"content": "What are the key principles of clean code?"
474+
}
475+
]
476+
}'
477+
```

public/search-index.json

Lines changed: 1 addition & 1 deletion
Large diffs are not rendered by default.

public/sitemap.xml

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -20,13 +20,13 @@
2020
</url>
2121
<url>
2222
<loc>https://docs.inference-gateway.com/api-reference</loc>
23-
<lastmod>2025-11-15T21:47:42.264Z</lastmod>
23+
<lastmod>2026-01-23T21:03:58.862Z</lastmod>
2424
<changefreq>monthly</changefreq>
2525
<priority>0.8</priority>
2626
</url>
2727
<url>
2828
<loc>https://docs.inference-gateway.com/architecture-overview</loc>
29-
<lastmod>2025-04-15T17:06:58.875Z</lastmod>
29+
<lastmod>2026-01-23T21:04:37.908Z</lastmod>
3030
<changefreq>monthly</changefreq>
3131
<priority>0.8</priority>
3232
</url>
@@ -44,13 +44,13 @@
4444
</url>
4545
<url>
4646
<loc>https://docs.inference-gateway.com/configuration</loc>
47-
<lastmod>2025-11-21T18:09:56.661Z</lastmod>
47+
<lastmod>2026-01-23T21:03:37.726Z</lastmod>
4848
<changefreq>monthly</changefreq>
4949
<priority>0.8</priority>
5050
</url>
5151
<url>
5252
<loc>https://docs.inference-gateway.com/deployment</loc>
53-
<lastmod>2026-01-23T20:44:34.331Z</lastmod>
53+
<lastmod>2026-01-23T20:51:19.657Z</lastmod>
5454
<changefreq>monthly</changefreq>
5555
<priority>0.8</priority>
5656
</url>
@@ -92,7 +92,7 @@
9292
</url>
9393
<url>
9494
<loc>https://docs.inference-gateway.com/supported-providers</loc>
95-
<lastmod>2025-11-15T21:28:17.983Z</lastmod>
95+
<lastmod>2026-01-23T21:05:10.589Z</lastmod>
9696
<changefreq>monthly</changefreq>
9797
<priority>0.8</priority>
9898
</url>

0 commit comments

Comments
 (0)