Skip to content

alan-sun-dev/proxmox-llm-gateway-deployer

Repository files navigation

Proxmox LLM Gateway Deployer

License: MIT Version Proxmox

Enterprise-grade automation script for deploying LiteLLM API gateway on Proxmox VE with full monitoring stack.

✨ Features

  • 🚀 One-Command Deployment: Fully automated VM provisioning and service configuration
  • 🔒 Production Security: UFW firewall, network isolation, auto-generated secrets
  • 📊 Built-in Monitoring: Optional Prometheus + Grafana stack
  • 🐳 Docker-based: PostgreSQL, Redis, LiteLLM in containerized environment
  • ☁️ Cloud-init Powered: Declarative infrastructure with Ubuntu cloud images
  • 🔄 Idempotent: Safe to re-run, detects existing deployments
  • 📝 Enterprise Ready: Comprehensive logging, validation scripts, error handling

🎯 Quick Start

Prerequisites

  • Proxmox VE 7.0+ host
  • Root access to Proxmox host
  • 8GB+ RAM available for VM
  • 60GB+ storage space

Basic Deployment

```bash curl -O https://raw.githubusercontent.com/alan-sun-dev/proxmox-llm-gateway-deployer/main/deploy-llm-gateway.sh chmod +x deploy-llm-gateway.sh sudo ./deploy-llm-gateway.sh ```

📋 Configuration

See config/llm-gateway.conf.example for all options.

📚 Documentation

📄 License

MIT License - see LICENSE file for details.


For complete documentation and full script, visit: https://github.com/alan-sun-dev/proxmox-llm-gateway-deployer

About

Enterprise-grade automation script for deploying LiteLLM API gateway on Proxmox VE

Resources

License

Stars

Watchers

Forks

Packages

 
 
 

Contributors

Languages