| icon | lucide/chess-rook |
|---|
Welcome to the OpenArc documentation! These docs are under construction but cover everything in the 2.0.3 README.
OpenArc includes a command line tool for controlling the server.
- openarc add — Add a model to the config.
- openarc list — List models added to the config.
- openarc serve — Start the OpenArc server.
- openarc load — Load a model from the config.
- openarc status — Check loaded models.
- openarc bench — Benchmarking tool for LLMs.
- openarc tool — OpenVINO utilities.
Models to get you started and where to find more!
OpenArc is deeply integrated with the Huggingface Ecosytem and has been written from the ground up to handle a ton of deployment complexity but still demands some calories to choose what models to use.
We are working on improving this process with experimental GGUF support coming, as well as a new frontend application similar to LM-Studio!
Below are some models to get started which are known to work.