Skip to main content

Deployment

On-premise​

LLMStack can be deployed on-premise on your infrastructure. You can deploy LLMStack on a single machine or on a cluster of machines. LLMStack is a collection of microservices that can be deployed using docker compose on a single machine or a cluster using docker swarm.

Docker Compose​

Docker Compose is the easiest way to deploy LLMStack on a single machine. You can deploy LLMStack on a single machine by following the instructions in our Getting Started guide.

Cloud offering​

LLMStack is also available as a cloud offering at Promptly. You can sign up for free tier at https://trypromptly.com and give LLMStack for a spin without local installation.