LocalAI

LocalAI is an open-source platform for running AI models locally with an OpenAI-compatible API. It allows you to run language models, image generation models, speech-to-text, text-to-speech, and other AI workloads on your own infrastructure.

About Hosting LocalAI

This dFlow template deploys LocalAI as a single service using Docker. Once deployed, you can run supported AI models on your own infrastructure and access them through OpenAI-compatible APIs.

Common Use Cases

• Run AI models on your own infrastructure
• Use an OpenAI-compatible API with local models
• Run language models and embeddings
• Generate images using supported models
• Add speech-to-text and text-to-speech capabilities
• Build private AI applications without depending on external AI APIs

Dependencies

• LocalAI

Why Deploy on dFlow?

Deploy LocalAI in minutes with persistent storage, environment variable management, custom domains, and centralized application management—all from a single dashboard.