Self-Hosted Index

Categories / Generative Artificial Intelligence (GenAI)

LLMKube

Kubernetes operator for LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API.

Website
https://llmkube.com
Source code
https://github.com/defilantech/LLMKube
GitHub stars
248
Repository activity
31 October 2026
Latest release
v0.10.14, 29 October 2026
Health
Active From the repository record in this build
License
Apache-2.0
Platforms
Go, Docker, K8S
Categories
Generative Artificial Intelligence (GenAI)

More in Generative Artificial Intelligence (GenAI)

  • Ollama

    Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

    Replaces ChatGPT, OpenAI API

    185,432 stars Active

    30 Oct 2026 v0.40.13

  • Open-WebUI

    User-friendly AI Interface, supports Ollama, OpenAI API.

    Replaces ChatGPT, Claude

    157,350 stars Active

    29 Oct 2026 v0.12.5

  • LobeHub

    Modern design AI chat framework supporting multiple AI providers, one click install MCP Marketplace and Artifacts / Thinking.

    Replaces ChatGPT, Claude

    83,632 stars Active

    31 Oct 2026 v0.0.0-nightly.pr21992.37446

  • AnythingLLM

    All-in-one desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.

    Replaces ChatGPT, Claude

    67,784 stars Active

    30 Oct 2026 v1.19.0

  • LocalAI

    Run your AI models locally and generate images and audio.

    Replaces OpenAI API

    50,087 stars Active

    30 Oct 2026 v4.12.1