stablyai/orca
remotion-dev/remotion
diegosouzapw/OmniRoute
docker-desktop-windows/docker-desktop
kepano/obsidian-skills Collection
LLM Inference Engines
The LLM Inference Engines collection tracks 15 curated open-source projects, 12 of them live on TrendingRepo right now — ranked by a cross-source momentum score blending GitHub star velocity with mentions on Hacker News, X, Bluesky, Product Hunt and Dev.to.
Live · top 15 repos · sorted by momentum across 24H
LIVE · 14m| # | Repository | Stars | 24h | 7d | 30d | Trend | Mentions | Actions |
|---|---|---|---|---|---|---|---|---|
| 01 |  open-webui/open-webui User-friendly AI Interface (Supports Ollama, OpenAI API, ...) | 146.8K | +94+0.1% | +736+0.5% | +3.9K+2.7% |     live on Hacker News | ||
| 02 |  ollama/ollama Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. | 176.9K | +48+0.0% | +433+0.2% | +2.3K+1.3% |  live on Hacker News | ||
| 03 |  vllm-project/vllm A high-throughput and memory-efficient inference and serving engine for LLMs | 87.2K | +3+0.0% | +511+0.6% | +2.8K+3.3% | live on X / Twitter | ||
| 04 |  mudler/LocalAI LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. | 47.9K | +3+0.0% | +176+0.4% | +715+1.5% | live on X / Twitter | ||
| 05 |  ggml-org/llama.cpp LLM inference in C/C++ | 121.7K | — | +608+0.5% | +3.6K+3.0% | live on Hacker News | ||
| 06 |  EricLBuehler/mistral.rs Fast, flexible LLM inference | 7.5K | +4+0.1% | +30+0.4% | +161+2.2% | live on X / Twitter | ||
| 07 |  kvcache-ai/ktransformers A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations | 19K | — | +306+1.6% | +1.7K+9.9% | live on X / Twitter | ||
| 08 |  sgl-project/sglang SGLang is a high-performance serving framework for large language models and multimodal models. | 30.8K | — | +221+0.7% | +1.2K+4.0% | live on Dev.to | ||
| 09 |  mlc-ai/web-llm High-performance In-browser LLM Inference Engine | 18.5K | +9+0.0% | +44+0.2% | +196+1.1% | live on X / Twitter | ||
| 10 |  lm-sys/FastChat An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena. | 39.5K | +2+0.0% | +10+0.0% | +60+0.2% | | ||
| 11 |  nomic-ai/gpt4all GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use. | 77.4K | -1-0.0% | +9+0.0% | +111+0.1% | live on Dev.to | ||
| 12 |  huggingface/text-generation-inference Large Language Model Text Generation Inference | 10.9K | — | +7+0.1% | +26+0.2% | | ||
| 13 | jmorganca/ollama-js No description published. | 0 | — | — | — | | ||
| 14 | Mozilla-Ocho/llamafile No description published. | 0 | — | — | — | | ||
| 15 | oobabooga/text-generation-webui No description published. | 0 | — | — | — | |