Collection

LLM Inference Engines

The LLM Inference Engines collection tracks 15 curated open-source projects, 2 of them live on TrendingRepo right now — ranked by a cross-source momentum score blending GitHub star velocity with mentions on Hacker News, X, Bluesky, Product Hunt and Dev.to.

Live · top 15 repos · sorted by momentum across 24H

LIVE · 41m

Velocity period:24h 7d 30dClick to re-sort top 15

#	Repository	Stars	24h	7d	30d	Mentions
01	mudler/LocalAI LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.	46.8K	+1+0.0%	+134+0.3%	+644+1.4%	live on X / Twitter
02	EricLBuehler/mistral.rs Fast, flexible LLM inference	7.3K	—	+36+0.5%	+165+2.3%	live on Bluesky
03	ggml-org/llama.cpp No description published.	0	—	—	—
04	huggingface/text-generation-inference No description published.	0	—	—	—
05	jmorganca/ollama-js No description published.	0	—	—	—
06	kvcache-ai/ktransformers No description published.	0	—	—	—
07	lm-sys/FastChat No description published.	0	—	—	—
08	mlc-ai/web-llm No description published.	0	—	—	—
09	Mozilla-Ocho/llamafile No description published.	0	—	—	—
10	nomic-ai/gpt4all No description published.	0	—	—	—
11	ollama/ollama No description published.	0	—	—	—
12	oobabooga/text-generation-webui No description published.	0	—	—	—
13	open-webui/open-webui No description published.	0	—	—	—
14	sgl-project/sglang No description published.	0	—	—	—
15	vllm-project/vllm No description published.	0	—	—	—

Showing 15 of 15 · ranked by momentum, velocity, and consensus

Prev Next