LLM Inference Engines
15 repos0 with live data
Curated list from OSS Insight (Apache 2.0) — attribution.
| CHART | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
#1 | EricLBuehler/mistral.rs | 0 | — | — | — | — | 0 | |||
#2 | ggml-org/llama.cpp | 0 | — | — | — | — | 0 | |||
#3 | huggingface/text-generation-inference | 0 | — | — | — | — | 0 | |||
#4 | jmorganca/ollama-js | 0 | — | — | — | — | 0 | |||
#5 | kvcache-ai/ktransformers | 0 | — | — | — | — | 0 | |||
#6 | lm-sys/FastChat | 0 | — | — | — | — | 0 | |||
#7 | mlc-ai/web-llm | 0 | — | — | — | — | 0 | |||
#8 | Mozilla-Ocho/llamafile | 0 | — | — | — | — | 0 | |||
#9 | mudler/LocalAI | 0 | — | — | — | — | 0 | |||
#10 | nomic-ai/gpt4all | 0 | — | — | — | — | 0 | |||
#11 | ollama/ollama | 0 | — | — | — | — | 0 | |||
#12 | oobabooga/text-generation-webui | 0 | — | — | — | — | 0 | |||
#13 | open-webui/open-webui | 0 | — | — | — | — | 0 | |||
#14 | sgl-project/sglang | 0 | — | — | — | — | 0 | |||
#15 | vllm-project/vllm | 0 | — | — | — | — | 0 |
SHOWING 15 OF 15SORT RANK ASC