llmfit

Hundreds of models & providers. One command to find what runs on your hardware.

English · 中文 New: Community Leaderboard — Browse real world performance data from actual users. Press b to see measured tok/s, TTFT, and VRAM for any GPU — not just yours. It has reached 26,669 GitHub stars, written primarily in Rust.

Why now: A young repository (3 months old) gaining early traction in its category.

• 26,669 GitHub stars, 1,611 forks — verifiable at github.com/AlexsJones/llmfit.
• Primary language Rust; topics: gguf, llm, localai, mlx.
• Licensed MIT.

Considerations: Solid adoption (26,669 stars) but quiet cross-source signal right now — established utility more than a current breakout.

ESTABLISHED LEADER · Build on it: Proven at scale (Rust) — safe to evaluate for production use or coverage; the open question is fit, not validity.

Sources: AlexsJones/llmfit on GitHub