Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.
guoqingbao/xinfer has added +221 stars since the first tracked point, with current momentum at 12.20.