Ghost Infer — Fast local LLM inference and chat app for consumer GPUs ✓ Verified
Also known as: ghost-infer
Released Oct 2026
Added to TheBestApplications on Nov 14, 2026
AI · PC
No reviews yet — be the first to try it.
⭐ 104 GitHub Stars (popularity on GitHub — not a user rating)
About this app
Ghost-infer is a high-performance local LLM inference engine packaged as a single Rust binary, built specifically for individual users with consumer GPUs. It features support for GGUF models, an OpenAI-compatible server API, and an included desktop application where models can interact directly with your local files. Optimized for speed, it excels at running models that exceed standard GPU VRAM capacities.
Reviews
Sign in with Google to leave a review.
No reviews yet.