LLM inference in C/C++
GitHub repository
https://github.com/ggml-org/llama.cppLicense
MIT
Stars
133,242
Homepage
https://llama.app/This is an independent tool overview. Check the project repository for current releases, compatibility, and installation requirements.