MNN

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

GitHub repository

License

Apache-2.0

Stars

16,344

Homepage

This is an independent tool overview. Check the project repository for current releases, compatibility, and installation requirements.

Alternatives and related tools

On-device AI assistant for terminal and Android tasks.

Desktop Companion for Hermes Agent

Hermes WebUI: The best way to use Hermes Agent from the web or from your phone!