vllm-ascend

Community maintained hardware plugin for vLLM on Ascend

GitHub repository

License

Apache-2.0

Stars

3,041

Homepage

This is an independent tool overview. Check the project repository for current releases, compatibility, and installation requirements.

Alternatives and related tools

On-device AI assistant for terminal and Android tasks.

Desktop Companion for Hermes Agent

Hermes WebUI: The best way to use Hermes Agent from the web or from your phone!