FastDeploy

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

GitHub repository

License

Apache-2.0

Stars

3,724

Homepage

This is an independent tool overview. Check the project repository for current releases, compatibility, and installation requirements.

Alternatives and related tools

On-device AI assistant for terminal and Android tasks.

Desktop Companion for Hermes Agent

Hermes WebUI: The best way to use Hermes Agent from the web or from your phone!