A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators.
GitHub repository
https://github.com/xLLM-AI/xllmLicense
Apache-2.0
Stars
1,616
Homepage
https://xllm-ai.com/This is an independent tool overview. Check the project repository for current releases, compatibility, and installation requirements.