A framework for efficient model inference with omni-modality models
GitHub repository
https://github.com/vllm-project/vllm-omniLicense
Apache-2.0
Stars
7,506
This is an independent tool overview. Check the project repository for current releases, compatibility, and installation requirements.