LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
GitHub repository
https://github.com/jundot/omlxLicense
Apache-2.0
Stars
23,310
Homepage
https://omlx.ai/This is an independent tool overview. Check the project repository for current releases, compatibility, and installation requirements.