kvcached

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

GitHub repository

License

Apache-2.0

Stars

2,020

This is an independent tool overview. Check the project repository for current releases, compatibility, and installation requirements.

Alternatives and related tools

On-device AI assistant for terminal and Android tasks.

Desktop Companion for Hermes Agent

Hermes WebUI: The best way to use Hermes Agent from the web or from your phone!