AI Toolbase
Back to Tools
tt-metal

tt-metal

AI Model Training & Runtime

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

GitHub repository

https://github.com/tenstorrent/tt-metal

License

Apache-2.0

Stars

1,741

Homepage

https://docs.tenstorrent.com/tt-metal/latest/ttnn/

This is an independent tool overview. Check the project repository for current releases, compatibility, and installation requirements.

Alternatives and related tools

vllm

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

sglang

sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

llama.cpp

llama.cpp

LLM inference in C/C++