TensorRT-LLM
PlatformNVIDIAactive
Open-source library for optimizing and accelerating large-language-model inference on NVIDIA GPUs.
- Oct 19, 2023
- —
- —
- Yes
- —
- 1
Releases
Oct 19, 2023NVIDIA makes TensorRT-LLM publicly availableSDK release
NVIDIA publicly released its open-source TensorRT-LLM library for optimized large-model inference.