Skip to content
AIMarketCap

Text Generation Inference

Product
Hugging FacePart of Transformersmaintenance

Open-source server for high-performance text-generation inference, historically used across Hugging Face deployment products.

Launched
Oct 1, 2022
Models
—
Modality
—
Open source
Yes
API available
—
Releases
2

Releases

2
Jan 16, 2025TGI adds multiple inference backendsText Generation Inference

Text Generation Inference added a multi-backend architecture supporting vLLM and TensorRT-LLM alongside its native backend.

Hugging Face Feature updateHugging FaceText Generation Inference
Oct 2022Text Generation Inference releasedText Generation Inference

Hugging Face released Text Generation Inference, a production server optimized for large-language-model generation.

GitHub SDK releaseHugging FaceText Generation Inference