Transformers
PlatformOpen-source library of model definitions and tooling for training and inference across text, vision, audio, multimodal, and other machine-learning tasks.
- Oct 11, 2018
- 2
- —
- Yes
- —
- 5
Models
| Model | Family | Released | Modality | Open source | API | Status |
|---|---|---|---|---|---|---|
| ModernBERTFamily | — | Dec 19, 2024 | textembedding | Yes | — | active |
| DistilBERT | — | Oct 2, 2019 | text | Yes | — | active |
Products
| Name | Type | Category | Launched | Latest release | Status |
|---|---|---|---|---|---|
| Open R1 | Product | — | Jan 2025 | Open R1 project launched | active |
| smolagents | Product | — | Dec 2024 | smolagents library released | active |
| Text Embeddings Inference | Product | — | Nov 2023 | Text Embeddings Inference released | active |
| Candle | Product | — | Aug 2023 | Candle Rust ML framework released | active |
| PEFT | Product | — | Dec 2022 | PEFT library released | active |
| Text Generation Inference | Product | — | Oct 2022 | TGI adds multiple inference backends | maintenance |
| TRL | Product | — | Aug 2022 | TRL training library released | active |
| Evaluate | Product | — | May 2022 | Evaluate library launched | active |
| SafeTensors | Product | — | Mar 2022 | SafeTensors introduced | active |
| Optimum | Product | — | Sep 2021 | Optimum optimization library launched | active |
| Accelerate | Product | — | Apr 2021 | Accelerate 1.0 release candidate | active |
| Tokenizers | Product | — | Mar 2020 | Tokenizers v1 released | active |
Releases
Sep 22, 2026Transformers adds native llama.cpp quant supportFeature update
Transformers added support for running llama.cpp GGUF quantized models within the library’s model-definition and inference workflows.
Dec 1, 2025Transformers v5 release candidateSDK release
Transformers v5 entered release candidate with simplified model definitions, standardized attention interfaces, and support for more than 400 architectures.
Nov 19, 2020Transformers v4 release candidateSDK release
Transformers v4 began its release cycle with broad framework and architecture support and a standardized model API.
Sep 26, 2019Library renamed TransformersSDK release
Hugging Face renamed pytorch-transformers to Transformers and expanded the library’s framework and architecture support.
Oct 11, 2018PyTorch-Pretrained-BERT releasedSDK release
Hugging Face released an open-source PyTorch implementation and pretrained checkpoints for BERT, the project that evolved into the Transformers library.