DeBERTa
Model FamilyMicrosoftactive
Release date and specs of Microsoft's AI model family
Microsoft Research language-model family using disentangled attention and enhanced mask decoding.
- Released
- Jun 1, 2020
- Context window
- —
- Modality
- —
- Open source
- Yes
- API available
- —
- Releases
- 1
Models in this family
| Model | Family | Released | Modality | Open source | API | Status |
|---|---|---|---|---|---|---|
| DeBERTa | Nov 22, 2021 | — | Yes | — | active |
Releases
Jun 2020DeBERTa introducedResearch paper
Microsoft Research introduces DeBERTa, improving Transformer language models with disentangled attention and enhanced mask decoding.
DeBERTa FAQ
When was DeBERTa released?
DeBERTa was released by Microsoft on Jun 1, 2020.
Is DeBERTa open source?
Yes. DeBERTa is listed as open source (open weights).
Which models are part of DeBERTa?
The Artificial Index lists 1 model under DeBERTa: DeBERTa V3.

