Skip to content
The Artificial Index

DeBERTa

Model Family
Microsoftactive

Release date and specs of Microsoft's AI model family

Microsoft Research language-model family using disentangled attention and enhanced mask decoding.

Released
Jun 1, 2020
Context window
—
Modality
—
Open source
Yes
API available
—
Releases
1

Models in this family

1
ModelReleased

Releases

1
Jun 2020DeBERTa introducedDeBERTa

Microsoft Research introduces DeBERTa, improving Transformer language models with disentangled attention and enhanced mask decoding.

DeBERTa FAQ

When was DeBERTa released?

DeBERTa was released by Microsoft on Jun 1, 2020.

Is DeBERTa open source?

Yes. DeBERTa is listed as open source (open weights).

Which models are part of DeBERTa?

The Artificial Index lists 1 model under DeBERTa: DeBERTa V3.