Skip to content
AIMarketCap

DistilBERT

Model
Hugging FacePart of Transformersactive

Distilled version of BERT created by Hugging Face to retain much of BERT’s capability with substantially fewer parameters and faster inference.

Released
Oct 2, 2019
Context window
—
Modality
text
Open source
Yes
API available
—
Releases
1

Releases

1
Oct 2, 2019DistilBERT releasedDistilBERT

Hugging Face released DistilBERT, a smaller and faster distilled BERT model retaining most of the teacher model’s language-understanding performance.

Hugging Face Model releaseHugging FaceDistilBERT