Skip to content
The Artificial Index

DistilBERT

Model

Release date and specs of Hugging Face's AI model

Distilled version of BERT created by Hugging Face to retain much of BERT’s capability with substantially fewer parameters and faster inference.

Released
Oct 2, 2019
Context window
—
Modality
text
Open source
Yes
API available
—
Releases
1
Parameters
66M

Releases

1
Oct 2, 2019DistilBERT releasedDistilBERT

Hugging Face released DistilBERT, a smaller and faster distilled BERT model retaining most of the teacher model’s language-understanding performance.

DistilBERT FAQ

When was DistilBERT released?

DistilBERT was released by Hugging Face on Oct 2, 2019.

Is DistilBERT open source?

Yes. DistilBERT is listed as open source (open weights).