MosaicBERT
ModelRelease date and specs of Databricks's AI model
Optimized BERT architecture designed for substantially faster and lower-cost pretraining.
- Released
- Mar 9, 2023
- Context window
- —
- Modality
- —
- Open source
- —
- API available
- —
- Releases
- 1
Releases
Mar 9, 2023MosaicBERT releasedModel release
MosaicML released MosaicBERT, an optimized BERT architecture designed to pretrain high-quality models at much lower cost.
MosaicBERT FAQ
When was MosaicBERT released?
MosaicBERT was released by Databricks on Mar 9, 2023.

