Skip to content
AIMarketCap

MosaicBERT

Model
DatabricksPart of MosaicML Platformactive

Optimized BERT architecture designed for substantially faster and lower-cost pretraining.

Released
Mar 9, 2023
Context window
—
Modality
—
Open source
—
API available
—
Releases
1

Releases

1
Mar 9, 2023MosaicBERT releasedMosaicBERT

MosaicML released MosaicBERT, an optimized BERT architecture designed to pretrain high-quality models at much lower cost.

Databricks Model releaseDatabricksMosaicBERT