Releases

MosaicML released MosaicBERT, an optimized BERT architecture designed to pretrain high-quality models at much lower cost.

Cohere established Command as its principal family of enterprise generative language models.

Cohere released Command Light as a lower-latency generation option for enterprise text workloads.

Cohere introduced the Command generation family for enterprise summarization, conversation and text workflows.

Meta released the first LLaMA model family for approved research use, spanning 7B to 65B parameters.

OpenAI released text-embedding-ada-002, replacing multiple earlier embedding models with a more capable and lower-cost model.

Meta withdrew the public Galactica demo after criticism over unreliable and misleading generated scientific content.

Meta AI released a research demo of Galactica, a large language model trained on scientific knowledge.

BigScience released BLOOMZ and mT0, instruction-finetuned multilingual models derived from BLOOM and the xP3 task collection.

Cohere released its second-generation multilingual embedding model for semantic search across more than 100 languages.

Cohere established its Rerank family of cross-encoder relevance models for search pipelines.

Meta released EnCodec, a neural audio codec for high-fidelity compression.

OpenAI released Whisper, a multilingual speech-recognition model, together with model weights and inference code.

The BigScience workshop released BLOOM, a 176-billion-parameter multilingual language model trained on the Jean Zay supercomputer.

Meta released NLLB-200, a machine-translation model covering 200 languages.

Meta released the Open Pretrained Transformer family and provided OPT-175B access to researchers.

OpenAI introduced DALL-E 2 with higher-resolution image generation and editing capabilities.

OpenAI introduced instruction-following models trained with human feedback.

Cohere introduced its Embed model family for semantic representation and retrieval.

Microsoft releases DeBERTa V3 with replaced-token detection and gradient-disentangled embedding sharing.

OpenAI introduced Codex, a descendant of GPT-3 that translates natural language into code.

DeepMind publishes AlphaFold 2's methodology and releases source code, expanding access to high-accuracy protein prediction.

Google introduces LaMDA as a conversational language model designed for open-ended dialogue.

OpenAI introduced CLIP, a neural network trained on image-text pairs for transferable visual recognition.

OpenAI introduced DALL-E, a model that generates images from text descriptions.