Releases

Microsoft Research introduces DeBERTa, improving Transformer language models with disentangled attention and enhanced mask decoding.

Databricks articulated the lakehouse architecture, combining data-lake openness with data-warehouse management and performance.

Google researchers publish the T5 approach and Colossal Clean Crawled Corpus, framing diverse NLP tasks in one text-to-text format.

Baidu published a continual pre-training framework for incremental multi-task learning.

Facebook AI introduced wav2vec, a self-supervised approach to speech representation learning from raw audio.

OpenAI Five defeated the reigning Dota 2 world champion team OG in a live best-of-three match.

FAIR researchers published a transformer language model that learned biological properties from protein sequences.

Baidu introduced knowledge-enhanced pre-training through ERNIE.

DeepMind's first AlphaFold system achieves top performance in the CASP13 protein-structure prediction assessment.

IBM Research demonstrated an AI system that generated evidence-backed arguments and debated a human expert.

OpenAI published the original GPT approach: generative pre-training followed by discriminative fine-tuning.

DeepMind publishes AlphaZero, a general self-play reinforcement-learning system for multiple board games.

Microsoft introduces Project Brainwave, an FPGA-based architecture for real-time deep-learning inference in cloud and edge systems.

OpenAI introduced PPO, a family of policy-gradient methods designed for stability and simplicity.

OpenAI and DeepMind researchers showed how agents can learn complex behavior from human preference comparisons.

Google researchers introduce the Transformer architecture, replacing recurrence with attention and reshaping modern sequence modeling.

DeepMind introduces WaveNet, a neural generative model for raw audio waveforms that substantially improves speech synthesis.

AlphaGo wins its landmark five-game match against 18-time world champion Lee Sedol by four games to one.

AlphaGo becomes the first computer program to defeat a professional Go player without handicaps on a full-sized board.

AlexNet, trained on NVIDIA GPUs, won the ImageNet competition and helped catalyze modern deep learning adoption.

IBM Watson defeated champions Ken Jennings and Brad Rutter in the Jeopardy! exhibition, demonstrating large-scale open-domain question answering.

IBM's Deep Blue defeated world chess champion Garry Kasparov in a six-game match.

IBM researchers began foundational work in machine learning, game-playing systems and artificial intelligence during the field's formative era.