Releases

Hugging Face released DistilBERT, a smaller and faster distilled BERT model retaining most of the teacher model’s language-understanding performance.

OpenAI released the 774-million-parameter GPT-2 model and shared further analysis of misuse and detection.

OpenAI introduced MuseNet, a deep neural network for generating multi-instrument musical compositions.

Facebook open-sourced its Deep Learning Recommendation Model reference implementation.

Baidu released its first knowledge-enhanced language representation model.

OpenAI introduced GPT-2 and began a staged release process due to misuse concerns.

Google open-sources BERT, enabling bidirectional pre-training for language understanding and downstream NLP tasks.

OpenAI presented its five-agent Dota 2 system trained through large-scale self-play.

Baidu opened PaddlePaddle to the global developer community for deep learning, vision, speech and NLP.

Google releases TensorFlow as an open-source machine-learning framework, making internal deep-learning infrastructure broadly available.

IBM publicly demonstrated its DeepQA question-answering architecture through the Jeopardy! competition.