Transformer
Model FamilyGoogle (Alphabet)active
Release date and specs of Google (Alphabet)'s AI model family
The attention-based neural-network architecture introduced by Google researchers in Attention Is All You Need.
- Released
- Jun 12, 2017
- Context window
- —
- Modality
- —
- Open source
- —
- API available
- —
- Releases
- 1
Releases
Jun 12, 2017Attention Is All You Need introduces the TransformerResearch paper
Google researchers introduce the Transformer architecture, replacing recurrence with attention and reshaping modern sequence modeling.
Transformer FAQ
When was Transformer released?
Transformer was released by Google (Alphabet) on Jun 12, 2017.

