Skip to content
The Artificial Index

Transformer

Model Family

Release date and specs of Google (Alphabet)'s AI model family

The attention-based neural-network architecture introduced by Google researchers in Attention Is All You Need.

Released
Jun 12, 2017
Context window
—
Modality
—
Open source
—
API available
—
Releases
1

Releases

1
Jun 12, 2017Attention Is All You Need introduces the TransformerTransformer

Google researchers introduce the Transformer architecture, replacing recurrence with attention and reshaping modern sequence modeling.

Transformer FAQ

When was Transformer released?

Transformer was released by Google (Alphabet) on Jun 12, 2017.