Transformer

Model Family

The attention-based neural-network architecture introduced by Google researchers in Attention Is All You Need.

Releases

Jun 12, 2017Attention Is All You Need introduces the TransformerTransformerResearch paper

Google researchers introduce the Transformer architecture, replacing recurrence with attention and reshaping modern sequence modeling.