transformer.txt

2017

The Transformer eight

The Transformer

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser and Illia Polosukhin introduced the Transformer in “Attention Is All You Need” — the architecture behind today’s large language models.

The people

  • Ashish Vaswani
  • Noam Shazeer
  • Niki Parmar
  • Jakob Uszkoreit
  • Llion Jones
  • Aidan N. Gomez
  • Łukasz Kaiser
  • Illia Polosukhin

Filed under

Key work

Attention Is All You Need (opens in new tab)

arXiv / NeurIPS, 2017

Sources