Transformer — AI Glossary

A transformer is the neural network architecture that powers virtually all modern large language models, including GPT, Claude, Gemini, and LLaMA. Introduced in the 2017 paper "Attention Is All You Need," transformers use self-attention mechanisms to process all input tokens in parallel rather than sequentially, enabling efficient training on massive datasets and strong performance on language tasks.