GPT

/dʒiː piː tiː/ · Abbreviation · AI & Machine Learning · Origin: 2018

Definitions

  1. Generative Pre-trained Transformer — OpenAI's series of large language models. GPT-3 (2020) demonstrated emergent abilities; GPT-3.5 powered the original ChatGPT; GPT-4 (2023) showed multimodal capabilities. The series that made 'AI' a dinner-table conversation topic.

    In plain English: The AI model series by OpenAI that powers ChatGPT — trained on vast amounts of text, it can write, code, analyze, and reason about almost any topic.

  2. The 'T' in GPT — Transformer — is the architectural innovation. The 'P' — Pre-trained — reflects the two-phase approach: expensive pre-training on internet-scale data, followed by cheaper fine-tuning for specific tasks. This approach made LLMs economically viable.

    Example: 'GPT is just a brand name. The real innovation is the transformer architecture — Google invented it, OpenAI scaled it, and now everyone uses it.'

    Source: acronym breakdown / architecture

Etymology

2018
OpenAI publishes 'Improving Language Understanding by Generative Pre-Training,' introducing the GPT architecture with 117M parameters
2020
GPT-3's 175B parameters demonstrate emergent abilities — few-shot learning, code generation — that surprise even its creators
2022
ChatGPT (based on GPT-3.5) becomes the fastest-growing consumer application in history, making GPT a household acronym

Related Terms