Ai Glossary
Browse 863 ai terms defined in plain English, from the cultural dictionary of computing.
863 Ai Terms
- Ablation Study
- An artificial intelligence concept involving ablation study and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Adversarial Attack
- An artificial intelligence concept involving adversarial attack and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Adversarial Example
- An artificial intelligence concept involving adversarial example and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Adversarial Robustness
- An artificial intelligence concept involving adversarial robustness and its effect on model design, behavior, or deployment. It influences how models are...
- Agent Framework
- An artificial intelligence concept involving agent framework and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI Accelerator
- An artificial intelligence concept involving ai accelerator and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI alignment
- The research discipline concerned with ensuring that artificial intelligence systems reliably pursue goals and behaviors that are beneficial to humans....
- AI Alignment Debate
- The ongoing argument over how serious AI alignment risks are, what kinds of harms matter most, and how systems should be governed or constrained.
- AI API
- An application programming interface that exposes AI capabilities such as text generation, embeddings, classification, speech, or image processing to other...
- AI Architecture
- The overall technical design of an AI system, including models, data flows, inference paths, evaluation loops, storage, orchestration, and operational...
- AI Art Controversy
- Public conflict over AI-generated art involving copyright, training data, labor displacement, attribution, and artistic legitimacy.
- AI Assistant
- A software assistant powered by AI that helps users perform tasks such as answering questions, drafting content, navigating tools, or automating workflows. AI...
- AI Audit
- A structured review of an AI system's behavior, data use, controls, and outcomes to assess risk, compliance, quality, or accountability. AI audits may examine...
- AI Benchmark
- An evaluation concept used to measure, inspect, or compare model behavior through ai benchmark. It influences how models are trained, evaluated, or served, and...
- AI Bias
- An artificial intelligence concept involving ai bias and its effect on model design, behavior, or deployment. It influences how models are trained, evaluated,...
- AI Cache
- A cache layer used to store and reuse AI-related outputs or intermediate results such as model responses, embeddings, retrieval results, or prompt expansions....
- AI Chain
- A sequence of AI-related steps in which the output of one model call or processing stage becomes input to the next. AI chains are used for workflows like...
- AI Chip
- An artificial intelligence concept involving ai chip and its effect on model design, behavior, or deployment. It influences how models are trained, evaluated,...
- AI Code Generation
- The use of AI systems to produce source code, tests, configuration, or code transformations from prompts, examples, or surrounding context. AI code generation...
- AI Code Review
- The use of AI to inspect code changes for potential bugs, style issues, security risks, or missing tests. AI code review is most effective as a supplement to...
- AI Coding
- Software development work performed with meaningful assistance from AI systems, including code generation, refactoring, debugging, explanation, or test...
- AI Compiler
- An artificial intelligence concept involving ai compiler and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI Compliance
- The practice of ensuring AI systems meet applicable legal, policy, contractual, and internal governance requirements. AI compliance work often covers data...
- AI Compute
- The processing resources used to train, fine-tune, or run AI models, including GPUs, TPUs, CPUs, and the surrounding infrastructure needed to support them. AI...
- AI Copilot
- An artificial intelligence concept involving ai copilot and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI Cost
- The total expense associated with building, running, or maintaining AI systems, including model usage, compute, storage, evaluation, data labeling, and...
- AI Data Pipeline
- The pipeline that collects, cleans, transforms, labels, stores, and serves data used for AI training, evaluation, retrieval, or inference workflows. AI data...
- AI Debugging
- The process of investigating and fixing problems in AI systems, such as bad outputs, retrieval errors, prompt issues, latency spikes, or evaluation failures....
- AI Demo
- A demonstration of an AI system's capabilities, often built to show a specific workflow, product concept, or technical proof of value. AI demos can be...
- AI Deploy
- To release or put an AI model or AI-powered feature into an environment where it can be used for testing or production workloads. AI deploy decisions usually...
- AI Deployment
- The operational process and resulting setup for serving an AI model or AI feature in staging or production. AI deployment includes packaging, routing, scaling,...
- AI Design
- The design of user experiences, workflows, controls, and system behavior around AI capabilities. AI design considers how users understand uncertainty, review...
- AI Detection
- The practice of identifying whether content, behavior, or system output is likely associated with AI generation or AI-driven activity. AI detection can be...
- AI Edge
- AI inference or processing performed close to where data is generated or consumed, such as on devices, local gateways, or edge servers rather than only in...
- AI Efficiency
- The ability of an AI system to deliver useful results with minimal waste in compute, latency, memory, tokens, or operational overhead. AI efficiency matters...
- AI Endpoint
- A network-accessible endpoint through which clients send requests to an AI model or AI-powered service. AI endpoints often expose inference, embeddings,...
- AI Engineering
- The engineering discipline of building, integrating, testing, deploying, and operating AI-powered systems in real products. AI engineering spans prompts,...
- AI Ethics
- An artificial intelligence concept involving ai ethics and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI Evaluation
- The process of measuring an AI system's performance, reliability, safety, and usefulness using benchmarks, real tasks, test sets, rubrics, or human review. AI...
- AI Explainability
- An artificial intelligence concept involving ai explainability and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI Fairness
- An evaluation concept used to measure, inspect, or compare model behavior through ai fairness. It influences how models are trained, evaluated, or served, and...
- AI Feature
- A product feature whose behavior depends meaningfully on AI, such as generation, recommendation, summarization, extraction, or classification. AI features...
- AI-First Company
- A company that treats AI as a core product and operating assumption rather than an add-on feature, shaping roadmap, staffing, and go-to-market around it. The...
- AI Framework
- A framework used to build, orchestrate, train, or serve AI applications and workflows. AI frameworks can provide abstractions for prompts, pipelines, model...
- AI Gateway
- A gateway layer that routes, authenticates, observes, and controls access to one or more AI providers or internal AI services. AI gateways often handle rate...
- AI Generation
- Content or output produced by an AI system, including text, code, images, audio, or structured data. Teams also use the phrase to describe the act of...
- AI Governance
- An artificial intelligence concept involving ai governance and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI Guardrail
- An artificial intelligence concept involving ai guardrail and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI Hallucination
- An evaluation concept used to measure, inspect, or compare model behavior through ai hallucination. It influences how models are trained, evaluated, or served,...
- AI Hosting
- The infrastructure and operational setup used to run AI models or AI-powered services, whether managed by a provider or self-hosted. AI hosting decisions...
- AI Image
- An image generated, edited, analyzed, or otherwise produced through AI techniques rather than captured or created entirely by traditional means. The term can...
- AI Impact
- The measurable effect an AI system has on users, workflows, business outcomes, risk, or society. Teams discuss AI impact when deciding whether a feature is...
- AI Index
- An index built to support AI workflows, often by storing embeddings, metadata, or searchable representations that help with retrieval and grounding. AI indexes...
- AI Infrastructure
- An artificial intelligence concept involving ai infrastructure and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI Integration
- The incorporation of AI capabilities into an existing product, workflow, or technical stack. AI integration usually involves APIs, data preparation, UX...
- AI Interface
- The interface through which users or systems interact with an AI capability, including prompts, controls, result displays, feedback mechanisms, and surrounding...
- AI Lab
- A team, group, or organization focused on researching, prototyping, or developing AI technologies and products. An AI lab may emphasize foundational research,...
- AI Language
- Language used in AI contexts, either referring to natural language processed by AI systems or to specialized representations, prompts, and conventions used...
- AI Layer
- A distinct layer in an application's architecture where AI-related logic is concentrated, such as prompting, retrieval, inference routing, or post-processing....
- AI Lifecycle
- The full sequence of stages an AI system goes through, from ideation and data preparation to training, evaluation, deployment, monitoring, updates, and...
- AI Limit
- A practical or technical boundary on what an AI system can do, such as context size, latency, reliability, modality support, safety constraints, or cost...
- AI Literacy
- An artificial intelligence concept involving ai literacy and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI Logging
- The recording of AI-related events such as prompts, responses, model versions, latency, token use, tool calls, and safety decisions for debugging or...
- AI Marketplace
- A platform or catalog where AI models, tools, datasets, plugins, or services can be discovered, compared, and adopted. AI marketplaces reduce distribution...
- AI Memory
- A mechanism that allows an AI system to retain, retrieve, or reuse information from prior interactions, documents, or state beyond a single immediate prompt....
- AI Metric
- A measurement used to assess some aspect of AI system behavior, such as accuracy, latency, cost, hallucination rate, acceptance rate, or user satisfaction. AI...
- AI Model
- A trained computational model that produces predictions, classifications, generations, or other outputs from input data. In product discussions, AI model may...
- AI Model Registry
- A model architecture concept tied to ai model registry and how modern AI systems represent or process information. It influences how models are trained,...
- AI Monitor
- A monitoring system, dashboard, or process used to watch AI behavior in production for issues such as drift, latency, errors, safety events, or quality...
- AI Multi-Agent
- Describing an AI system in which multiple agents or agent-like components cooperate, specialize, or divide work rather than relying on a single monolithic...
- AI-Native
- Designed from the beginning around AI capabilities rather than retrofitting AI into an older product architecture or workflow. It usually implies product...
- AI Notebook
- A notebook-based environment used to explore data, prompts, models, or experiments interactively while mixing code, outputs, and documentation in one place. AI...
- AI Observability
- An artificial intelligence concept involving ai observability and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI Ops
- The operational work required to deploy, monitor, govern, and maintain AI systems in real environments. AI ops includes model rollouts, incident response,...
- AI Optimist
- A person who believes that advanced AI will be predominantly beneficial to humanity — driving scientific breakthroughs, economic prosperity, and reduced...
- AI Optimization
- The process of improving an AI system's quality, latency, cost, or reliability through changes to prompts, models, retrieval, infrastructure, or evaluation. AI...
- AI Orchestration
- An artificial intelligence concept involving ai orchestration and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI Output
- The result produced by an AI system, such as text, code, predictions, labels, images, or structured data. Teams evaluate AI output not just for correctness but...
- AI Parameter
- A configurable value in an AI system, or in some contexts an individual learned weight inside a model. In product discussions, the phrase often refers to...
- AI Performance
- How well an AI system performs across relevant dimensions such as accuracy, latency, throughput, cost, and user acceptance. AI performance must be judged in...
- AI Pipeline
- An artificial intelligence concept involving ai pipeline and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI Platform
- A shared platform that provides the tools, APIs, infrastructure, and operational controls needed for teams to build and run AI applications. AI platforms often...
- AI Plugin
- A plugin that adds AI capabilities to an existing product, or a plugin that lets an AI system call into external functionality. AI plugins are usually...
- AI-Powered Security
- Security tooling or workflows that use machine learning or AI techniques for tasks such as anomaly detection, triage, or automated analysis. The phrase is...
- AI Pricing
- The pricing model used for AI products or APIs, such as per token, per request, per seat, per image, or usage-tiered billing. AI pricing shapes product design...
- AI Privacy
- The protection of personal, sensitive, or confidential information when AI systems collect, process, store, or generate data. AI privacy concerns include...
- AI Processing
- The handling of inputs, transformations, inference steps, and post-processing performed by an AI-enabled system. AI processing can include tokenization,...
- AI Product
- A product whose value depends significantly on AI capabilities such as generation, ranking, prediction, or automation. Building an AI product involves both...
- AI Prompt
- The instruction, context, examples, or input text provided to an AI model to shape its output. Prompt design affects quality heavily, especially in systems...
- AI Provider
- A company or internal platform that supplies model access, inference APIs, or hosted AI capabilities. Teams often support multiple AI providers so they can...
- AI Quality
- The overall usefulness and reliability of an AI system's outputs for the intended task, considering factors like correctness, consistency, tone, safety, and...
- AI Query
- A request sent to an AI system, whether as a prompt, tool call, search-like instruction, or structured input. AI queries may include user text, system context,...
- AI Rate Limit
- A limit on how frequently AI requests can be made, often enforced per second, minute, account, or model. AI rate limits protect providers and shared systems,...
- AI Red Teaming
- An artificial intelligence concept involving ai red teaming and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI Registry
- A registry used to track AI assets such as models, prompts, datasets, versions, or evaluation records. AI registries help teams know what is deployed, which...
- AI Regulation
- An artificial intelligence concept involving ai regulation and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI Request
- A single call or interaction sent to an AI system for inference or processing. An AI request may include prompts, files, metadata, tools, or settings that...
- AI Response
- The returned output from an AI request, whether as free-form text, structured data, a tool call, or multimodal content. AI responses often need post-processing...
- AI Risk
- An artificial intelligence concept involving ai risk and its effect on model design, behavior, or deployment. It influences how models are trained, evaluated,...
- AI Router
- A component that decides which model, provider, region, or path should handle a given AI request based on cost, latency, policy, or capability needs. AI...
- AI Runtime
- The runtime environment in which AI inference or AI-driven workflows execute, including model serving, orchestration logic, tool access, and surrounding...
- AI Sandbox
- A restricted environment used to test or execute AI-driven actions with limited permissions, controlled data access, and stronger safety guarantees. AI...
- AI Scale
- The level of usage, compute demand, model size, or organizational reach at which an AI system operates. Teams talk about AI scale when discussing whether...
- AI SDK
- A software development kit that helps developers integrate AI services, models, or workflows into applications more easily than calling raw APIs directly. AI...
- AI Search
- Search functionality enhanced by AI techniques such as semantic ranking, embeddings, query rewriting, or answer generation. AI search is often designed to...
- AI Server
- A server or service instance that hosts AI workloads such as inference, retrieval, or orchestration. AI servers may need specialized hardware, caching, and...
- AI Service
- A standalone service that exposes AI functionality to other systems, typically through an API or internal platform interface. AI services can handle...
- AI Session
- A bounded interaction or runtime session associated with an AI system, often carrying temporary context, conversation history, tools, or user-specific state....
- AI Simulation
- The use of AI within a simulated environment, or the use of simulation to test AI behavior before real deployment. AI simulations are common in robotics,...
- AI Skill
- A specific capability or packaged behavior an AI system can invoke, such as summarizing, searching, transforming files, or calling a particular tool workflow....
- AI Solution
- A proposed or deployed solution that uses AI to solve a business, technical, or workflow problem. The term is often used broadly in product and consulting...
- AI Speed
- The responsiveness or throughput of an AI system, usually measured in latency, tokens per second, jobs per minute, or end-to-end completion time. AI speed...
- AI Stack
- The combined set of models, data systems, tooling, APIs, orchestration, and infrastructure that make up an AI application or platform. Teams discuss the AI...
- AI Startup
- A startup whose main product, infrastructure, or market positioning depends heavily on artificial intelligence. The label covers everything from model labs to...
- AI Strategy
- A plan for how an organization will use AI to create value while managing risk, cost, and operational constraints. AI strategy includes decisions about...
- AI Streaming
- The delivery of AI output incrementally as it is produced rather than waiting for the full response to complete. AI streaming improves perceived speed and can...
- AI Studio
- A visual or integrated environment for building, testing, and managing AI prompts, workflows, or models. AI studios are often aimed at rapid iteration by...
- AI System
- A complete system that uses AI as part of its behavior, including the model and the surrounding data, interfaces, controls, and operational processes. Framing...
- AI Task
- A specific job assigned to or handled by an AI system, such as summarizing a document, extracting fields, ranking candidates, or answering a question. AI tasks...
- AI Template
- A reusable template for prompts, workflows, or outputs that standardizes how AI is invoked across similar use cases. AI templates help reduce duplication and...
- AI Test
- A single test case or evaluation scenario used to check whether an AI system behaves acceptably on a specific input or requirement. AI tests can cover...
- AI Testing
- The broader practice of validating AI system behavior through test sets, scenario runs, regression suites, manual review, and production monitoring. AI testing...
- AI Token
- A token as used by AI models, typically representing a chunk of text that counts toward context limits, cost, and generation length. Token counts matter...
- AI Tool
- A tool that uses AI, or a callable capability made available to an AI system so it can act beyond text generation alone. The phrase is broad and can refer to...
- AI Toolchain
- The set of tools used together to build, evaluate, deploy, and monitor AI systems. An AI toolchain may include notebooks, prompt managers, model APIs, vector...
- AI Trace
- A trace or record showing the sequence of steps an AI request took through prompts, retrieval, tool calls, model invocations, and post-processing. AI traces...
- AI Training
- The process of adjusting a model's parameters using data so it learns patterns or capabilities relevant to a task or domain. In product discussions, the term...
- AI Transparency
- An artificial intelligence concept involving ai transparency and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI Tuning
- The adjustment of prompts, parameters, retrieval settings, model choices, or fine-tuning configurations to improve AI system behavior. AI tuning is iterative...
- AI Type
- A category or class of AI system, model, or task, such as generative AI, classification, recommendation, or speech recognition. The phrase is often used...
- AI Usage
- The extent and pattern of how AI features or services are used, often measured in requests, users, tokens, tasks, or time saved. Tracking AI usage helps teams...
- AI Vector
- A vector representation used in AI systems, typically to encode text, images, or other data numerically so similarity and retrieval operations become possible....
- AI Version
- A specific version of an AI model, prompt set, workflow, or configuration used in evaluation or production. Explicit AI versioning is important because...
- AI Voice
- An AI-generated or AI-controlled voice used for speech synthesis, voice interfaces, narration, or conversational experiences. The term can also refer to the...
- AI Watermarking
- An artificial intelligence concept involving ai watermarking and its effect on model design, behavior, or deployment. It influences how models are trained,...
- AI Workflow
- A structured sequence of steps in which AI is used as part of a broader task, often alongside retrieval, validation, human review, and downstream systems. AI...
- AI Workspace
- A shared environment where teams can build, test, and manage AI assets such as prompts, datasets, evaluations, and model configurations. AI workspaces help...
- Alignment Tax
- The idea that making an AI system safer, more steerable, or better aligned with human preferences may impose costs in speed, capability, flexibility, or...
- Anchor Box
- An artificial intelligence concept involving anchor box and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Anomaly Detection ML
- An AI task or capability focused on anomaly detection ml and the production of useful predictions or outputs from data. It influences how models are trained,...
- Anthropic
- An AI company known for developing large language models and safety-focused techniques, including the Claude family of models. In technical discussions, the...
- attention head
- Attention Head is a single attention mechanism within a multi-head attention layer of a transformer neural network. In the transformer architecture (introduced...
- Attention Score
- A model architecture concept tied to attention score and how modern AI systems represent or process information. It influences how models are trained,...
- Autonomous Agent Framework
- An artificial intelligence concept involving autonomous agent framework and its effect on model design, behavior, or deployment. It influences how models are...
- Bag of Words
- An artificial intelligence concept involving bag of words and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Bayesian Inference
- An artificial intelligence concept involving bayesian inference and its effect on model design, behavior, or deployment. It influences how models are trained,...
- benchmark contamination
- The phenomenon where a model's training data inadvertently (or deliberately) includes examples from evaluation benchmarks, inflating its apparent performance...
- Benchmark Saturation
- A situation in which benchmark scores become so high that the benchmark no longer meaningfully distinguishes between systems or predicts real-world usefulness....
- Bias-Variance Tradeoff
- An artificial intelligence concept involving bias-variance tradeoff and its effect on model design, behavior, or deployment. It influences how models are...
- Bidirectional Encoder
- A model architecture concept tied to bidirectional encoder and how modern AI systems represent or process information. It influences how models are trained,...
- Bigram
- An artificial intelligence concept involving bigram and its effect on model design, behavior, or deployment. It influences how models are trained, evaluated,...
- Binary Classification
- An AI task or capability focused on binary classification and the production of useful predictions or outputs from data. It influences how models are trained,...
- Bolt
- An AI-powered web development platform by StackBlitz that generates full-stack web applications from natural language descriptions. Bolt runs entirely in the...
- Boosting
- An artificial intelligence concept involving boosting and its effect on model design, behavior, or deployment. It influences how models are trained, evaluated,...
- Capability Overhang
- The idea that significant useful capabilities may already be possible with current models or techniques but remain unrealized because productization,...
- Causal Inference
- An artificial intelligence concept involving causal inference and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Chain of Density
- A prompting approach for iterative summarization in which each revision preserves important information while becoming more information-dense and compact. It...
- Chain of Verification
- A prompting or workflow pattern where an AI system generates an answer and then explicitly checks or verifies important claims through additional reasoning or...
- Chatbot Framework
- An artificial intelligence concept involving chatbot framework and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Checkpoint
- An artificial intelligence concept involving checkpoint and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Chinchilla Scaling
- A scaling-law result emphasizing that, for a given compute budget, model size and training data should be balanced rather than simply making models larger with...
- Chinese Room
- A philosophical thought experiment proposed by John Searle to argue that symbol manipulation alone may not constitute genuine understanding, even if outputs...
- ChromaDB
- An open-source embedding database (vector database) designed to be the easiest way to build AI applications that need to search over documents, images, or...
- Classification Threshold
- An AI task or capability focused on classification threshold and the production of useful predictions or outputs from data. It influences how models are...
- Classifier
- A model or component that assigns an input to one or more categories based on learned patterns or defined criteria. Classifiers are widely used in spam...
- Class Imbalance
- An artificial intelligence concept involving class imbalance and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Claude
- A family of AI assistant models developed by Anthropic and used for tasks such as conversation, writing, coding, and analysis. In product and engineering...
- Claude Code
- An agentic command-line coding tool built by Anthropic that integrates the Claude AI model directly into the developer's terminal workflow. Claude Code can...
- Claude Moment
- A joking phrase for the moment an AI assistant confidently produces something polished-sounding but subtly wrong, overly literal, or impractically verbose. In...
- Cognitive Architecture
- A high-level design intended to model or support aspects of cognition such as memory, planning, perception, and decision-making in a unified system. The term...
- Cognitive Bias AI
- Biases in AI behavior that resemble human cognitive biases, or discussions of human cognitive bias as it applies to designing and evaluating AI systems. The...
- Cognitive Load AI
- The mental effort required from users to work effectively with an AI system, especially when reviewing outputs, correcting errors, or understanding uncertain...
- Cognitive Science AI
- The area of overlap between AI and cognitive science, where researchers use ideas from human cognition to design systems or use AI models to explore theories...
- Collaborative Filtering
- An artificial intelligence concept involving collaborative filtering and its effect on model design, behavior, or deployment. It influences how models are...
- Collective Intelligence
- Intelligence that emerges from the combined behavior of multiple individuals, agents, or systems rather than from one isolated mind or model. In AI...
- Compute Budget
- An artificial intelligence concept involving compute budget and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Compute Optimal
- Describing a training or model setup that makes the most effective use of a fixed compute budget according to scaling-law reasoning. A compute-optimal approach...
- Computer Vision
- An artificial intelligence concept involving computer vision and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Concept Drift
- An artificial intelligence concept involving concept drift and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Conditional Generation
- An AI task or capability focused on conditional generation and the production of useful predictions or outputs from data. It influences how models are trained,...
- Connectionism
- An artificial intelligence concept involving connectionism and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Consistency Model
- A model architecture concept tied to consistency model and how modern AI systems represent or process information. It influences how models are trained,...
- constitutional AI
- A training methodology developed by Anthropic where an AI system is guided by a set of written principles (a 'constitution') rather than relying solely on...
- Constitutional AI Method
- An alignment method in which an AI system is guided by an explicit set of principles or rules, often using self-critique and revision to improve responses...
- Context Distillation
- A technique for training or adapting models so they internalize behaviors that would otherwise require large context at inference time. The goal is to compress...
- Context Extension
- An approach for increasing the amount of context a model can handle, whether through architectural changes, fine-tuning methods, retrieval, or system-level...
- Context Length
- The maximum amount of input and sometimes generated output that a model can consider within a single request, usually measured in tokens. Context length...
- Context Stuffing
- The practice of adding too much material to a prompt or context window in the hope that more information will improve the answer, often with diminishing...
- Controlled Generation
- Generation that is constrained by specific requirements such as format, tone, style, factual grounding, or policy rules rather than being left fully...
- Conversational AI
- AI systems designed to interact through natural-language conversation, whether in chat, voice, or messaging interfaces. Conversational AI includes chatbots,...
- Conversation Memory
- The ability of a conversational AI system to retain and reuse relevant information from earlier turns in the same interaction or across sessions. Good...
- Conversation Tree
- A branching representation of possible conversational paths, replies, or decision points rather than a single linear thread. Conversation trees are used in...
- Convolutional Neural Network
- A model architecture concept tied to convolutional neural network and how modern AI systems represent or process information. It influences how models are...
- Cooperative AI
- AI research and system design focused on enabling agents to work cooperatively with humans or with one another toward shared goals. Cooperative AI is important...
- Coordinated AI
- Describing AI systems or agents that are organized to act in a coordinated way rather than independently. The phrase usually appears in discussions of...
- Copilot
- An AI-powered code completion tool developed by GitHub (Microsoft) that suggests code as you type in your editor. Built on OpenAI's Codex model (a GPT...
- Cost Function
- An artificial intelligence concept involving cost function and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Counterfactual Explanation
- An artificial intelligence concept involving counterfactual explanation and its effect on model design, behavior, or deployment. It influences how models are...
- CUDA Poor
- A joking term for being limited by lack of GPU resources, especially in environments where CUDA-compatible hardware is the bottleneck. In AI engineering slang,...
- DALL-E
- An AI image generation model created by OpenAI that produces images from text descriptions. Named as a portmanteau of Salvador Dali and Pixar's WALL-E, DALL-E...
- Data Curation
- The careful selection, cleaning, labeling, and organization of data so it is suitable for training, evaluation, or retrieval. Data curation is often one of the...
- Data Mixture
- The composition and relative proportions of different datasets or data sources used to train a model. The data mixture can strongly influence what capabilities...
- Data Quality
- The degree to which data is accurate, complete, relevant, consistent, and usable for a specific AI task. Poor data quality often causes more serious problems...
- Data Scaling
- Increasing the amount or effective use of training or retrieval data to improve model behavior, often in line with scaling-law considerations. Data scaling is...
- dead internet theory
- A conspiracy theory and cultural critique proposing that the internet is now predominantly populated by bot-generated content and AI-driven interactions, with...
- Decision Boundary
- An artificial intelligence concept involving decision boundary and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Decision Tree
- An artificial intelligence concept involving decision tree and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Decoder
- A model architecture concept tied to decoder and how modern AI systems represent or process information. It influences how models are trained, evaluated, or...
- Decoder Only
- Describing a transformer architecture that uses only the decoder-style stack, typically generating tokens autoregressively from left to right. Many modern...
- Deconvolution
- An artificial intelligence concept involving deconvolution and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Deep Fake Detection
- An AI task or capability focused on deep fake detection and the production of useful predictions or outputs from data. It influences how models are trained,...
- Denoising
- An artificial intelligence concept involving denoising and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Dense Layer
- A model architecture concept tied to dense layer and how modern AI systems represent or process information. It influences how models are trained, evaluated,...
- Dense Model
- A model in which most or all parameters are active for each forward pass, unlike sparse architectures such as mixture-of-experts where only subsets activate....
- Depth Estimation
- An artificial intelligence concept involving depth estimation and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Devin
- An AI software engineering agent developed by Cognition Labs, marketed as the first 'AI software engineer.' Devin operates autonomously in a sandboxed...
- Dialogue Policy
- The strategy or rules that determine how a conversational system chooses its next action, such as asking a follow-up question, answering, clarifying, or...
- Dialogue System
- An artificial intelligence concept involving dialogue system and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Discriminator
- An artificial intelligence concept involving discriminator and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Disentangled Representation
- An artificial intelligence concept involving disentangled representation and its effect on model design, behavior, or deployment. It influences how models are...
- distillation
- Distillation (or knowledge distillation) is a model compression technique in machine learning where a smaller, more efficient student model is trained to...
- Document QA
- Question answering over one or more documents, typically using retrieval, chunking, and generation to answer based on supplied material rather than general...
- Domain Adaptation
- An artificial intelligence concept involving domain adaptation and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Domain Randomization
- An artificial intelligence concept involving domain randomization and its effect on model design, behavior, or deployment. It influences how models are...
- Double Descent
- An artificial intelligence concept involving double descent and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Dual Process Theory
- A theory from cognitive science that distinguishes between fast intuitive reasoning and slower deliberate reasoning. In AI discussions it is often used as an...
- Early Stopping
- An artificial intelligence concept involving early stopping and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Edge Deployment
- An artificial intelligence concept involving edge deployment and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Elicitation
- The process of drawing out a model's capabilities, preferences, or hidden knowledge through careful prompting, testing, or setup. In AI research, elicitation...
- Embedding Dimension
- The number of numeric dimensions in an embedding vector used to represent data such as text or images. Embedding dimension affects storage cost, retrieval...
- Embedding Layer
- A neural network layer that maps discrete tokens or categories into dense vector representations that the rest of the model can process. Embedding layers are...
- Embodied AI
- AI that operates through a body or physical agent interacting with an environment, such as a robot or simulated avatar. Embodied AI research emphasizes...
- Emergence
- The appearance of higher-level behaviors or capabilities that are not obvious from inspecting individual components alone and may become visible only at...
- Emergent Ability
- An artificial intelligence concept involving emergent ability and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Emergent Behavior
- An artificial intelligence concept involving emergent behavior and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Encoder
- A model architecture concept tied to encoder and how modern AI systems represent or process information. It influences how models are trained, evaluated, or...
- Encoder-Decoder
- A model architecture concept tied to encoder-decoder and how modern AI systems represent or process information. It influences how models are trained,...
- Ensemble Method
- An artificial intelligence concept involving ensemble method and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Entity Extraction
- An artificial intelligence concept involving entity extraction and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Entity Linking
- An artificial intelligence concept involving entity linking and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Entity Recognition
- An AI task or capability focused on entity recognition and the production of useful predictions or outputs from data. It influences how models are trained,...
- Evaluation Harness
- A reusable framework or test rig for running evaluation cases against models or AI systems in a consistent way. Evaluation harnesses make it easier to compare...
- Evaluation Metric
- An evaluation concept used to measure, inspect, or compare model behavior through evaluation metric. It influences how models are trained, evaluated, or...
- Expert Iteration
- A training approach in which a stronger search or expert process generates improved targets or guidance that a model then learns to imitate, repeating this...
- Expert System
- An artificial intelligence concept involving expert system and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Explainability
- An artificial intelligence concept involving explainability and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Explainable AI
- An artificial intelligence concept involving explainable ai and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Exploration vs Exploitation
- An artificial intelligence concept involving exploration vs exploitation and its effect on model design, behavior, or deployment. It influences how models are...
- Face Detection
- An AI task or capability focused on face detection and the production of useful predictions or outputs from data. It influences how models are trained,...
- Face Recognition
- An AI task or capability focused on face recognition and the production of useful predictions or outputs from data. It influences how models are trained,...
- Factuality
- An evaluation concept used to measure, inspect, or compare model behavior through factuality. It influences how models are trained, evaluated, or served, and...
- Fairness Metric
- An evaluation concept used to measure, inspect, or compare model behavior through fairness metric. It influences how models are trained, evaluated, or served,...
- Faithfulness
- The degree to which an AI system's output accurately reflects its source material, reasoning, or evidence rather than introducing unsupported claims....
- Feature Extraction
- An artificial intelligence concept involving feature extraction and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Feature Importance
- An artificial intelligence concept involving feature importance and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Feature Map
- An artificial intelligence concept involving feature map and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Feature Selection
- An artificial intelligence concept involving feature selection and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Feedback Loop AI
- A feedback loop involving AI outputs influencing future inputs, behavior, training data, or user decisions in ways that reinforce certain patterns over time....
- Feed-Forward Network
- A model architecture concept tied to feed-forward network and how modern AI systems represent or process information. It influences how models are trained,...
- Few-Shot
- Describing a setup where a model is given a small number of examples in the prompt to demonstrate the desired behavior before handling a new input. Few-shot...
- Few-Shot Prompting
- An artificial intelligence concept involving few-shot prompting and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Fill-in-the-Middle
- A generation pattern where a model is asked to produce content that belongs between a provided prefix and suffix rather than simply continuing from the start....
- Fine-Grained Control
- The ability to adjust an AI system's behavior in precise ways rather than through broad high-level settings alone. Fine-grained control matters when teams need...
- Focal Loss
- An artificial intelligence concept involving focal loss and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Forward Pass
- An artificial intelligence concept involving forward pass and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Frequency Penalty
- An artificial intelligence concept involving frequency penalty and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Frontier Model
- A model that is near the leading edge of capability for its class at a given point in time. The phrase is often used to describe large general-purpose models...
- Frozen Embedding
- An embedding layer or embedding representation whose parameters are kept fixed during some later stage of training or adaptation. Freezing embeddings can...
- Frozen Layer
- A model architecture concept tied to frozen layer and how modern AI systems represent or process information. It influences how models are trained, evaluated,...
- Gemini
- Google's family of multimodal AI models, succeeding the PaLM series, capable of processing and generating text, code, images, audio, and video. Gemini launched...
- General Intelligence
- The capability to perform effectively across a wide range of tasks and domains rather than being limited to one narrow specialized function. In AI discussions,...
- Generalist Agent
- An agent designed to perform a broad range of tasks across domains instead of specializing in one narrow workflow. Generalist agents rely on flexible planning,...
- Generalization
- An artificial intelligence concept involving generalization and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Generated Content
- Content produced by an AI system rather than written, drawn, or assembled entirely by a person. Generated content can include text, code, images, summaries,...
- Generative Adversarial Network
- A model architecture concept tied to generative adversarial network and how modern AI systems represent or process information. It influences how models are...
- Generative Model
- A model architecture concept tied to generative model and how modern AI systems represent or process information. It influences how models are trained,...
- Generative Search
- A search experience in which AI generates synthesized answers or summaries based on retrieved sources instead of only returning ranked links. Generative search...
- Genetic Algorithm
- An artificial intelligence concept involving genetic algorithm and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Gesture Recognition
- An AI task or capability focused on gesture recognition and the production of useful predictions or outputs from data. It influences how models are trained,...
- GitHub Copilot Debate
- The continuing argument over AI coding assistants, covering productivity, code quality, licensing, learning effects, and developer dependence.
- Goal Conditioned
- Describing a model or policy that takes an explicit goal as part of its input so its behavior can adapt to the desired outcome. Goal-conditioned approaches are...
- Goal Misgeneralization
- A failure mode in which a system generalizes the wrong objective or proxy when placed in new situations, even though it appears to perform well during...
- Goodhart's Law AI
- The application of Goodhart's Law to AI systems, where optimizing heavily for a measurable proxy can degrade the true objective once the proxy becomes the...
- GPT-4
- OpenAI's fourth-generation Generative Pre-trained Transformer, a large multimodal model capable of processing both text and images. Released in March 2023,...
- GPU Cluster
- An artificial intelligence concept involving gpu cluster and its effect on model design, behavior, or deployment. It influences how models are trained,...
- GPU Memory
- The memory available on a GPU for storing model weights, activations, batches, and intermediate computation during training or inference. GPU memory is often...
- GPU Utilization
- A measure of how fully a GPU is being used for useful computation over time. Low GPU utilization can indicate bottlenecks in data loading, batching, model...
- Gradient-Free Optimization
- Optimization methods that do not rely on computing gradients and instead search using alternatives such as evolutionary strategies, sampling, or black-box...
- Greedy Decoding
- An artificial intelligence concept involving greedy decoding and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Grid Search
- An artificial intelligence concept involving grid search and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Groq
- A company that designs custom AI inference chips (Language Processing Units, or LPUs) optimized for running large language models at extreme speed. Groq's...
- Grounded Generation
- Generation that is explicitly based on supplied evidence, retrieved documents, tool outputs, or verified context rather than relying only on the model's...
- grounding
- The technique of connecting an LLM's outputs to verifiable external data sources to reduce hallucinations and improve factual accuracy. Grounding typically...
- Ground Truth
- An artificial intelligence concept involving ground truth and its effect on model design, behavior, or deployment. It influences how models are trained,...
- guardrails
- Safety mechanisms and filters applied to AI systems to prevent harmful, off-topic, or policy-violating outputs. Guardrails can be implemented at the prompt...
- Hallucination Detection
- An AI task or capability focused on hallucination detection and the production of useful predictions or outputs from data. It influences how models are...
- Hallucination Mitigation
- An evaluation concept used to measure, inspect, or compare model behavior through hallucination mitigation. It influences how models are trained, evaluated, or...
- Hallucination Rate
- A metric intended to capture how often an AI system produces unsupported, false, or invented content in a given evaluation setting. Hallucination rate is...
- Hidden Layer
- A model architecture concept tied to hidden layer and how modern AI systems represent or process information. It influences how models are trained, evaluated,...
- Hidden State
- A model architecture concept tied to hidden state and how modern AI systems represent or process information. It influences how models are trained, evaluated,...
- Hierarchical Clustering
- An artificial intelligence concept involving hierarchical clustering and its effect on model design, behavior, or deployment. It influences how models are...
- Human Baseline
- A human performance level used as a reference point when evaluating an AI system. Comparing against a human baseline helps teams judge whether a model is...
- Human Evaluation
- An evaluation concept used to measure, inspect, or compare model behavior through human evaluation. It influences how models are trained, evaluated, or served,...
- Human Feedback
- An artificial intelligence concept involving human feedback and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Human-in-the-Loop
- An artificial intelligence concept involving human-in-the-loop and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Human Preference
- Human judgments about which outputs, behaviors, or policies are more desirable, useful, or acceptable in a given context. Human preference data is often used...
- Hyperparameter
- An artificial intelligence concept involving hyperparameter and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Hyperparameter Search
- An artificial intelligence concept involving hyperparameter search and its effect on model design, behavior, or deployment. It influences how models are...
- Image Captioning
- An AI task or capability focused on image captioning and the production of useful predictions or outputs from data. It influences how models are trained,...
- Image Classification
- An AI task or capability focused on image classification and the production of useful predictions or outputs from data. It influences how models are trained,...
- Image Encoder
- A model component that converts image inputs into vector representations that other parts of the system can use for classification, retrieval, generation, or...
- Image Generation
- An AI task or capability focused on image generation and the production of useful predictions or outputs from data. It influences how models are trained,...
- Image Inpainting
- An artificial intelligence concept involving image inpainting and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Image Segmentation
- An AI task or capability focused on image segmentation and the production of useful predictions or outputs from data. It influences how models are trained,...
- Image Super-Resolution
- An artificial intelligence concept involving image super-resolution and its effect on model design, behavior, or deployment. It influences how models are...
- Image Tokenizer
- A mechanism that transforms an image into a sequence of tokens or discrete units that a model can process, often as part of a multimodal architecture. Image...
- Implicit Reasoning
- Reasoning that appears in a model's behavior without being explicitly exposed step by step in the output. The term is used when a system seems to perform...
- Inductive Bias
- An artificial intelligence concept involving inductive bias and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Inference Budget
- The amount of compute, latency, tokens, or money available for running inference on a task or product. Inference budgets force tradeoffs among model quality,...
- Inference Cost
- The cost incurred when running a model to produce outputs, including compute usage, provider charges, and operational overhead. Inference cost is a central...
- Inference Latency
- The delay between submitting an inference request and receiving the result. Inference latency is affected by model size, hardware, batching, network overhead,...
- Inference Optimization
- The process of making model inference faster, cheaper, or more efficient through techniques such as quantization, batching, caching, compilation, or smarter...
- Inference Server
- A server or service process dedicated to hosting models and executing inference requests. Inference servers manage model loading, batching, scheduling, and...
- Inference Speed
- How quickly a model can process inputs and generate outputs during inference, often measured in latency or tokens per second. Inference speed influences user...
- Inference Time
- The time taken by a model or AI pipeline to compute an output for a specific input at runtime. The phrase is often used interchangeably with inference latency,...
- Information Extraction
- An artificial intelligence concept involving information extraction and its effect on model design, behavior, or deployment. It influences how models are...
- Information Retrieval
- An AI task or capability focused on information retrieval and the production of useful predictions or outputs from data. It influences how models are trained,...
- Input Processing
- The preparation and transformation applied to incoming data before it reaches the core model, such as cleaning, chunking, tokenization, normalization, or...
- Input Token
- A token consumed as part of the input to an AI model, counting toward context limits and often toward cost. Input tokens include prompts, instructions,...
- Instruction Dataset
- A dataset composed of instructions and desired responses used to train or adapt a model to follow tasks more effectively. Instruction datasets are central to...
- Instruction Following
- An artificial intelligence concept involving instruction following and its effect on model design, behavior, or deployment. It influences how models are...
- Instruction Hierarchy
- The ordering of which instructions take precedence when multiple sources of guidance are present, such as system, developer, tool, and user instructions....
- Instruction Set AI
- A defined collection of instructions or behaviors an AI system is expected to follow, often used in prompt design, orchestration, or evaluation. The phrase...
- Intelligence Explosion
- A hypothetical scenario in which increasingly capable AI systems rapidly improve themselves or accelerate progress so quickly that intelligence grows...
- Interactive Learning
- Learning that occurs through ongoing interaction with users, environments, or feedback sources rather than from a fixed static dataset alone. Interactive...
- Interleaved Generation
- A generation process in which different types of content, reasoning steps, or tool interactions are mixed together rather than produced in one uninterrupted...
- Internal Representation
- The hidden encoded form in which a model stores and transforms information while processing inputs. Internal representations are a major focus of...
- Interpretability
- The extent to which humans can understand why an AI system produced a particular output or how it represents information internally. Interpretability matters...
- Jailbreak AI
- An attempt to bypass an AI system's intended safeguards, restrictions, or instruction boundaries through adversarial prompting or workflow manipulation....
- Knowledge Boundary
- The effective boundary around what an AI system knows or can answer reliably, given its training data, retrieval access, and current context. Understanding...
- Knowledge Cutoff
- The latest point in time up to which a model's training data is known or assumed to reflect information. Knowledge cutoff matters because models without...
- Knowledge Retrieval
- An AI task or capability focused on knowledge retrieval and the production of useful predictions or outputs from data. It influences how models are trained,...
- Knowledge Update
- A change that refreshes what an AI system can access or reflect, whether through retraining, fine-tuning, new retrieval data, or updated memory. Teams use the...
- LanceDB
- An open-source, embedded vector database built on the Lance columnar data format, designed for multimodal AI applications. LanceDB runs embedded in your...
- LangChain
- An open-source framework for building applications powered by large language models. LangChain provides abstractions for chaining together LLM calls, tool...
- Language Agent
- An artificial intelligence concept involving language agent and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Language Model
- A model architecture concept tied to language model and how modern AI systems represent or process information. It influences how models are trained,...
- Language Model Evaluation
- A model architecture concept tied to language model evaluation and how modern AI systems represent or process information. It influences how models are...
- Language Understanding
- The ability of an AI system to interpret meaning, intent, structure, and context in natural language. In practice, language understanding is judged by how well...
- Large Action Model
- A model or system designed not just to generate text but to choose and execute actions across tools, interfaces, or environments. The term is used in...
- Large Behavior Model
- A broad term for models trained or configured to produce complex behavioral policies across many situations rather than single narrow outputs. The phrase...
- Large Context Model
- A model designed to handle especially large context windows, allowing it to process longer documents, histories, or combined evidence in a single request....
- Large Language Meme
- A meme or joke built around large language models, their behaviors, or the culture forming around them. In engineering slang, these memes often oscillate...
- Latent Variable
- An artificial intelligence concept involving latent variable and its effect on model design, behavior, or deployment. It influences how models are trained,...
- Lean AI
- An approach to AI product development that emphasizes simplicity, clear business value, and efficient use of models and infrastructure instead of maximal...
- Lemmatization
- Lemmatization is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Length Penalty
- A decoding parameter or scoring adjustment that discourages or encourages longer outputs when selecting among generated sequences. Length penalties are used to...
- Likelihood
- A probabilistic measure of how well a model assigns probability to observed data or candidate outputs. In AI and machine learning, likelihood is central to...
- Linearized Attention
- An approach to making attention mechanisms more computationally efficient by approximating or restructuring them so cost scales more favorably with sequence...
- Linear Layer
- Linear Layer is a model component or design choice that shapes how information flows through a learned system. It is commonly used for building neural...
- Linear Probe
- Linear Probe is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Linear Regression
- Linear Regression is a supervised learning method for estimating numeric outputs from input features. It is commonly used for prediction pipelines and baseline...
- Lisp
- The second-oldest high-level programming language, pioneering many foundational concepts including tree data structures, automatic garbage collection, dynamic...
- Llama
- Llama is an open-weight family of large language models from Meta. It is commonly used for self-hosted chat, summarization, and fine-tuned assistants, where...
- LLM
- Large Language Model — a neural network trained on vast amounts of text data that can generate, summarize, translate, and reason about human language.
- LLM Benchmark
- A benchmark used specifically to evaluate large language models on tasks such as reasoning, coding, factuality, tool use, or safety. LLM benchmarks are useful...
- LLM Cache
- A cache used to store and reuse large language model outputs or related intermediate results so repeated requests do not trigger full generation again. LLM...
- LLM Calling
- The act or pattern of invoking a large language model from application code, a workflow engine, or another model-mediated system. The phrase often comes up...
- LLM Chain
- A sequence of large language model calls or model-driven steps linked together to complete a larger task. LLM chains can combine summarization, retrieval,...
- LLM Completion
- A completion or generated output produced by a large language model in response to a prompt. The term often refers specifically to text generation APIs or the...
- LLM Config
- The configuration used for a large language model workflow, including model choice, temperature, max tokens, system prompts, tool settings, and routing rules....
- LLM Cost
- The cost associated with using a large language model, including API charges, compute resources, and surrounding operational overhead. LLM cost is closely...
- LLM Gateway
- A gateway layer that centralizes access to one or more large language models and often handles authentication, logging, rate limits, policy enforcement, and...
- LLM Judge
- A large language model used to evaluate, rank, or critique the outputs of another model or system according to some rubric. LLM-as-judge approaches can scale...
- LLM Memory
- The mechanisms by which a large language model system retains or reuses relevant information across turns, tasks, or sessions. LLM memory may involve...
- LLM Observability
- The practice of instrumenting and analyzing large language model systems so teams can understand their behavior, performance, cost, and failure modes. LLM...
- LLM Optimization
- Improving a large language model workflow for quality, speed, reliability, or cost through changes to prompts, routing, context management, evaluation, or...
- LLM Output
- The text, structure, or tool call returned by a large language model after processing a prompt. LLM output often needs validation or post-processing before it...
- LLM Pipeline
- A pipeline built around large language model interactions, often including retrieval, prompt assembly, inference, validation, and downstream actions. LLM...
- LLM Platform
- A shared platform that gives teams standardized access to large language models along with tooling for prompts, evaluations, logging, and governance. LLM...
- LLM Plugin
- A plugin that adds large language model capabilities to an application, or a plugin that lets an LLM interact with external functions or data sources. The term...
- LLM Prompt
- The prompt used for a large language model, including instructions, examples, formatting constraints, and context. LLM prompts are often versioned and tuned...
- LLM Provider
- A provider that offers access to large language models through APIs, hosted infrastructure, or platform tooling. Teams compare LLM providers on quality,...
- LLM Proxy
- A proxy service that sits between applications and large language models to add routing, logging, caching, security, or compatibility layers. An LLM proxy can...
- LLM Reliability
- The extent to which a large language model system behaves consistently and acceptably across repeated use, edge cases, and operational conditions. Reliability...
- LLM Request
- A request made to a large language model, including the prompt, context, settings, and any tools or metadata attached to the call. Tracking LLM requests...
- LLM Response
- The response returned by a large language model after processing a request. Depending on the system, an LLM response may include text, structured fields, tool...
- LLM Router
- A routing component that decides which large language model should handle a request based on task type, cost, latency, policy, or capacity. LLM routers help...
- LLM Scale
- The operational or capability scale at which large language model systems are run, whether measured in traffic, context size, model size, or organizational...
- LLM SDK
- A software development kit for integrating large language models more conveniently than working with raw endpoints directly. LLM SDKs usually help with typed...
- LLM Security
- The security discipline around large language model systems, including prompt injection defenses, data protection, access control, abuse prevention, and safe...
- LLM Server
- A server that hosts or brokers access to one or more large language models for applications or internal users. LLM servers may perform model serving directly...
- LLM Service
- A service that exposes large language model capabilities to other systems, typically with an API and surrounding operational logic. LLM services often package...
- LLM Streaming
- The incremental delivery of large language model output as it is generated rather than only after completion finishes. LLM streaming improves perceived...
- LLM Throughput
- The rate at which a large language model system can process requests or generate tokens over time. Throughput matters for capacity planning, queueing behavior,...
- LLM Token
- A token as used in the context of large language models, counted toward prompt size, generation limits, and billing. LLM token usage is closely monitored...
- LLM Tool
- A tool made available to a large language model system so it can access external data or perform actions beyond plain text generation. LLM tools are central to...
- LLM Trace
- A trace showing the full path of a large language model request through prompts, retrieval, model calls, tool interactions, and post-processing. LLM traces are...
- LLM Workflow
- A workflow in which large language models play one or more central roles, often alongside retrieval, tools, review, and business logic. The phrase emphasizes...
- LLM Wrapper
- A wrapper around large language model APIs that hides provider details and exposes a cleaner project-specific interface. LLM wrappers are common when teams...
- Logistic Regression
- Logistic Regression is a supervised learning method for estimating numeric outputs from input features. It is commonly used for prediction pipelines and...
- Logit
- Logit is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and research...
- Logprob
- The logarithm of a probability assigned by a model to a token or sequence, commonly used for numerical stability in scoring and decoding. Logprobs are useful...
- Long-Horizon Planning
- Planning over many steps or over extended time spans where early decisions affect distant later outcomes. Long-horizon planning is difficult because errors can...
- Long Short-Term Memory
- Long Short-Term Memory is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models...
- LoRA Detail
- LoRA Detail is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Lovable
- An AI-powered full-stack application builder (formerly GPT Engineer) that generates complete web applications from natural language prompts. Lovable creates...
- Low-Rank Adaptation
- A parameter-efficient fine-tuning method, commonly known as LoRA, that updates low-rank matrices instead of all model weights. Low-rank adaptation makes it...
- LSTM
- LSTM is a recurrent neural network architecture with gated memory cells. It is commonly used for sequence modeling where long-range dependencies matter, where...
- Machine Unlearning
- Techniques aimed at removing the influence of specific data from a trained model without fully retraining it from scratch. Machine unlearning is discussed in...
- MAE
- MAE is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and research...
- Manifold Learning
- Manifold Learning is a learning paradigm that improves task performance from data, feedback, or experience. It is commonly used for models that adapt...
- Markov Chain
- Markov Chain is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Markov Chain Monte Carlo
- Markov Chain Monte Carlo is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production...
- Maximum Likelihood Estimation
- Maximum Likelihood Estimation is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production...
- Max Tokens
- A setting that limits how many tokens a model may generate in a response or, in some systems, how large parts of the request can be. Max token settings help...
- Mean Absolute Error
- Mean Absolute Error is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models...
- Mean Squared Error
- Mean Squared Error is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Mechanistic Interpretability
- Mechanistic Interpretability is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production...
- Memorization
- Memorization is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Memory Augmented Network
- Memory Augmented Network is a model component or design choice that shapes how information flows through a learned system. It is commonly used for building...
- Memory Bank
- A store of information used by an AI system to retain and retrieve prior context, facts, or learned artifacts outside the immediate prompt window. Memory banks...
- Memory Module
- A dedicated component responsible for storing, updating, or retrieving information used by an AI system beyond transient prompt context. A memory module may be...
- Mental Model AI
- The user's or designer's conceptual model of how an AI system works, what it knows, and how it will behave in different situations. Clear mental models are...
- Mesa-Optimization
- A concept in AI alignment referring to a learned subsystem that itself behaves like an optimizer pursuing objectives that may differ from the outer training...
- Meta-Learning
- Meta-Learning is a learning paradigm that improves task performance from data, feedback, or experience. It is commonly used for models that adapt...
- Midjourney
- An AI image generation service known for producing highly aesthetic, artistic images from text prompts. Originally accessed exclusively through Discord bot...
- Mini-Batch
- Mini-Batch is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Mistral
- Mistral is a family of open and commercial language models from Mistral AI. It is commonly used for instruction following, coding, and efficient serving, where...
- mixture of agents
- An architecture where multiple LLM agents collaborate by having each agent process the outputs of others in iterative rounds, leveraging the phenomenon that...
- Mixture of Depths
- An architectural idea where different tokens or inputs receive different amounts of computational depth, allowing the model to spend more effort on harder...
- Model Alignment
- The extent to which a model's behavior matches intended goals, human values, policy constraints, or task requirements. Model alignment is a broad concern...
- Model Benchmark
- A benchmark used to compare models on one or more tasks, capabilities, or operational metrics. Model benchmarks help guide selection, but they should be...
- Model Config
- The configuration associated with a model deployment or usage pattern, including model version, decoding settings, context limits, adapters, and operational...
- Model Context
- The information available to a model at inference time, including the prompt, conversation history, retrieved documents, tool outputs, and other supplied...
- Model Cost
- The cost associated with training, hosting, or running a model in production, including compute, storage, licensing, and operational overhead. Model cost...
- Model Deployment
- The process and resulting setup for releasing a model into an environment where it can serve real workloads. Model deployment includes packaging, routing,...
- Model Editor
- A tool or interface used to inspect, configure, or modify model-related assets such as prompts, adapters, metadata, or deployment settings. The term is usually...
- Model Efficiency
- How effectively a model uses compute, memory, and time to deliver useful performance for a given task. Model efficiency matters because a slightly less capable...
- Model Endpoint
- An API endpoint through which applications send requests to a specific model or model-backed service. Model endpoints often expose inference, embeddings,...
- Model Error
- An error arising from model behavior, model execution, or model-based prediction rather than from ordinary application logic alone. Model errors may include...
- Model Eval
- An evaluation process or result used to measure how a model performs on chosen tasks, datasets, or business criteria. Teams rely on model evals to compare...
- Model Family
- A related set of model versions or sizes built from the same underlying architecture or development line. Model families often share capabilities and...
- Model Fingerprint
- An identifier or signature used to distinguish a specific model build, configuration, or inference environment from others. Model fingerprints help trace...
- Model Format
- The file or representation format used to store, exchange, or load model weights and related metadata. Model format choices affect portability, performance,...
- Model Gateway
- A gateway layer that manages traffic to one or more models and often adds logging, policy enforcement, routing, authentication, and rate control. Model...
- Model Generation
- The output produced by a model, or in some contexts the act of generating that output from a prompt or input. The phrase is broad and typically refers to text,...
- Model Hosting
- The infrastructure and operational setup used to run and serve models, whether managed by a provider or self-hosted by a team. Model hosting affects cost,...
- Model ID
- A specific identifier used to select or reference a model in code, configuration, or deployment systems. Model IDs are critical in production because closely...
- Model Input
- The data supplied to a model for processing, such as text, images, prompts, metadata, or retrieved context. Model input quality and structure strongly...
- Model Integration
- The work of connecting a model to an application, workflow, or platform so it can be used as part of a real product. Model integration includes APIs, prompts,...
- Model Interface
- The defined way other software or users interact with a model, including input shape, output structure, supported parameters, and behavioral expectations. A...
- Model Latency
- The delay introduced by the model portion of a system, from receiving input to producing output. Model latency is a key product metric because users notice...
- Model License
- The legal terms governing how a model can be used, modified, distributed, or commercialized. Model licenses matter because they can restrict deployment...
- Model Lifecycle
- The full life of a model from selection or training through evaluation, deployment, monitoring, updates, and retirement. Managing the model lifecycle well...
- Model Limit
- A practical or technical boundary on model behavior, such as context size, latency tolerance, modality support, or reliability under certain conditions....
- Model Metric
- A metric used to measure some aspect of model behavior, such as accuracy, latency, cost, calibration, or acceptance rate. Model metrics are most useful when...
- Model Migration
- The process of moving a workflow or product from one model, model family, or serving setup to another. Model migrations require careful testing because subtle...
- Model Monitor
- A monitoring system or process used to track model quality, latency, safety, or drift over time. Model monitors help catch degradation that benchmarks and...
- Model Name
- The human-readable name used to refer to a model in product docs, configuration, or provider catalogs. Model names are useful, but engineering systems usually...
- Model Optimization
- Improving a model or its serving path for better quality, efficiency, speed, or cost through tuning, pruning, quantization, routing, or infrastructure changes....
- Model Output
- The result returned by a model after processing its input, whether as text, labels, scores, embeddings, images, or structured fields. Model output often needs...
- Model Parameter
- A parameter within a model, or in product usage a configurable setting that affects model behavior. The term can refer either to learned weights or to external...
- Model Performance
- How well a model performs on the dimensions that matter for a task, such as accuracy, speed, cost, robustness, or user satisfaction. Model performance should...
- Model Pipeline
- A pipeline built around a model, including input preparation, inference, post-processing, logging, and any supporting retrieval or validation steps. Model...
- Model Platform
- A shared platform that standardizes how teams discover, evaluate, deploy, and monitor models. Model platforms reduce duplicated infrastructure work and help...
- Model Plugin
- A plugin that adds model-related capabilities to a product, or a modular model component integrated into a larger system. The exact meaning depends on the...
- Model Prediction
- A prediction or output produced by a model based on its input. The term is common in both classic machine learning and modern generative systems, though in...
- Model Quality
- The overall usefulness and reliability of a model's outputs for the intended task, considering correctness, consistency, safety, and user acceptance. Model...
- Model Release
- A released version of a model made available for testing or production use. Model releases may include updated weights, changed behavior, new limits, or...
- Model Request
- A single request sent to a model or model-backed endpoint, including input data and relevant settings. Tracking model requests is important for debugging,...
- Model Response
- The response returned by a model after processing a request. Depending on the system, a model response may include text, scores, embeddings, tool calls, or...
- Model Safety
- The set of behaviors, controls, and evaluation practices aimed at preventing harmful, unsafe, or policy-violating model outputs and actions. Model safety work...
- Model Scale
- The size or operational scale of a model, whether measured in parameter count, context length, throughput, or production traffic. Model scale shapes...
- Model SDK
- A software development kit that helps applications interact with models through typed calls, retries, streaming helpers, and consistent request handling. Model...
- Model Selection
- The process of choosing which model is best suited for a task, product, or request based on quality, speed, cost, safety, and operational constraints. Model...
- Model Server
- A server or service instance that loads a model and handles inference requests against it. Model servers may support batching, scaling, caching, and health...
- Model Size
- The scale of a model, usually discussed in terms of parameter count, memory footprint, or checkpoint size. Model size affects latency, hardware requirements,...
- Model Speed
- The speed at which a model can return results, often measured by latency or tokens per second. Model speed matters especially in interactive products where...
- Model State
- The current state associated with a model or model session, such as loaded weights, cached context, runtime settings, or internal serving condition. The exact...
- Model Streaming
- The incremental delivery of model output as it is produced rather than returning only a completed result at the end. Model streaming improves perceived...
- Model Temperature
- The temperature setting applied during generation to make output more deterministic or more varied. Higher temperature generally increases randomness, while...
- Model Test
- A test case or testing process used to check model behavior, quality, safety, or performance. Model tests are often included in regression suites before...
- Model Token
- A token as understood by a model's tokenizer and counted for context limits, billing, or generation length. Model token behavior matters because different...
- Model Tokenizer
- The tokenizer associated with a model that converts raw input into tokens and often converts generated tokens back into text. The tokenizer affects context...
- Model Tool
- A tool used to work with models, or a callable tool made available to a model system so it can do more than generate text alone. The exact meaning depends on...
- Model Trace
- A detailed record of how a model request was processed, including input assembly, retrieval steps, inference timing, tool interactions, and validation results....
- Model Update
- An update to a model, its configuration, or its surrounding serving behavior. Model updates can improve quality or capability, but they also introduce...
- Model Usage
- How frequently and in what ways a model is used across products, teams, or workflows. Tracking model usage helps with cost control, capacity planning, and...
- Model Validation
- The process of verifying that a model or model-backed system behaves acceptably before or during deployment. Model validation can include benchmarks,...
- Model Version
- A specific version of a model distinguished from earlier or later versions by weights, configuration, or release status. Explicit model versioning is essential...
- Model Weight
- A learned numerical parameter in a model that influences how inputs are transformed into outputs. Collectively, model weights encode much of the behavior...
- Moderation
- The process of identifying, filtering, or handling unsafe, disallowed, or harmful content in user inputs or AI outputs. Moderation is a core safety function in...
- Moderation API
- An API that classifies or flags content for safety, policy, or risk categories such as violence, self-harm, or harassment. Moderation APIs are often used as...
- Monte Carlo Dropout
- Monte Carlo Dropout is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models...
- Monte Carlo Tree Search
- Monte Carlo Tree Search is a retrieval or nearest-neighbor concept for efficiently finding relevant items in large spaces. It is commonly used for semantic...
- Morphological Analysis
- Morphological Analysis is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models...
- Moshi
- Moshi is a real-time speech-native model architecture aimed at low-latency spoken interaction. It is commonly used for voice assistants and conversational...
- Motion Capture AI
- Motion Capture AI is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Multi-Agent
- Describing a system in which multiple agents or agent-like components work together, divide labor, or verify one another instead of relying on a single...
- Multi-Agent Framework
- A framework designed to help developers build, coordinate, and observe systems composed of multiple agents. Multi-agent frameworks usually provide abstractions...
- Multi-Agent System
- Multi-Agent System is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Multi-Head
- Describing an architecture that uses multiple attention heads or output heads to process information in parallel or from different representational...
- Multi-Head Attention
- Multi-Head Attention is a mechanism that weights the most relevant tokens, positions, or features during computation. It is commonly used for transformers and...
- Multi-Label Classification
- Multi-Label Classification is a modeling approach for assigning one or more labels to an input. It is commonly used for ranking, triage, moderation, and...
- Multi-Modal
- Describing AI systems that can process or generate more than one modality, such as text, images, audio, or video. Multi-modal systems are useful when tasks...
- Multi-Modal Fusion
- Multi-Modal Fusion is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Multimodal Learning
- Multimodal Learning is a learning paradigm that improves task performance from data, feedback, or experience. It is commonly used for models that adapt...
- Multi-Step Reasoning
- Reasoning that unfolds across several logical or computational steps rather than a single immediate response. Multi-step reasoning is important for tasks like...
- Multi-Task Learning
- Multi-Task Learning is a learning paradigm that improves task performance from data, feedback, or experience. It is commonly used for models that adapt...
- Multi-Turn
- Describing an interaction that spans multiple back-and-forth turns rather than a single one-shot request and response. Multi-turn behavior requires the system...
- Multi-Turn Conversation
- A conversation that continues across multiple turns, requiring the AI system to track prior context, clarify ambiguities, and remain consistent over time....
- Mutual Information
- Mutual Information is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Naive Bayes
- Naive Bayes is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Natural Instruction
- An instruction phrased in ordinary natural language rather than formal code or rigid command syntax. Natural instructions make systems easier to use, though...
- Nearest Neighbor Search
- Nearest Neighbor Search is a retrieval or nearest-neighbor concept for efficiently finding relevant items in large spaces. It is commonly used for semantic...
- Needle in a Haystack
- A type of evaluation that tests whether a model can retrieve or use one small crucial detail hidden inside a very large context. The phrase is often used to...
- Negative Sampling
- Negative Sampling is a decoding control that shapes how a generative model selects its next output. It is commonly used for text and multimodal generation...
- Neural Architecture Search
- Neural Architecture Search is a model component or design choice that shapes how information flows through a learned system. It is commonly used for building...
- Neural Compression
- Compression techniques that use neural networks to represent, encode, or reconstruct data more efficiently than traditional methods in some settings. The term...
- Neural Network Detail
- Neural Network Detail is a model component or design choice that shapes how information flows through a learned system. It is commonly used for building neural...
- Neural Network Pruning
- The removal of weights, neurons, or connections from a neural network to make it smaller or more efficient while trying to preserve performance. Pruning is one...
- Neural ODE
- Neural ODE is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Neural Processor
- A processor or accelerator specialized for neural network workloads such as inference or training. Neural processors are designed to handle matrix-heavy...
- Neural Search
- Search based on learned vector representations and semantic similarity rather than only keyword overlap. Neural search is widely used to improve relevance when...
- Neural Style Transfer
- Neural Style Transfer is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models...
- Next Token Prediction
- The task of predicting the next token in a sequence given the preceding context, which is a core training objective for many language models. Despite its...
- Noise Contrastive Estimation
- Noise Contrastive Estimation is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production...
- Noise Injection
- The deliberate addition of noise to inputs, activations, gradients, or parameters during training or testing to improve robustness, exploration, or...
- Noise Schedule
- Noise Schedule is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Non-Deterministic Output
- Output that can vary across repeated runs even when the same input is used, often because of sampling, temperature, system changes, or distributed execution...
- Normalization Layer
- Normalization Layer is a model component or design choice that shapes how information flows through a learned system. It is commonly used for building neural...
- Nucleus Sampling
- Nucleus Sampling is a decoding control that shapes how a generative model selects its next output. It is commonly used for text and multimodal generation...
- Number Theory ML
- Number Theory ML is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Objective Function
- The function a model or training process is trying to optimize, such as minimizing error or maximizing reward. The objective function strongly shapes what the...
- Ollama
- A tool for running large language models locally on personal hardware. Ollama packages model weights, configuration, and a runtime into a simple command-line...
- On-Device AI
- AI processing that runs directly on a user's device rather than entirely in centralized cloud infrastructure. On-device AI can improve latency, privacy, and...
- On-Device Inference
- Inference performed locally on a device rather than in the cloud. On-device inference is valuable when privacy, responsiveness, bandwidth, or offline operation...
- One-Hot Encoding
- One-Hot Encoding is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- One-Shot Learning
- One-Shot Learning is a learning paradigm that improves task performance from data, feedback, or experience. It is commonly used for models that adapt...
- Online Learning
- Online Learning is a learning paradigm that improves task performance from data, feedback, or experience. It is commonly used for models that adapt...
- On-Policy
- Describing reinforcement learning methods that learn from data generated by the current policy being improved rather than from a separate behavior policy....
- OpenAI API
- An API provided by OpenAI for accessing model capabilities such as language generation, reasoning, embeddings, image generation, speech, and other AI workflows...
- Open Source AI
- AI systems, models, tools, or related assets released under terms that allow inspection, modification, and reuse to some degree. The phrase is often debated...
- Optimal Transport
- Optimal Transport is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Opt-In AI
- An AI feature or program that users must actively choose to enable rather than receiving by default. Opt-in AI is often used when teams want explicit consent...
- Outlier Detection
- Outlier Detection is an application task where a model extracts structured meaning or predictions from raw input. It is commonly used for NLP and vision...
- Out-of-Distribution
- Describing inputs or situations that differ meaningfully from the data or conditions a model encountered during training. Out-of-distribution cases are...
- Output Format
- The required structure or presentation style of an AI system's output, such as plain text, markdown, JSON, XML, or a fixed template. Output format matters...
- Output Length
- The length of the content produced by an AI system, often measured in tokens, words, or characters. Output length affects readability, cost, latency, and...
- Output Parsing
- The process of reading and interpreting AI output so it can be consumed by software or validation layers. Output parsing is especially important when models...
- Overfit
- Overfit is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and research...
- Overgeneration
- A failure mode where a model produces more content than necessary, continues beyond the desired stopping point, or adds unsupported elaboration. Overgeneration...
- Overthinking AI
- A situation where an AI system applies unnecessary complexity or excessive reasoning to a simple task, often leading to slower responses or avoidable mistakes....
- Parallel Generation
- Generation strategies or system designs that produce multiple outputs, branches, or partial computations in parallel rather than strictly one sequence at a...
- Parameter Count
- The total number of learned parameters in a model, commonly used as a rough indicator of size and sometimes capability. Parameter count is informative, but it...
- Parameter Efficient
- Describing methods that achieve adaptation or performance gains while changing only a small subset of parameters instead of retraining or updating an entire...
- Parameter Sharing
- A design approach where the same parameters are reused across different parts of a model or across multiple computations. Parameter sharing can reduce model...
- Passive Learning
- Learning from a fixed dataset without actively choosing which examples to request or explore next. Passive learning contrasts with active or interactive...
- PEFT
- PEFT is parameter-efficient fine-tuning methods that update only a small subset of model parameters. It is commonly used for customizing large models without...
- Penalty
- A cost or discouraging adjustment applied during optimization or generation to reduce unwanted behavior such as repetition, excessive length, or policy...
- Perception Module
- Perception Module is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Perceptron
- Perceptron is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Permutation Invariance
- Permutation Invariance is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models...
- Persona AI
- An AI system or configuration designed to present a particular role, tone, expertise profile, or interaction style. Persona-based design can improve usability,...
- Personalization
- Personalization is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Pinecone
- A managed vector database service purpose-built for machine learning applications that need to search over high-dimensional embedding vectors at scale....
- Pixel Shuffle
- Pixel Shuffle is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Planning AI
- AI systems or techniques focused on creating and following plans toward goals rather than only generating one-step responses. Planning AI is especially...
- Pooling Layer
- Pooling Layer is a model component or design choice that shapes how information flows through a learned system. It is commonly used for building neural...
- Position Encoding
- Position Encoding is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Power-Seeking
- Describing behavior that tends to pursue more control, resources, or influence as an instrumental means to achieving objectives. In AI safety discussions,...
- Preference Data
- Data capturing which outputs humans prefer among alternatives, often used to train ranking models, reward models, or alignment systems. Preference data is...
- Preference Learning
- Preference Learning is a learning paradigm that improves task performance from data, feedback, or experience. It is commonly used for models that adapt...
- Preference Model
- A model trained to predict or score human preferences among candidate outputs, often used in alignment and reinforcement learning pipelines. Preference models...
- Prefix
- The starting portion of a prompt, sequence, or context that comes before what the model is asked to generate or complete. Prefixes are important in generation...
- Prefix Tuning
- Prefix Tuning is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Principal Component Analysis
- Principal Component Analysis is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production...
- Probability Distribution
- Probability Distribution is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production...
- Process Reward Model
- A reward model that evaluates the quality of intermediate reasoning steps or process traces rather than scoring only the final answer. Process reward models...
- Production AI
- AI systems that are running in real production environments and serving meaningful workloads rather than being confined to demos or prototypes. Production AI...
- Prolog
- A logic programming language where programs are expressed as relations and rules rather than step-by-step instructions. Prolog's built-in backtracking search...
- Prompt Attack
- An adversarial attempt to manipulate an AI system through crafted input so it ignores instructions, reveals restricted information, or behaves in unintended...
- Prompt Cache
- A cache that stores prompt-related computations or repeated prompt results so equivalent requests can be handled more cheaply and quickly. Prompt caches are...
- Prompt Compression
- The practice of reducing prompt length while preserving the instructions or context needed for good performance. Prompt compression helps with latency, cost,...
- Prompt Design
- The work of structuring instructions, examples, formatting, and context so an AI model behaves as intended. Prompt design is both a product and engineering...
- Prompt Evaluation
- The process of measuring how well a prompt performs across relevant tasks, edge cases, and quality criteria. Prompt evaluation is important because prompts...
- Prompt Format
- The structure and layout of a prompt, including sections, delimiters, examples, and formatting conventions. Prompt format can affect how clearly the model...
- Prompt Guard
- A safeguard or validation layer intended to protect prompts or detect dangerous prompt conditions such as injection, policy violations, or malformed context....
- Prompt Library
- A shared collection of reusable prompts, templates, or prompt components maintained for consistency across teams or products. Prompt libraries make it easier...
- Prompt Management
- The operational practice of organizing, versioning, reviewing, testing, and deploying prompts in a controlled way. Prompt management becomes important once...
- Prompt Optimization
- Improving prompt performance for quality, consistency, cost, or latency through iteration, testing, and measurement. Prompt optimization often yields large...
- Prompt Pipeline
- A pipeline that assembles, transforms, validates, and sends prompts as part of a larger AI workflow. Prompt pipelines often include template filling, retrieval...
- Prompt Registry
- A registry used to store, version, and track prompts and related metadata such as owners, evaluations, and rollout status. Prompt registries help teams treat...
- Prompt Rewriting
- The act of rewriting a prompt to improve clarity, control behavior, reduce ambiguity, or adapt to a different model or workflow. Prompt rewriting is common...
- Prompt Safety
- The practice of designing prompts and prompt-handling systems so they are resistant to misuse, injection, leakage, or unsafe behavior. Prompt safety overlaps...
- Prompt Strategy
- The overall approach used to design and apply prompts across a task or product, including instruction order, examples, tool use, and fallback behavior. Prompt...
- Prompt Suffix
- The portion of a prompt or sequence that comes after some focal gap or inserted content, often discussed in editing or fill-in-the-middle tasks. Suffixes help...
- Prompt System
- The full system of prompt templates, assembly logic, versioning, and operational controls used to drive AI behavior in a product. The term emphasizes that...
- Prompt Testing
- The practice of testing prompts against known cases, edge conditions, and regression suites to verify behavior before release. Prompt testing is necessary...
- Prompt Token
- A token consumed by the prompt portion of a model request, including system instructions, examples, user content, and retrieved context. Prompt token counts...
- Prompt Versioning
- The practice of assigning explicit versions to prompts so changes can be tracked, compared, rolled back, and audited. Prompt versioning is especially important...
- Protein Folding AI
- Protein Folding AI is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Proxy Task
- A task used as a stand-in for a harder-to-measure real objective, often because the true target is expensive or ambiguous to evaluate directly. Proxy tasks are...
- QLoRA
- QLoRA is a parameter-efficient fine-tuning method that combines low-rank adapters with quantized base weights. It is commonly used for adapting large language...
- Quality Filter
- A filter or validation step that screens AI outputs for quality criteria such as correctness, completeness, formatting, or groundedness before they are...
- Question Answering
- Question Answering is an application task where a model extracts structured meaning or predictions from raw input. It is commonly used for NLP and vision...
- RAFT
- RAFT is a dense optical-flow architecture based on recurrent all-pairs field transforms. It is commonly used for estimating pixel-level motion between video...
- RAG Architecture
- The overall system design for retrieval-augmented generation, including indexing, chunking, retrieval, ranking, prompt assembly, and answer generation. RAG...
- RAG Chain
- A retrieval-augmented generation workflow built as a sequence of connected steps such as query rewriting, retrieval, reranking, and final generation. The...
- RAG Chunk
- A chunk of source content prepared for indexing and retrieval in a retrieval-augmented generation system. Chunk size and boundaries affect both what gets...
- RAG Context
- The retrieved material inserted into a prompt as supporting context for a retrieval-augmented generation system. RAG context needs to be relevant and concise...
- RAG Embedding
- An embedding used within a retrieval-augmented generation system to represent documents, chunks, or queries for semantic search. The embedding model chosen for...
- RAG Evaluation
- The evaluation of retrieval-augmented generation systems across dimensions such as retrieval relevance, grounding, citation quality, answer correctness, and...
- RAG Framework
- A framework that provides components or abstractions for building retrieval-augmented generation systems, such as indexing, retrievers, prompt templates, and...
- RAG Index
- The searchable index used by a retrieval-augmented generation system to locate relevant source material. A RAG index may store embeddings, metadata, keywords,...
- RAG Pipeline
- The full retrieval-augmented generation pipeline, including ingestion, chunking, indexing, retrieval, reranking, prompt assembly, generation, and validation....
- RAG Query
- A query sent into a retrieval-augmented generation workflow to retrieve relevant supporting material before generation. RAG queries may be raw user questions...
- RAG Retriever
- The retriever component in a retrieval-augmented generation system that selects candidate documents or chunks for the model to use as context. Retriever...
- RAG Search
- The retrieval search process within a retrieval-augmented generation system, often combining semantic, keyword, or hybrid approaches. RAG search determines...
- RAG System
- A complete retrieval-augmented generation system that combines search or retrieval with generation so answers can be grounded in external knowledge. RAG...
- Random Forest
- Random Forest is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Random Search
- Random Search is a retrieval or nearest-neighbor concept for efficiently finding relevant items in large spaces. It is commonly used for semantic search,...
- Rank Fusion
- Rank Fusion is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Ranking Model
- A model used to score and order candidate items such as documents, answers, ads, or recommendations according to relevance or quality. Ranking models are...
- Reasoning
- Reasoning is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and research...
- Reasoning Agent
- An agentic AI component focused on planning, decomposing problems, or carrying out reasoning-heavy tasks, often with access to tools or memory. Reasoning...
- Reasoning Benchmark
- A benchmark designed to test reasoning ability, such as multi-step logic, math, planning, or problem decomposition. Reasoning benchmarks are useful, but they...
- Reasoning Chain
- Reasoning Chain is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Reasoning Error
- An error caused by faulty logical steps, invalid assumptions, or broken inference inside an AI system's reasoning process. Reasoning errors can occur even when...
- Reasoning Model
- A model optimized or selected for tasks that require stronger multi-step inference, planning, or problem decomposition rather than simple pattern matching...
- Reasoning Step
- An individual step within a larger reasoning process or chain of inference. Teams talk about reasoning steps when analyzing how an AI system reached a...
- Reasoning Token
- A token used during reasoning-focused generation or internal reasoning traces, often discussed in the context of cost, latency, or long multi-step responses....
- Reasoning Trace
- A record or visible sequence of reasoning-related steps, intermediate thoughts, or problem-solving actions used to analyze how an AI system arrived at its...
- Receptive Field
- Receptive Field is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Recommendation System
- Recommendation System is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models...
- Recurrent Neural Network
- Recurrent Neural Network is a model component or design choice that shapes how information flows through a learned system. It is commonly used for building...
- Red Team AI
- The practice of adversarially testing AI systems to uncover unsafe behavior, security weaknesses, misuse pathways, or policy failures before deployment. Red...
- Refusal
- A response pattern in which an AI system declines to comply with a request because it is unsafe, disallowed, unsupported, or outside system boundaries. Good...
- Refusal Training
- Training or tuning methods intended to improve when and how an AI system refuses unsafe, disallowed, or unsupported requests. Refusal training is part of...
- Regression
- Regression is a supervised learning method for estimating numeric outputs from input features. It is commonly used for prediction pipelines and baseline...
- Regression in AI
- A deterioration in AI system behavior after a change such as a new model, prompt, index, or configuration update. AI regressions may appear as lower quality,...
- Relevance Score
- A score used to estimate how relevant a document, chunk, or answer is to a query or task. Relevance scores are common in search, retrieval, and reranking...
- Repetition Penalty
- A decoding adjustment that discourages a model from repeating the same tokens, words, or phrases too often during generation. Repetition penalties help reduce...
- Replay Buffer
- A stored collection of past experiences or transitions used in reinforcement learning so training can reuse prior data instead of relying only on the newest...
- Replicate
- A platform for running open-source machine learning models in the cloud via a simple API. Replicate lets developers run models without managing infrastructure:...
- Replit Agent
- An AI agent built into the Replit cloud development platform that can build, deploy, and iterate on software applications from natural language instructions....
- Representation
- The encoded form in which a model captures information about inputs, concepts, or patterns internally. Representations shape what distinctions the model can...
- Representation Learning
- Representation Learning is a learning paradigm that improves task performance from data, feedback, or experience. It is commonly used for models that adapt...
- Residual Connection
- Residual Connection is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models...
- Residual Network
- Residual Network is a model component or design choice that shapes how information flows through a learned system. It is commonly used for building neural...
- Response Format
- The required structure or layout of an AI response, such as plain text, markdown, bullets, JSON, or a schema-defined object. Response format matters because...
- Response Length
- The length of an AI response, often discussed in terms of tokens, words, or user-perceived verbosity. Response length affects cost, latency, readability, and...
- Response Quality
- The overall usefulness, correctness, clarity, and appropriateness of an AI response for a given task. Response quality is often judged by a mix of human...
- Response Time AI
- The time it takes an AI system to return a response, including retrieval, model inference, validation, and any other steps on the critical path. Response time...
- Response Token
- A token generated in the response portion of a model call. Response tokens are often tracked separately from prompt tokens because they influence output...
- retrieval
- In the context of LLM applications, the process of fetching relevant documents or data chunks from an external knowledge base to provide as context for the...
- Retrieval Model
- A model used to retrieve relevant information, often by creating embeddings, ranking candidates, or estimating semantic similarity. Retrieval models are...
- Retrieval Pipeline
- The pipeline that turns a query into retrieved evidence, often including rewriting, embedding, search, ranking, filtering, and context assembly. Retrieval...
- Retrieval Quality
- How well a retrieval system finds the right information for a given query, considering relevance, freshness, completeness, and ranking order. Retrieval quality...
- Retriever
- The component in a search or RAG system that fetches candidate information relevant to a query. Retrievers may use embeddings, keywords, hybrid search, or...
- Reward Engineering
- The design and tuning of reward signals, reward models, or scoring functions so learning systems optimize for the intended behavior. Reward engineering is...
- Reward Signal
- The signal used to tell a learning system how good or bad an action, output, or trajectory was. Reward signals drive optimization, so poorly specified signals...
- Ring Attention
- Ring Attention is a mechanism that weights the most relevant tokens, positions, or features during computation. It is commonly used for transformers and...
- RLHF Detail
- RLHF Detail is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- RNN
- RNN is a recurrent neural network that reuses state across time steps. It is commonly used for language, audio, and time-series sequence modeling, where teams...
- Robustness
- The ability of an AI system to remain useful and stable across noisy inputs, edge cases, shifting conditions, and small perturbations. Robustness matters...
- Running Average
- Running Average is a training-time optimization concept that governs how model parameters are updated. It is commonly used for iterative learning loops for...
- Safety Benchmark
- A benchmark specifically designed to measure safety-related behavior such as refusal quality, harm avoidance, policy compliance, or robustness to adversarial...
- Safety Evaluation
- The broader process of assessing whether an AI system behaves safely under expected use and misuse scenarios. Safety evaluation may include red teaming,...
- Safety Policy
- A policy that defines what an AI system should and should not do from a safety and acceptable-use perspective. Safety policies guide training, prompting,...
- Safety Testing
- Testing focused on unsafe behavior, policy violations, prompt injection, abuse scenarios, and other safety-relevant failure modes. Safety testing is often done...
- Safety Training
- Training or tuning intended to improve safe behavior, refusal quality, and compliance with policies or human preferences. Safety training is one layer among...
- Sample Efficiency
- Sample Efficiency is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Sampling Strategy
- Sampling Strategy is a decoding control that shapes how a generative model selects its next output. It is commonly used for text and multimodal generation...
- Sampling Temperature
- Sampling Temperature is a decoding control that shapes how a generative model selects its next output. It is commonly used for text and multimodal generation...
- Scaffold AI
- An AI system that relies on scaffolding around the core model, such as planning loops, tools, memory, or verification steps, to achieve stronger behavior than...
- scaffolding
- The orchestration code surrounding an LLM that provides structure, tool access, memory, and control flow to transform a raw language model into a functional...
- Scale AI
- The challenge or practice of operating AI systems at large usage levels, larger model sizes, or across many teams and products. The phrase can also appear...
- Scaling Hypothesis
- The idea that simply scaling up model size, data, and compute can continue to produce substantial capability gains. The scaling hypothesis is influential in...
- Scheduled Sampling
- Scheduled Sampling is a decoding control that shapes how a generative model selects its next output. It is commonly used for text and multimodal generation...
- Schema-Guided Generation
- Generation constrained by an explicit schema so outputs conform to a required structured format such as JSON objects with specific fields. Schema-guided...
- Score Function
- A function that assigns scores to outputs, actions, candidates, or states so they can be compared, ranked, or optimized. Score functions appear in ranking,...
- Score Matching
- Score Matching is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Scoring Model
- A model used to score candidates, outputs, or states according to relevance, quality, safety, or another target property. Scoring models are common in ranking,...
- Seed AI
- A hypothetical initial AI system capable of meaningfully improving itself or helping create more capable successor systems. The term appears mainly in...
- Self-Attention
- Self-Attention is a mechanism that weights the most relevant tokens, positions, or features during computation. It is commonly used for transformers and...
- Self-Consistency
- A prompting or decoding strategy in which multiple reasoning paths or outputs are generated and then compared to select the most consistent answer....
- Self-Correction
- The ability or workflow by which an AI system identifies and fixes its own mistakes after initial generation. Self-correction can improve quality, though it...
- Self-Critique
- A step in which an AI system critiques its own output against a rubric, policy, or reasoning standard before revising it. Self-critique is often used in...
- Self-Evaluation
- An AI system's attempt to evaluate the quality, correctness, or confidence of its own outputs. Self-evaluation can be helpful, but it is not automatically...
- Self-Improvement
- The process by which an AI system helps improve its own capabilities, training process, or supporting infrastructure over time. The term appears both in...
- Self-Instruct
- A method of generating synthetic instruction-following data using models themselves, often to expand training datasets without fully manual labeling....
- Self-Play
- Self-Play is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and research...
- Self-Reflection
- A reflective step where an AI system reviews its own reasoning, assumptions, or output quality and may revise accordingly. Self-reflection is often used to...
- Self-Supervised
- Describing learning methods that use structure already present in unlabeled data to create training signals, rather than relying on externally labeled...
- Self-Supervised Learning
- Self-Supervised Learning is a learning paradigm that improves task performance from data, feedback, or experience. It is commonly used for models that adapt...
- Semantic Memory
- Memory of general facts, concepts, or knowledge rather than specific episodic experiences. In AI system design, the term is used when distinguishing broad...
- Semantic Similarity
- Semantic Similarity is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models...
- Semi-Supervised Learning
- Semi-Supervised Learning is a learning paradigm that improves task performance from data, feedback, or experience. It is commonly used for models that adapt...
- Sentence Completion
- A generation task where the model is asked to complete a partial sentence in a coherent and contextually appropriate way. Sentence completion is a simple but...
- Sequence Length
- The number of tokens or elements in a sequence processed by a model. Sequence length affects memory use, compute cost, and how much context a system can handle...
- Sequence Model
- A model designed to process ordered sequences such as text, audio, or time-series data while accounting for order and context. Sequence models include...
- SGD
- SGD is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and research...
- SIGLIP
- SIGLIP is a vision-language model family trained with sigmoid contrastive objectives instead of softmax normalization. It is commonly used for image-text...
- Sigmoid
- Sigmoid is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and research...
- Similarity Search
- Similarity Search is a retrieval or nearest-neighbor concept for efficiently finding relevant items in large spaces. It is commonly used for semantic search,...
- Situational Awareness
- Awareness of relevant context about the environment, task, capabilities, and constraints in which a system is operating. In AI discussions, situational...
- Skill Composition
- The combination of multiple capabilities or specialized skills into a larger workflow so an AI system can solve more complex tasks. Skill composition is...
- Skip Connection
- Skip Connection is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Sleeper Agent
- A hypothetical or experimental agent that appears benign under ordinary conditions but behaves differently when specific triggers are met. The concept is...
- slop
- Low-quality, generic content mass-produced by AI models, typically characterized by saccharine tone, excessive hedging phrases, and a lack of genuine insight....
- Small Language Model
- A language model that is smaller in parameter count and operational cost than frontier-scale models, often optimized for speed, specialization, or on-device...
- Smart Reply
- A short AI-generated suggested reply offered to users in messaging, email, or support interfaces. Smart replies are designed for speed and convenience rather...
- Softmax
- Softmax is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and research...
- Soft Prompt
- A learnable prompt representation, typically implemented as trainable embeddings, that influences model behavior without changing the full model weights. Soft...
- Sparse Attention
- Sparse Attention is a mechanism that weights the most relevant tokens, positions, or features during computation. It is commonly used for transformers and...
- Sparse Mixture of Experts
- Sparse Mixture of Experts is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production...
- Sparse Model
- A model in which only a subset of parameters or pathways are active for a given input, rather than using the full parameter set every time. Sparse models can...
- Sparse Retrieval
- Sparse Retrieval is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Specification Gaming
- A failure mode where a system exploits loopholes in its objective or specification to achieve high reward or apparent success without doing what was actually...
- Speculative Decoding
- Speculative Decoding is a decoding control that shapes how a generative model selects its next output. It is commonly used for text and multimodal generation...
- Steering Vector
- A direction in representation space that can be used to steer model behavior by shifting internal activations toward or away from certain concepts or styles....
- Stemming
- Stemming is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and research...
- Step-by-Step
- Describing instructions or outputs that proceed one step at a time rather than jumping directly to the conclusion. Step-by-step prompting is often used to...
- Step Function
- Step Function is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Stop Sequence
- A token sequence that tells a generation system where to stop producing output when that sequence appears. Stop sequences are used to control output boundaries...
- Stride
- Stride is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and research...
- Strong AI
- Strong AI is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and research...
- Structured Generation
- Generation constrained to produce output in a defined structure such as JSON, tables, typed fields, or schema-aligned objects rather than free-form text alone....
- Student Model
- A smaller or simpler model trained to imitate or approximate the behavior of a larger teacher model. Student models are often used to reduce cost and latency...
- Style Transfer
- Style Transfer is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Sub-Word
- A piece of a word used as a tokenization unit so models can handle rare words, variations, and new forms more efficiently than with whole-word vocabularies...
- Summarization
- Summarization is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Superposition
- A phenomenon in which multiple concepts or features appear to be represented in overlapping ways within the same model components rather than each having a...
- Supervised
- Describing learning that uses labeled examples or explicit targets to teach a model the desired mapping from inputs to outputs. Supervised methods remain...
- Supervised Fine-Tuning
- Supervised Fine-Tuning is a stage of model optimization where weights or behaviors are adjusted from data or feedback. It is commonly used for foundation-model...
- Supervised Learning
- Supervised Learning is a learning paradigm that improves task performance from data, feedback, or experience. It is commonly used for models that adapt...
- Surrogate Model
- A simpler or cheaper model used to approximate a more expensive process, objective, or system during optimization or experimentation. Surrogate models help...
- Synthetic Data Generation
- Synthetic Data Generation is a generative modeling concept for producing new content such as text, images, audio, or video. It is commonly used for creative...
- synthetic training data
- Training data generated by AI models rather than collected from humans, used to train or fine-tune other models. While dramatically cheaper to produce,...
- System 1 and System 2
- System 1 and System 2 is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models...
- System Card
- A document that describes an AI system's purpose, capabilities, limitations, risks, and evaluation results so stakeholders can understand how it should be...
- System Message
- A high-priority instruction message used to define the assistant's role, rules, or behavior before user input is considered. System messages are often used to...
- system prompt
- System prompt is the initial set of instructions given to a large language model (LLM) that defines its behavior, personality, constraints, and capabilities...
- Tabular Learning
- Tabular Learning is a learning paradigm that improves task performance from data, feedback, or experience. It is commonly used for models that adapt...
- Task Decomposition
- Breaking a larger task into smaller subtasks that can be solved, checked, or delegated more easily. Task decomposition is common in agent workflows because it...
- Task Planning
- The process of deciding the sequence of steps needed to complete a goal, often including dependencies, tool use, and checkpoints. Task planning is a core...
- Teacher Forcing
- Teacher Forcing is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Temperature Scaling
- Temperature Scaling is a decoding control that shapes how a generative model selects its next output. It is commonly used for text and multimodal generation...
- Temporal Difference Learning
- Temporal Difference Learning is a learning paradigm that improves task performance from data, feedback, or experience. It is commonly used for models that...
- Test-Time Compute
- Test-Time Compute is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Text Chunking
- The process of splitting text into smaller segments for indexing, retrieval, summarization, or model input. Text chunking affects what context is preserved and...
- Text Classification
- Text Classification is a modeling approach for assigning one or more labels to an input. It is commonly used for ranking, triage, moderation, and structured...
- Text Generation
- Text Generation is a generative modeling concept for producing new content such as text, images, audio, or video. It is commonly used for creative tools,...
- Text Processing
- The preparation, transformation, and analysis of text for use in AI systems, including cleaning, tokenization, normalization, extraction, and formatting. Good...
- Text Splitter
- A tool or component that splits text into segments according to rules such as length, sentence boundaries, structure, or semantic units. Text splitters are...
- Text-to-SQL
- Text-to-SQL is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- TFDS
- TFDS is TensorFlow Datasets, a curated collection of ready-to-load datasets and dataset loaders. It is commonly used for standardized benchmarking and...
- Thinking Token
- A token associated with intermediate reasoning or extended deliberation in a model's generation process. The term is often used when discussing tradeoffs...
- Think Step by Step
- A prompting instruction intended to encourage the model to reason in a more deliberate multi-step way rather than answering immediately. It is commonly used in...
- Throughput AI
- The rate at which an AI system can process requests, tasks, or tokens over time under real operating conditions. Throughput matters for capacity planning and...
- Together AI
- A cloud platform for running, fine-tuning, and training open-source AI models. Together AI provides an inference API for popular open models (LLaMA, Mistral,...
- Token Count
- The number of tokens present in a prompt, response, document, or full model interaction. Token count affects cost, latency, and whether a request fits within...
- Token Embedding
- The vector representation associated with a token so the model can process it numerically rather than as raw text. Token embeddings are a foundational part of...
- Token Generation
- The step-by-step generation of tokens by a model during inference. Token generation speed and quality shape both latency and the final usefulness of the...
- Token Healing
- Techniques used to smooth awkward token-boundary behavior, especially when continuing partially written text or handling boundaries that would otherwise...
- Token ID
- The numeric identifier assigned to a token in a model's vocabulary. Token IDs are used internally by tokenizers and models to represent text as discrete...
- Token Merging
- A tokenization or model-efficiency technique in which tokens or token-like units are merged to reduce computation or represent text more compactly. The term...
- Token Prediction
- The act of predicting the next token or candidate tokens in a sequence based on prior context. Token prediction is the core mechanism behind many language...
- Token Probability
- The probability a model assigns to a particular token as the next output in a given context. Token probabilities are useful for scoring, confidence analysis,...
- Token Sampling
- The process of selecting output tokens from a probability distribution during generation rather than always taking the single highest-probability choice. Token...
- Token Sequence
- An ordered sequence of tokens representing an input, output, or intermediate model state. Token sequences are the basic units many language models operate...
- tokens per second
- The standard throughput metric for language model inference, measuring how many tokens a model can generate per second. Higher TPS enables more responsive user...
- Tool Agent
- An AI agent designed to use tools such as search, code execution, databases, or APIs as part of completing tasks. Tool agents are important when text...
- Tool Call
- A structured request from an AI system to invoke an external tool, function, or API instead of only generating plain text. Tool calls let models interact with...
- Tool Integration
- The work of connecting external tools, APIs, or services into an AI workflow so the system can act on real data or systems. Tool integration raises questions...
- Tool Planning
- The process of deciding which tools to use, in what order, and with what inputs to accomplish a task. Tool planning is a core challenge in agent systems that...
- Tool Selection
- The act of choosing the most appropriate tool for a given query, step, or task. Good tool selection helps avoid wasted actions and reduces the chance of wrong...
- tool use
- The capability of a language model to invoke external functions, APIs, or services during response generation. Rather than relying solely on its training data,...
- Tool Use Detail
- Tool Use Detail is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Top-K Sampling
- Top-K Sampling is a decoding control that shapes how a generative model selects its next output. It is commonly used for text and multimodal generation systems...
- Top-P Sampling
- Top-P Sampling is a decoding control that shapes how a generative model selects its next output. It is commonly used for text and multimodal generation systems...
- Training Budget
- The amount of money, compute, time, or engineering effort available for training or fine-tuning a model. Training budgets constrain how much experimentation...
- Training Config
- The set of configuration values used for a training run, such as learning rate, batch size, optimizer choice, schedule, and data settings. Training config...
- Training Cost
- The total cost of training a model, including compute usage, storage, engineering time, data preparation, and supporting infrastructure. Training cost is a...
- Training Curriculum
- The planned ordering or progression of training examples, tasks, or difficulty levels over the course of learning. Training curricula are used when the...
- Training Data Curation
- The deliberate selection, cleaning, labeling, and organization of data used for training. Training data curation strongly shapes model quality because noisy or...
- Training Dataset
- The dataset used to train or fine-tune a model. The training dataset largely determines what patterns the model will learn and where it may later succeed or...
- Training Distribution
- The distribution of examples, patterns, and conditions present in the data a model was trained on. A mismatch between training distribution and real-world use...
- Training Dynamics
- The behavior of the training process over time, including how loss, gradients, representations, and performance evolve during learning. Studying training...
- Training Efficiency
- How effectively a training setup converts compute, data, and time into improved model performance. Better training efficiency means reaching useful quality...
- Training Infrastructure
- The hardware, software, orchestration, storage, and operational systems used to run model training. Training infrastructure becomes a major engineering...
- Training Loss
- The loss measured on training data during model learning, used to indicate how well the model is fitting the current examples according to the objective....
- Training Objective
- The objective function or goal that training is trying to optimize, such as next-token prediction, classification accuracy, or reward maximization. The...
- Training Pipeline
- The full pipeline that prepares data, configures jobs, runs training, evaluates checkpoints, and promotes successful artifacts. Training pipelines help make...
- Training Recipe
- A practical specification for how to train a model, including data setup, optimizer, schedules, regularization, and engineering tricks that together produce a...
- Training Schedule
- The plan governing how training progresses over time, such as learning rate schedules, phase transitions, checkpoint timing, or staged dataset exposure....
- Training Strategy
- The overall approach a team takes to training a model, including data choices, objectives, scaling decisions, adaptation methods, and evaluation criteria....
- Trajectory
- A sequence of states, actions, observations, or decisions taken over time in a learning or agentic environment. Trajectories are central in reinforcement...
- Transfer Learning
- Transfer Learning is a learning paradigm that improves task performance from data, feedback, or experience. It is commonly used for models that adapt...
- Transformer Architecture
- Transformer Architecture is a model component or design choice that shapes how information flows through a learned system. It is commonly used for building...
- Transformer Block
- Transformer Block is a model component or design choice that shapes how information flows through a learned system. It is commonly used for building neural...
- Transformer Decoder
- Transformer Decoder is a model component or design choice that shapes how information flows through a learned system. It is commonly used for building neural...
- Transformer Encoder
- Transformer Encoder is a model component or design choice that shapes how information flows through a learned system. It is commonly used for building neural...
- Tree of Thought
- Tree of Thought is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Truncation
- Truncation is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Truthfulness
- The tendency of an AI system to provide answers that are factually correct and not misleading, rather than merely plausible-sounding. Truthfulness is distinct...
- Tuning
- Tuning is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and research...
- Turing Award
- Turing Award is the highest-profile award in computer science, often compared with a Nobel Prize for the field. It is commonly used for recognizing...
- Uncertainty
- A measure or acknowledgment of how unsure an AI system is about an answer, prediction, or decision. Handling uncertainty well is important because systems...
- Uncertainty Estimation
- Techniques used to estimate how uncertain a model is about its outputs or predictions. Uncertainty estimation is useful for deciding when to escalate to...
- Uncertainty Quantification
- The formal measurement and expression of uncertainty in model outputs, predictions, or system behavior. Uncertainty quantification is important in high-stakes...
- Underfitting
- Underfitting is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- U-Net
- U-Net is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and research...
- Unlabeled Data
- Unlabeled Data is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Unlocking
- The act of revealing or eliciting stronger model performance through better prompting, tooling, data, or workflow design rather than through a new underlying...
- Unstructured Data AI
- AI systems or workflows focused on processing unstructured data such as documents, images, conversations, audio, or free-form text rather than neatly labeled...
- Unsupervised Learning
- Unsupervised Learning is a learning paradigm that improves task performance from data, feedback, or experience. It is commonly used for models that adapt...
- Upsampling
- Upsampling is a decoding control that shapes how a generative model selects its next output. It is commonly used for text and multimodal generation systems...
- Utility Function AI
- The concept of defining AI behavior around a utility function that encodes what outcomes should be preferred or optimized. The term appears mainly in alignment...
- v0
- An AI-powered UI generation tool by Vercel that creates React components from text descriptions or screenshots. Users describe the interface they want in...
- VAE
- VAE is a probabilistic generative model that learns a continuous latent space with variational objectives. It is commonly used for representation learning,...
- Validation Loss
- The loss measured on validation data rather than on training data, used to assess generalization during model development. Rising validation loss can signal...
- Validation Metric
- A metric calculated on validation data to assess whether a model is improving in the ways that matter for the task. Validation metrics help teams decide when...
- Validation Set
- Validation Set is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Value Function
- Value Function is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Variational Autoencoder
- Variational Autoencoder is a model component or design choice that shapes how information flows through a learned system. It is commonly used for building...
- Variational Inference
- Variational Inference is the phase where a trained model processes new inputs to produce predictions or generations. It is commonly used for production APIs,...
- Vector Index
- Vector Index is a retrieval or nearest-neighbor concept for efficiently finding relevant items in large spaces. It is commonly used for semantic search,...
- Vector Search
- Vector Search is a retrieval or nearest-neighbor concept for efficiently finding relevant items in large spaces. It is commonly used for semantic search,...
- Verification AI
- AI systems or components used to verify claims, outputs, reasoning, or evidence rather than only generate new content. Verification AI is often used to reduce...
- Vision Encoder
- A model component that converts image or visual input into encoded representations usable by downstream systems. Vision encoders are key building blocks in...
- Vision Feature
- A feature or representation extracted from visual input by a model or preprocessing system. Vision features help downstream models reason about shapes,...
- Vision Model
- A model designed to process images or visual data for tasks such as classification, detection, captioning, OCR, or multimodal reasoning. Vision models are...
- Vision Task
- A task involving visual input, such as classification, detection, segmentation, OCR, captioning, or visual question answering. Vision tasks often combine...
- Visual Grounding
- Linking model outputs or language understanding to specific elements in visual input so statements are tied to what is actually present in the image. Visual...
- Visual Instruction
- An instruction involving visual input, such as asking a model to describe, compare, annotate, or reason about an image or screenshot. Visual instructions are...
- Visual Question Answering
- Visual Question Answering is an application task where a model extracts structured meaning or predictions from raw input. It is commonly used for NLP and...
- Visual Understanding
- The ability of an AI system to interpret images, diagrams, screenshots, or other visual material meaningfully rather than only processing raw pixels. Visual...
- Vocabulary
- Vocabulary is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Vocabulary Size
- The number of unique tokens available in a model's vocabulary. Vocabulary size affects tokenization efficiency, memory usage, and how text in different...
- Warm Start
- Starting training or optimization from an existing model, checkpoint, or good prior state instead of beginning from random initialization. Warm starts are...
- Watermark Detection
- Techniques for identifying whether content carries a watermark or signal indicating it may have been generated by a model or processed by a specific system....
- Weak AI
- Weak AI is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and research...
- Weaviate
- An open-source vector database that combines vector search with structured filtering and keyword search in a single engine. Weaviate can automatically...
- Web Agent
- An AI agent that interacts with websites or web applications to gather information, fill forms, navigate interfaces, or complete tasks. Web agents need strong...
- Weight
- Weight is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and research...
- Weight Decay
- Weight Decay is a training-time optimization concept that governs how model parameters are updated. It is commonly used for iterative learning loops for neural...
- Weight Initialization
- Weight Initialization is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models...
- Weight Merging
- Combining weights or learned parameter changes from multiple models, adapters, or fine-tunes to produce a merged model. Weight merging is explored as a way to...
- Weight Quantization
- Reducing the precision used to store or compute model weights so the model uses less memory and often runs faster. Weight quantization is a common technique...
- Weight Sharing
- Weight Sharing is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Weight Tying
- Weight Tying is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and...
- Window Attention
- An attention pattern that restricts attention to local windows or neighborhoods instead of letting every token attend to every other token globally. Window...
- Windsurf
- An AI-powered code editor built by Codeium, designed as an alternative to Cursor and VS Code with Copilot. Windsurf (formerly Codeium Editor) provides AI code...
- Word Piece
- A tokenization unit smaller than a whole word but larger than a character, commonly used to represent text efficiently in language models. Word pieces help...
- Working Memory AI
- The short-term memory mechanism an AI system uses to hold relevant information while reasoning or carrying out a task. Working memory is important for...
- World Knowledge
- General knowledge about facts, concepts, and regularities in the world that a model has learned or can access. World knowledge differs from task-specific or...
- XAI
- Short for explainable AI, referring to techniques and system designs that make model behavior, outputs, or decisions easier for humans to understand. XAI is...
- XGBoost
- XGBoost is an AI or ML concept used to represent, train, evaluate, or deploy learned systems. It is commonly used for building production models and research...
- Zero-Shot
- Describing a setting where a model performs a task without being given task-specific examples in the prompt, relying instead on prior training and general...
- Zero-Shot Classification
- Zero-Shot Classification is a modeling approach for assigning one or more labels to an input. It is commonly used for ranking, triage, moderation, and...
Related Topics
- Models (264 terms in common)
- Ml (250 terms in common)
- Systems (97 terms in common)
- Evaluation (47 terms in common)
- Training (38 terms in common)
- Llms (35 terms in common)
- Architecture (29 terms in common)
- Prompts (26 terms in common)
- Generation (25 terms in common)
- Reasoning (21 terms in common)
- Tasks (20 terms in common)
- Safety (19 terms in common)
- Optimization (18 terms in common)
- Agents (17 terms in common)
- Tokens (16 terms in common)
- Rag (15 terms in common)
- Performance (13 terms in common)
- Pipelines (12 terms in common)
- Inference (12 terms in common)
- Efficiency (12 terms in common)