Gating Network

Definitions

1. A network component that decides which expert, branch, or submodule should handle a given input in architectures such as mixture-of-experts models.

   In plain English: The part of an AI system that decides which internal specialist should respond.

   Example: "The gating network routed math-heavy prompts to a small subset of experts."

Related Terms

• Attention Mechanism
• Mixture of Experts
• scaffolding
• Context Window
• Retrieval-Augmented Generation
• Decoder-Only Transformer
• Positional Encoding
• SwiGLU