mixture of agents

Definitions

1. An architecture where multiple LLM agents collaborate by having each agent process the outputs of others in iterative rounds, leveraging the phenomenon that LLMs tend to produce better responses when given reference outputs from other models. Distinct from Mixture of Experts, which routes within a single model.

   In plain English: A system where several AI models work together, each improving on the others' answers, to produce a better final result than any single model could.

   Example: Their mixture-of-agents setup using three open-source models consistently outperformed any single frontier model on the benchmark.

Related Terms

• Agentic AI
• Autonomous Agent
• tool use
• Context Window
• Retrieval-Augmented Generation
• Multimodal AI
• AI Agent
• Adapter Layer