Compound AI is a paradigm that augments and complements LLMs by integrating them into systems with multiple specialized components handling data and model retrieval, task coordination and planning, reasoning, reflecting, and learning. Unlike a single LLM call, a Compound AI system orchestrates multiple agents (LLM-based and deterministic) to handle complex enterprise applications reliably.
