New Research Reveals Optimal Structure for AI Agent Teams – Most Companies Getting It Wrong
Breaking: Majority of AI Agent Deployments Are Poorly Organized, New Study Warns
As artificial intelligence agents proliferate across industries, a groundbreaking study from Google Research, Google DeepMind, and MIT reveals a critical gap: nearly all organizations deploying AI agents are doing so without a coherent structural strategy.
“We found that almost no one has managed to roll them out well across an entire organization,” said a lead researcher familiar with the study. “Even where agents are deployed, they’re often poorly organized.”
The paper, titled Towards a Science of Scaling Agent Systems: When and Why Agent Systems Work, directly addresses the chaos observed at events like NVIDIA GTC 2025, where developers admitted to shipping agent systems “almost by guessing.”
Key Findings: The Right Number of Agents Remains Elusive
The study identifies three core questions that companies are struggling with: What is the optimal number of AI agents in a team? Which model provider yields the best results? Should a single “boss” agent supervise others, or should agents coordinate peer-to-peer?
“The main question boils down to organizational structure,” a DeepMind researcher explained. “We need to move from guesswork to a science of scaling.”
According to the research, most current deployments are fragmented, with agents operating in silos rather than as part of a cohesive system. This leads to inefficiencies and missed opportunities for automation.
Background: The AI Agent Boom and Its Growing Pains
Since early 2025, AI agents have become ubiquitous in Silicon Valley and beyond. Companies are deploying them for tasks ranging from customer service to code generation. However, the rapid adoption has outpaced best practices.
“We’ve seen AI everywhere, but nobody knows how to structure these agent teams,” said an industry analyst who attended GTC 2025. “It’s like building a company without an org chart.”
The new paper aims to fill that gap by providing a decision algorithm for creating optimal agent systems. It builds on earlier theoretical work by one of the authors, who previously wrote a book on the math behind AI, but the focus now is purely organizational.
What This Means: A Framework for Real-World Deployment
For developers and CTOs, the study offers a practical path forward. It includes code examples using Jupyter notebooks and Ollama, a free local large language model runner, allowing teams to test configurations before scaling.
The research emphasizes that agents are not just LLMs with extra abilities. “An LLM alone can tell you how to send an email, but it can’t send one,” the researcher noted. “An agent is like giving that intern a desk, a laptop, and a to-do list – plus the ability to act.”
Key prerequisites for building effective agent teams include a general understanding of Python, access to Ollama, and a Jupyter environment (Google Colab is recommended). But the study also acknowledges the rise of no-code tools, making agent orchestration accessible to non-experts.
The Three Core Components
- Installing utilities and Python libraries – setting up the tech stack (anchor: detailed setup guide below).
- Starting the Ollama server, fetching the model and tools – choosing the right LLM for the task.
- Testing the model and running agents – validating performance before full deployment.
The conclusion is stark: “The future of AI is evals. Without rigorous testing and organizational structure, companies will continue wasting resources on agents that don’t actually work together.”
Practical Implications for Developers
For those ready to act, the study recommends starting with a single agent equipped with clear goals, then gradually adding peers or a supervisor based on performance metrics. The research provides a decision algorithm to guide this process.
“Companies should stop guessing and start evaluating,” the researcher said. “The most successful deployments will be those that treat agent teams as systems to be engineered, not just thrown together.”
The full paper is available online, and sample code is shared in an accompanying repository. As one attendee at GTC 2025 put it: “We finally have a map for the AI agent gold rush – but most people are still digging blind.”
What This Means for the Industry
The implications are profound. If organizations adopt the study’s recommendations, we could see a shift from chaotic, siloed agent use to streamlined, scalable systems. This could accelerate automation in sectors like finance, healthcare, and logistics.
However, without adopting these principles, companies risk falling behind as competitors optimize their agent teams. “The window for innovation is wide open,” the analyst concluded. “Those who ignore structure will be left with expensive, broken systems.”