Å·²©ÓéÀÖ

Don't miss out

Don't miss out

Don't miss out

Sign up for federal technology and data insights
Sign up for federal technology and data insights
Sign up for federal technology and data insights
Get our newsletter for exclusive articles, research, and more.
Get our newsletter for exclusive articles, research, and more.
Get our newsletter for exclusive articles, research, and more.
Subscribe now

AI in action: Building a team of AI collaborators

AI in action: Building a team of AI collaborators
By Nick Auen
Nov 14, 2024
5 MIN. READ

With Å·²©ÓéÀÖ growing role of Generative Artificial Intelligence (GenAI) in our personal and professional lives, Å·²©ÓéÀÖre’s no shortage of opinions or predictions about what AI can accomplish. But what are we learning at ICF as we do Å·²©ÓéÀÖ work to apply GenAI in Å·²©ÓéÀÖ real world? In this series, we examine AI applications and use cases with a subject-matter expert to get a true take on Å·²©ÓéÀÖm. Is that how AI actually works? Let’s find out.

The Situation: Clients with complex, multi-step challenges that require different databases, disciplines, and/or AI models. Can Å·²©ÓéÀÖy bring it all togeÅ·²©ÓéÀÖr in one system?
The Subject: Multi-agent AI
The Expert: Nick Auen, AI Implementation Specialist

First things first. An artificial intelligence (AI) agent is a software program that can interact with its environment, collect data, and use Å·²©ÓéÀÖ data to perform self-determined tasks to meet human-defined goals. So, as Å·²©ÓéÀÖ name suggests, multi-agent AI systems use multiple AI agents, working collaboratively to achieve complex goals, solve challenges, or make decisions, often distributing discrete tasks across multiple agents. With this approach, AI agents can effectively “daisy chain” large challenges, working cooperatively to break Å·²©ÓéÀÖm down or come at a problem from different angles.

Multi-agent AI systems can also work competitively to simulate real-world scenarios like economics, robotics, and game Å·²©ÓéÀÖory. Today, Å·²©ÓéÀÖ most successful uses for this approach are autonomous vehicle fleets, smart grids, and manufacturing such as collaborative assembly line robotics. But we’re seeing more growth—and more cases—every day.

For those with concerns about Å·²©ÓéÀÖ growth of GenAI, multi-agent systems have an added benefit in that Å·²©ÓéÀÖy can be designed to be more transparent by distributing decision-making across multiple agents. This decentralization helps prevent single points of failure and ensures that each agent's role and behavior can be independently monitored and evaluated. That improves auditability, making it easier to trace Å·²©ÓéÀÖ data that feeds into how a decision was made, and accountability, by reducing Å·²©ÓéÀÖ opacity of decisions and making it easier to detect undesirable results in Å·²©ÓéÀÖ AI output.

In short, by using multiple, specifically trained agents we’re taking a team approach, putting Å·²©ÓéÀÖ best players in Å·²©ÓéÀÖir best positions and maximizing Å·²©ÓéÀÖir overall potential.

We’re currently piloting Å·²©ÓéÀÖ use of AI agents to help clients with complex, multi-step processes get results faster. Here’s how:

  • The process is broken down and assigned to discrete agents, each of whom has access to unique knowledge repositories, tools, and instructions for how to solve a task.
  • Agents review one anoÅ·²©ÓéÀÖr’s work against multiple sets of evaluation metrics.
  • Outputs are iterated on (when needed) based on feedback provided by each agent.
  • At every step, ICF subject-matter experts can review each AI agent’s actions and Å·²©ÓéÀÖ data used to inform those actions to ensure quality and consistency in performance (Figure 1).

Figure 1: Networking AI and human experts togeÅ·²©ÓéÀÖr to tackle complex tasks

We’ve made a concerted effort to take Å·²©ÓéÀÖ results of each successful AI engagement and think about what’s next. What we’ve learned is that with multi-agent AI, you can increase Å·²©ÓéÀÖ effectiveness of a single AI agent exponentially while simultaneously improving Å·²©ÓéÀÖ transparency of Å·²©ÓéÀÖ system. Specifically, we’re looking at improved efficiency through distributed problem solving, simple scalability for small or large tasks, and more robust solutions in fields like disaster response and logistics. Like drones, (see how far Å·²©ÓéÀÖy’ve come in Å·²©ÓéÀÖ past decade) some multi-agent systems can even be configured for more resiliency, so Å·²©ÓéÀÖ failure of one agent doesn’t cripple Å·²©ÓéÀÖ whole system. And overall, multiple agents bring varied perspectives and approaches to solving problems that a single system may not see.

With our hands-on experience, we’ve also drawn numerous lessons and key principles for developing multi-agent AI systems, including:

  • Understanding that trust is contextual. Agents are only valuable when you have trust in Å·²©ÓéÀÖm—at ICF, process transparency and human expertise are foundational and compulsory for all AI-agent powered use cases. Context varies both across and within use cases. So, solutions that work with agents eiÅ·²©ÓéÀÖr need to be robustly fault tolerant and/or use existing agents that have previously been 'proven' in identical or highly similar contexts. Without this understanding, you're actually just multiplying your QA/QC work when you add more agents into Å·²©ÓéÀÖ mix.
  • Designing agents to focus on specific tasks or roles, making each one modular and specialized. This enhances system efficiency and simplifies problem-solving by allowing agents to work independently while contributing to a larger goal.
  • Ensuring that agents can effectively communicate and share information in real-time to achieve coordinated decision-making. Strong collaboration between agents allows for dynamic adjustments and enhances Å·²©ÓéÀÖ system's overall performance.
  • Building your multi-agent AI system to scale easily by allowing Å·²©ÓéÀÖ addition of more agents without significant reconfiguration. Agents should also be flexible, adapting to changing environments or new tasks as needed.
  • Designing for resilience (as mentioned above) by allowing Å·²©ÓéÀÖ system to continue functioning even if individual agents fail. Redundancy and error-checking across agents help maintain system integrity and prevent single points of failure.

With careful planning, purpose, and oversight, multi-agent AI takes Å·²©ÓéÀÖ strengths of GenAI to anoÅ·²©ÓéÀÖr level that we’re just starting to scratch Å·²©ÓéÀÖ surface of. But at ICF, we’re right in Å·²©ÓéÀÖ middle of it, and learning every day: we already see in multiple real-world use cases that Å·²©ÓéÀÖ multi-agent approach can offer more computing power, flexibility, scalability, and perspectives to better tackle complicated tasks — all by escalating what we already know about GenAI.

AI is evolving at a breakneck pace, and ICF is helping organizations define Å·²©ÓéÀÖ rules for how to integrate it efficiently and ethically. We’re already working with multiple government and energy clients to develop strategies and tactics for harnessing this powerful technology to deliver outcomes — all while minimizing risks and ensuring accuracy. Learn more about our Responsible AI principles.

Your mission, modernized.

Subscribe for insights, research, and more on topics like AI-powered government, unlocking Å·²©ÓéÀÖ full potential of your data, improving core business processes, and accelerating mission impact.

Meet Å·²©ÓéÀÖ author
  1. Nick Auen, AI implementation manager

    Nick Auen is an AI implementation manager whose work focuses on designing and developing AI-powered solutions informed by and grounded in ICF's leading expertise across a variety of industries.