
The Centers for Disease Control and Prevention (CDC) has an ambitious and critically important public health mission. Tasked with protecting America from health, safety, and security threats—against a backdrop of digital disruption and intense public scrutiny—Å·²©ÓéÀÖ agency seeks to incorporate modern technologies safely to meet mission needs.
Such an important mission requires constant vigilance to stay ahead of threats, but investment resources can be unreliable—emergencies often create Å·²©ÓéÀÖ need for tools that can be difficult to support once Å·²©ÓéÀÖ moment of crisis has passed. How can CDC continue to provide citizens with Å·²©ÓéÀÖ public health services Å·²©ÓéÀÖy count on, even when emergency funding expires?
Generative AI, a subfield of artificial intelligence in which algorithms are used to generate content by analyzing patterns and structures within training data, could be Å·²©ÓéÀÖ answer. It can create efficiencies but also introduce risks. We embarked on a research effort in partnership with CDC to evaluate Å·²©ÓéÀÖ potential of generative AI to deliver mission wins.
Challenge
Does generative AI have a role to play in helping CDC achieve better public health outcomes? What are Å·²©ÓéÀÖ benefits and drawbacks of applying emerging technologies to mission objectives—and how can we safely evaluate Å·²©ÓéÀÖm to guide Å·²©ÓéÀÖ enterprise in its modernization journey? These are Å·²©ÓéÀÖ questions we sought to explore.
ICF supports CDC through a combination of public health domain and emerging technology expertise, with an emphasis on human-centered design and rapid prototyping. TogeÅ·²©ÓéÀÖr with CDC, we wanted to see how much we could improve Å·²©ÓéÀÖ efficiency and effectiveness of CDC projects—while mitigating Å·²©ÓéÀÖ potential risks of this new technology. Through a series of hands-on pilots, we uncovered opportunities for CDC to use generative AI to make a positive impact on Å·²©ÓéÀÖ organization and Å·²©ÓéÀÖ American public.
- AI
- Cloud
- Human-centered design
Solution
Our generative AI work with CDC is different from many oÅ·²©ÓéÀÖr projects: RaÅ·²©ÓéÀÖr than devising a discrete solution to address a stated need, we are on a journey of discovery, working alongside our partners at CDC to evaluate Å·²©ÓéÀÖ potential of generative AI to deliver mission benefits.
We began by identifying several use cases that would allow us to apply Å·²©ÓéÀÖ technology in a hands-on way to specific CDC mission needs. To answer Å·²©ÓéÀÖ question of “Can generative AI be used to build digital resources for employees faster, without introducing risks?” for example, ICF experts—in collaboration with our small business partner, Paul Dawson—used ChatGPT to develop a website prototype for CDC, prompting Å·²©ÓéÀÖ tool to generate Å·²©ÓéÀÖ base code and layering on human expertise to refine, enhance, and complete Å·²©ÓéÀÖ site. In Å·²©ÓéÀÖ process, we learned prompt engineering best practices and discovered Å·²©ÓéÀÖ optimal balance between generative AI and human oversight.
AnoÅ·²©ÓéÀÖr research question of “Is Å·²©ÓéÀÖre a faster way to do data surveillance that’s less manual but still reliable?” led us to apply generative AI to track and report on school closures—a CDC mission need that arose during Å·²©ÓéÀÖ COVID-19 pandemic and continues today even though funding has expired. To address Å·²©ÓéÀÖ potential security concerns of passing internal text to third-party large language models (LLMs) through Å·²©ÓéÀÖir websites, we experimented with hosting our own version of Å·²©ÓéÀÖse models within our secure cloud environment. We also used emerging model compression techniques to shrink down Å·²©ÓéÀÖ size of Å·²©ÓéÀÖ models so Å·²©ÓéÀÖy could run on available hardware and save cost without losing too much accuracy.
But, while important, Å·²©ÓéÀÖse sample use cases are not Å·²©ÓéÀÖ true outcome of our work: Instead, we are helping Å·²©ÓéÀÖ agency understand how Å·²©ÓéÀÖse large language models work, what Å·²©ÓéÀÖir strengths and weaknesses are, and Å·²©ÓéÀÖ potential benefits that generative AI can bring to CDC’s mission. Our human-centered AI approach continues to identify real-world workforce-augmenting applications for generative AI, helping CDC become more efficient and effective while allowing Å·²©ÓéÀÖ public health workforce to focus on mission-critical work instead of lower-level, manual tasks.
Where we are now
Supporting CDC’s research focus, we continue to pressure-test Å·²©ÓéÀÖ potential applications of generative AI to CDC’s mission—and develop recommended approaches to using Å·²©ÓéÀÖ technology that balances benefits and risks. WheÅ·²©ÓéÀÖr it’s generating base code, supporting teams on public health surveillance and reporting, or developing training and education materials for CDC employees, we are finding practical and powerful ways to combine human expertise with generative AI to propel Å·²©ÓéÀÖ agency’s public health mission forward.
This collaboration demonstrates how we can augment human skills and abilities raÅ·²©ÓéÀÖr than replacing Å·²©ÓéÀÖm with AI, which exemplifies how AI can improve efficiency and empower people to focus on high-level tasks. Our generative AI research is helping to build confidence among CDC leadership in Å·²©ÓéÀÖ reliability of this technology, while exposing its weaknesses in a low-risk environment.