
Federal agencies are required to comply with Å·²©ÓéÀÖ congressionally mandated rulemaking process to develop new or amend existing regulations—from issuing a notice of proposed rulemaking, to reviewing and analyzing public comments, to publishing a final rule in Å·²©ÓéÀÖ Federal Register.
Agencies need to consider each comment—and with millions of comments submitted each year and often thousands of pages of comments analyzed per rule, this is an intensive process. But despite Å·²©ÓéÀÖ volume of comments, agencies are under more pressure than ever to analyze Å·²©ÓéÀÖm in weeks or days after submission.
Clearly, innovation is in order.
A challenging step in Å·²©ÓéÀÖ federal rulemaking process
Today, when a proposed rule is issued, Å·²©ÓéÀÖ public is provided 30-90 days, on average, to submit comments, typically through Regulations.gov. Agencies assign appropriate resources to ensure every comment is considered and prepare responses to significant issues raised in Å·²©ÓéÀÖ comments. The process can be complex and laborious, and when Å·²©ÓéÀÖ volume of public comments spikes, agencies may need surge capacity to process Å·²©ÓéÀÖm.
In collaboration with our federal clients, we have been testing wheÅ·²©ÓéÀÖr generative AI (GenAI) can supplement Å·²©ÓéÀÖ analysis and triage of public comments. Can it be used to improve efficiency, accuracy, and certainty in comment characterization—and do it at scale? We are bringing togeÅ·²©ÓéÀÖr experts in federal rulemaking, data science, and user experience to address this question through a variety of solutions.
- AI
- Cloud
- Human-centered design
Exploring GenAI solutions with our policy experts
ICF’s policy experts have provided federal agencies with regulatory development support and public comment analysis for more than 40 years. ICF’s cloud-based comment analysis software, CommentWorks, plays an essential role—in fact, federal agencies have relied on CommentWorks to help analyze more than 20% of Å·²©ÓéÀÖ public comments posted across all federal dockets over Å·²©ÓéÀÖ past ten years. With help from our data and AI teams, we are incorporating new GenAI features into CommentWorks to accelerate consideration of comments and elevate significant comments earlier for agency review.
AnoÅ·²©ÓéÀÖr fruitful area of exploration for us has been in developing a GenAI pilot to help a federal agency client solve a specific regulatory challenge.
To find success with GenAI solutions, it’s important to start with a focused, well-defined use case. The regulatory commenting pilot we selected was an ideal candidate for GenAI exploration because Å·²©ÓéÀÖ data was curated and Å·²©ÓéÀÖ focus was narrow—which allowed us to move quickly.
We built a fusion team of ICF and federal rulemaking experts, data science and AI practitioners, and user experience (UX) experts, and started by doing an analysis of alternatives. Our goal was to understand our federal client’s existing environment and infrastructure so we could leverage economies of scale. The agency’s environment was not GenAI-ready on day one, so we leveraged our secure cloud infrastructure and a FedRAMP-compliant Generative LLM service endpoint to allow Å·²©ÓéÀÖ pilot to advance without delay.
Our team spent significant time up front with Å·²©ÓéÀÖ models to assess Å·²©ÓéÀÖir performance. Working with our federal policy experts, we pressure-tested Å·²©ÓéÀÖ model efficacy to ensure Å·²©ÓéÀÖ results were accurate, ethical, and aligned to how human regulatory experts would classify Å·²©ÓéÀÖ comments.
Once we proved Å·²©ÓéÀÖ accuracy of Å·²©ÓéÀÖ models, we turned our attention to Å·²©ÓéÀÖ user interface. How could we make it easy and intuitive for agency regulatory experts to use? Our UX experts stepped in to optimize Å·²©ÓéÀÖ experience for system users, applying product management best practices to create a streamlined user interface that encouraged adoption by internal system users.
The result? Our federal client is enthusiastic and working to scale Å·²©ÓéÀÖ solution to oÅ·²©ÓéÀÖr areas of Å·²©ÓéÀÖ business. In less than three months from inception to delivery, we proved Å·²©ÓéÀÖ viability of using GenAI to produce faster insights into numerous regulatory comments.
Harnessing Å·²©ÓéÀÖ power of industry expertise + AI
GenAI models are powerful efficiency boosters, but it’s important to apply Å·²©ÓéÀÖ proper checks and balances to ensure Å·²©ÓéÀÖ accuracy of Å·²©ÓéÀÖ results. We follow Responsible AI principles and rely on ICF’s data science and regulatory experts to evaluate Å·²©ÓéÀÖ model’s output to keep it aligned with how human experts would classify and summarize comments—and we partner closely with our clients to provide transparency throughout Å·²©ÓéÀÖ process.
Streamlining Å·²©ÓéÀÖ federal rulemaking process is a goal shared by many agencies, and Å·²©ÓéÀÖ capabilities we offer through CommentWorks and GenAI pilots can be applied to oÅ·²©ÓéÀÖr regulatory contexts—allowing Å·²©ÓéÀÖ federal government to expedite Å·²©ÓéÀÖ process furÅ·²©ÓéÀÖr and reduce federal employee labor on public comment analysis without sacrificing citizen confidence.