Why AI Transparency is Vital for Government Purchases
Ensuring transparency about what artificial intelligence (AI) technologies can really do is crucial when the government considers buying these technologies, say two officials from the General Services Administration (GSA) and NASA.
Importance of Honest Conversations
During a panel discussion on government technology purchasing, Geoff Sage, director of the Enterprise Service and Analysis Division in NASA’s Office of Procurement, emphasized the need for honest conversations. "As a buyer of this type of technology, I’m being sold the world, and when I go to look at it, it’s not really the world. It’s this little dirt path on the corner," Sage remarked. This highlights the ever-changing nature of generative AI and the need for careful, step-by-step evaluation.
Challenges with AI Evolution
Udaya Patnaik, chief innovation officer for the Office of IT Category in GSA’s Federal Acquisition Service, pointed out the challenges in managing evolving AI technologies. "It requires a level of transparency between industry and government to really say, ‘look, this is what we know, and this is what we don’t know,'" Patnaik stated. For example, businesses need to disclose the origins of their AI models, the data they are trained on, and any potential biases present.
Government Action on AI Procurement
The Biden administration and Congress are considering how to address AI procurement. The Office of Management and Budget is gathering public input to ensure responsible AI purchases by federal agencies. Additionally, a bipartisan Senate bill proposes that agencies should assess AI risks before buying and using these technologies.
Modernizing Contracts
Patnaik also noted that it's essential to "look at contracts openly" because traditional methods of acquiring AI or machine learning technologies are outdated. This requires close cooperation between acquisition, legal, and technical communities to fully understand what is being purchased.
Innovative Approaches
Sage echoed the need for innovation in procurement methods. He mentioned that NASA focuses on early and open communication involving various departments such as the office of the chief information officer, legal advisors, and technical experts from the beginning.
Balancing Speed and Evaluation
David Berteau, President and CEO of the Professional Services Council, highlighted the challenge of keeping up with rapid technology advancements while effectively evaluating them. "How do you pace the government’s incorporation with the pace of development of technology is the first key question. The second is, what’s it worth?" Berteau said, emphasizing the complex nature of valuing AI technology.
This discussion underscores a collective effort to modernize government AI procurement through transparency, open dialogue, and innovative approaches.
