Elham Tabassi, Chief AI Advisor at NIST, Avthar Suothin from Timescale, and David Hsu, CEO of Retool, dive into the essential topic of trustworthy AI. They discuss NIST's AI Risk Management Framework and its pivotal role in ensuring safe AI development, particularly in sensitive areas like healthcare. The conversation highlights privacy concerns in data management and the importance of transparent frameworks. They also explore the evolution of AI risk management and the significance of community feedback in shaping effective guidelines.
NIST emphasizes the importance of collaborating with diverse stakeholders to develop guidelines that enhance the trustworthiness, reliability, and fairness of AI systems.
The AI Risk Management Framework (AI RMF) provides organizations with a structured approach to identify, measure, and manage AI risks effectively over time.
Deep dives
Introduction to Timescale and Postgres for AI
Timescale is a company focused on enhancing the capabilities of Postgres, particularly in handling time series data and AI applications. Developers can leverage existing knowledge of Postgres to create AI applications without needing to learn completely new technologies. Using tools such as the PGAI project, developers can seamlessly integrate AI functionalities like retrieval-augmented generation and search into their projects. This approach not only simplifies the learning curve but also enables developers to take on new and exciting roles as AI engineers utilizing familiar technologies.
NIST's Role in Establishing Trustworthy AI
The National Institute of Standards and Technology (NIST) aims to advance innovation and competitiveness in the U.S. through the development of standards and measurement science for AI technology. NIST prioritizes cultivating trust by collaborating with various stakeholders to create guidelines that improve AI systems’ reliability, security, and fairness. Their efforts include engaging experts from diverse fields to ensure comprehensive input and goals that align with societal needs. These collaborations are essential in formulating effective risk management frameworks tailored to the complexities of AI.
The Importance of Stakeholder Engagement in AI Trust
NIST emphasizes collaborative engagement with stakeholders to ascertain what constitutes trust and trustworthiness in AI systems. The AI Risk Management Framework (AI RMF) promotes transparency and accountability within AI development by incorporating inputs from various disciplines, such as psychology and sociology, to capture a broader understanding of AI’s impact. Through this inclusive approach, NIST establishes key characteristics of trustworthy systems, including reliability, explainability, and bias management. This engagement aims to create scientifically sound guidelines that help organizations achieve trust in their AI applications.
Navigating Risks and Building an AI Future
As AI technology rapidly evolves, understanding and managing associated risks is critical for its adoption and effectiveness. NIST's AIRMF offers a structured process for organizations to govern, map, measure, and manage AI risks, allowing them to implement trustworthy AI practices gradually. Organizations are encouraged to start with simple recommendations from the framework and adapt them according to their specific use cases. Continuous monitoring and reassessment are advised, given the dynamic nature of AI systems, ensuring they remain reliable and effective in their operations.
Elham Tabassi, the Chief AI Advisor at the U.S. National Institute of Standards & Technology (NIST), joins Chris for an enlightening discussion about the path towards trustworthy AI. Together they explore NIST’s ‘AI Risk Management Framework’ (AI RMF) within the context of the White House’s ‘Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence’.
Changelog++ members save 10 minutes on this episode because they made the ads disappear. Join today!
Sponsors:
Timescale – Real-time analytics on Postgres, seriously fast. Over 3 million Timescale databases power loT, sensors, Al, dev tools, crypto, and finance apps — all on Postgres. Postgres, for everything.
Retool – The low-code platform for developers to build internal tools — Some of the best teams out there trust Retool…Brex, Coinbase, Plaid, Doordash, LegalGenius, Amazon, Allbirds, Peloton, and so many more – the developers at these teams trust Retool as the platform to build their internal tools. Try it free at retool.com/changelog
DeleteMe – DeleteMe makes it quick, easy and safe to remove your personal data online.