Exploring the concept of 'shifting left' from software to AI, Saurabh Gupta discusses data governance strategies and the importance of early data quality evaluation. He highlights automating data processes with a software development approach and shifting organizational mindset towards data adoption. The podcast covers the role of data governance leads in data literacy, starting small in data governance for quick wins, and key trends in data quality and ethical data management.
Read more
AI Summary
Highlights
AI Chapters
Episode notes
auto_awesome
Podcast summary created with Snipd AI
Quick takeaways
Shifting left concept in software engineering enhances software development rituals and emphasizes quality and usability early on.
Data governance in organizations improves data accuracy, reduces errors, and enhances overall data usability through defined standards and checks.
Deep dives
Importance of Shifting Left in Data Quality
Shifting left, a concept in software engineering, involves testing software early in the development lifecycle. This approach enhances software development rituals and emphasizes quality and usability throughout the process. In the podcast, Serab Gupta, Chief Strategy and Revenue Officer at the Modern Data Company, discusses applying the concept of shifting left to data. By moving data quality efforts to the producer side early in the process, organizations can improve data accuracy and reduce errors, enhancing overall data usability.
Role of Data Governance in Improving Data Quality
Data governance plays a crucial role in enhancing data quality and usability. By standardizing processes, policies, and checks, data governance ensures that data products meet quality standards early in the development lifecycle. Serab Gupta emphasizes the need for data governance to define quality standards, behavioral aspects, and checks to improve data accuracy and enhance the consumer experience. Implementing data governance practices early on helps organizations address data quality issues proactively, reducing operational inefficiencies and costs.
Driving Data Literacy Through Data Governance
Data governance leads can drive data literacy initiatives within organizations. By partnering with business users and identifying pain points related to data trust and accuracy, data governance leads can automate quality checks and improve data reliability. Establishing standards and communicating the importance of data literacy can empower teams to adopt best practices and enhance data usage and understanding.
Quick Wins and Starting Small in Data Governance
To achieve quick wins in data governance, organizations should start small by identifying crucial use cases and partnering with business users to address specific challenges. By automating data quality checks, organizations can reduce manual efforts and enhance data trust. Establishing credibility through simple yet impactful changes can lead to broader adoption and success in data governance initiatives.
There is a concept in software engineering which is called ‘shifting left’, this focuses on testing software a lot earlier in the development lifecycle than you would normally expect it to. This helps teams building the software create better rituals and processes, while also ensuring quality and usability are key aspects to evaluate as the software is being built. We know this works in software development, but what happens when these practices are used when building AI tools?
Saurabh Gupta is a seasoned technology executive and is currently Chief Strategy & Revenue Officer The Modern Data Company. With over 25 years of experience in tech, data and strategy, he has led many strategy and modernization initiatives across industries and disciplines. Through his career, he has worked with various Internation Organizations and NGOs, Public sector and Private sector organizations. Before joining TMDC, he was the Head of Data Strategy & Governance at ThoughtWorks & CDO/Director for Washington DC Gov., where he developed the digital/data modernization strategy for education data. Prior to DCGov he played leadership and strategic roles at organizations including IMF and World Bank where he was responsible for their Data strategy and led the OpenData initiatives. He has also closely worked with African Development Bank, OECD, EuroStat, ECB, UN and FAO as a part of inter-organization working groups on data and development goals. As a part of the taskforce for international data cooperation under the G20 Data Gaps initiative, he chaired the technical working group on data standards and exchange. He also played an advisor role to the African Development Bank on their data democratization efforts under the Africa Information Highway.
In the episode, Adel & Saurabh explore the importance of data quality and how ‘shifting left’ can improve data quality practices, the role of data governance, the emergence of data product managers, operationalizing ‘shift left’ strategies through collaboration and data governance, the challenges faced when implementing data governance, future trends in data quality and governance, and much more.