AI Today Podcast: AI Glossary Series- Data Engineer, Data Engineering, Data Pipeline, Data Wrangling, Data feed, Data Governance, Data integration
Oct 6, 2023
auto_awesome
The hosts discuss the benefits of staying informed about AI terminology and share a story about a data engineer. They introduce terms related to data in AI and discuss data engineering, data feed, data integration, and data pipeline. They explore data wrangling, pipelines, and data governance, emphasizing their importance. They also discuss AI terms, introduce the CPM AI methodology, and highlight the availability of a free intro course and CPM AI certification.
Data feed is a way to receive data from one or more sources.
Data governance ensures proper storage, management, accuracy, availability, and access control of data.
Deep dives
Data Feed, Data Integration, and Data Pipeline
Data feed is a way to receive data from one or more sources. Data integration combines data from different sources for analysis and visualization. Data pipeline is a set of interconnected steps that perform various data-related activities.
Data Engineering and Data Wrangling
Data engineering involves tasks to make data available for analytic applications. It includes data ingestion, preparation, transformation, and optimization. Data wrangling is the process of transforming raw data into its desired form, involving cleaning, merging, filtering, and feature engineering.
Data Governance in Data Engineering
Data governance ensures proper storage, management, accuracy, availability, and access control of data. It addresses risks such as security, privacy, data quality, data provenance, sharing, and compliance. Data engineers play a role in supporting data governance processes.
In this episode of the AI Today podcast hosts Kathleen Walch and Ron Schmelzer define terms related to data. Because, data is the heart of AI. So it’s important to understand the role data plays in AI and ML projects. In this episode we go over the terms data engineer, data engineering, and data pipeline.