Insights Tomorrow

Data Integration in the Era of AI

Nov 15, 2023

The podcast explores the evolution of data cleansing and transformation processes at Microsoft, emphasizing the importance of non-coding solutions and discussing various interfaces and tools. They delve into the evolution of Power Query and its current state in Microsoft Fabric, and compare Microsoft tools such as DTS, SSIS, Power Query, and data factory, expressing a preference for data factory and fabric. They also discuss the potential of delivering analytics through a SaaS platform as a game changer and mention upcoming webcasts.

24:58

Creator website

AI Summary

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

Low-code and no-code interfaces have become essential in data cleansing and transformation, enabling users to perform tasks without writing code.

Microsoft is infusing AI capabilities into data integration tools, enhancing productivity and providing guidance to users.

Deep dives

The Journey into Data and Tech

We Schonk, a product leader at Microsoft, shares his journey into the data and tech field. He started with a PhD in query processing in databases and joined Microsoft to work on SQL Server Integration Services (SSI). Over time, he became involved in the development of Azure Data Factory and Power Query. These products targeted different users, from citizen developers to professional developers, and received positive feedback. Eventually, the data integration efforts of both products merged into one big Microsoft Data Integration team.

Introduction

4min

The Journey of Understanding Machine Learning and Delivering AI Solutions

2min

The Evolution of Data Cleansing and Transforming Processes

2min

Evolution of Power Query

14min

Favorite Data Integration Capabilities and Products

3min

On today's episode of Insights Tomorrow, Patrick LeBlanc and Partner Director of Products with the Cloud and AI organization at Microsoft, Wee Hyong, discuss his journey into the tech and data field, the importance of infusing AI into products to provide value differentiation, and how technology has evolved over the years to offer no-code and low-code interfaces for data integration.

In this episode you’ll learn:

How data integration has evolved at Microsoft
Potential AI capabilities coming to Data Factory and Power Query
The evolution of Power Query and how it has become a powerful ETL tool

Some questions we ask:

When did you transition into AI, and what led you to that field?
How has the process of data integration evolved at Microsoft?
Can you explain modern data and the infusion of data integration technologies?

Guest bio

Wee Hyong is a highly accomplished leader in Data and AI, boasting a stellar track record of steering multi-million dollar enterprises to enduring dominance within their respective industries. Throughout his illustrious career, Wee Hyong has adorned numerous hats, having excelled as a developer, a seasoned product manager, a data scientist, an innovative researcher, and a trusted technical advisor. Furthermore, he has penned over 10 authoritative books on Data and AI. These diverse and rich professional experiences have endowed him with a distinct set of stills, enabling him to conquer some of the world's most intricate and challenging technological enigmas.

Resources:

View Wee Hyong on LinkedIn

View Patrick LeBlanc on LinkedIn

Discover and follow other Microsoft podcasts at microsoft.com/podcasts

Hosted on Acast. See acast.com/privacy for more information.