Big Ideas in App Architecture Observability in the Cloud & Dataflow Modifications with Yolanda Davis from Cloudera
May 2, 2023
48:36
In today's episode, we're joined by Yolanda Davis, Principal Software Engineer at Cloudera, to talk about Apache NiFi and its role in streamlining data transfers.
Yolanda explains the architecture of Cloudera’s Apache NiFi and the UI developers use of the tool to design and manage dataflows. She also shares how Kubernetes has changed the game in terms of efficiency and scalability (while acknowledging the occasionally immense challenge of growing K8s).
We delve into the challenges of observability and monitoring in the cloud. And how Cloudera is using the insights gathered from monitoring. Yolanda also shares some unique observations about the way she sees the public cloud being leveraged for scaling efficiently for performance and cost savings.
Join as we discuss:
Yolanda explains the architecture of Cloudera’s Apache NiFi and the UI developers use of the tool to design and manage dataflows. She also shares how Kubernetes has changed the game in terms of efficiency and scalability (while acknowledging the occasionally immense challenge of growing K8s).
We delve into the challenges of observability and monitoring in the cloud. And how Cloudera is using the insights gathered from monitoring. Yolanda also shares some unique observations about the way she sees the public cloud being leveraged for scaling efficiently for performance and cost savings.
Join as we discuss:
- Cloudera’s Apache NiFi and how it streamlines data transfers, operates within the cloud, and deploys dataflow
- Exploring the combination of observability and AI
- Scaling efficiently for performance and cost efficiency