Agile Data N’ Info

In this engaging conversation, Jason Taylor, a former quant researcher now building AI-driven data services, shares insights from his journey into the startup world. He discusses the importance of broad skill sets in data careers and advocates for identifying roles based on strengths. Jason delves into how generative AI is reshaping data services and emphasizes caution in automated outputs. He also highlights the significance of domain expertise, the evolution of data collection, and the potential for AI to empower creativity in content creation.

Join Shane Gibson as he chats with Andy Cutler about the art of data modeling and the potential of AI tools to improve the art. You can get in touch with Andy via LinkedIn or over at https://linktr.ee/andycutler If you want want to read a summary generated with GenAI, head over to: https://agiledata.substack.com/i/182448381/google-notebooklm-briefing   If you want to download the transcript for the podcast, head over to: https://agiledata.substack.com/i/182448381/transcript   Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.com/   If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.   Subscribe: Apple Podcast | Spotify | Google Podcast  | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser |  Deezer | Podcast Addict |  Buy the Green Book now!   Simply Magical Data Ways of Working

Join Shane Gibson as he chats with Timo Dechau about the pattern of Metric Trees. You can get in touch with Timo via LinkedIn or over at https://timodechau.com If you want want to read a summary generated with GenAI, head over to: https://agiledata.substack.com/i/179577155/google-notebooklm-briefing   If you want to download the transcript for the podcast, head over to: https://agiledata.substack.com/i/179577155/transcript     Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.com/   If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.   Subscribe: Apple Podcast | Spotify | Google Podcast  | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser |  Deezer | Podcast Addict |  Buy the Green Book now!   Simply Magical Data Ways of Working

Join Shane Gibson as he chats with Rob Long about patterns that you can use to document and understand your data estate. You can read the article we discuss in the podcast episode here: https://atlonglastanalytics.substack.com/p/data-producer-consumer-diagrams You can get in touch with Rob via LinkedIn or over at https://atlonglastanalytics.substack.com/ If you want want to read a summary generated with GenAI, head over to: https://agiledata.substack.com/i/176072946/google-notebooklm-briefing   If you want to download the transcript for the podcast, head over to: https://agiledata.substack.com/i/176072946/transcript   Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.com/   If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.   Subscribe: Apple Podcast | Spotify | Google Podcast  | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser |  Deezer | Podcast Addict |  Buy the Green Book now!   Simply Magical Data Ways of Working

Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern for the Data Match.   The Data Match pattern provides an automated, granular comparison capability to efficiently identify and report discrepancies between two datasets, moving from row counts to specific data values. This 'data diff' solution transforms hours of manual data reconciliation into minutes by optimising comparisons for cloud analytics databases like BigQuery, serving as a support feature for on-demand exception handling rather than a continuous trust rule.   An AgileData Engineering Pattern is a repeatable, proven approach for solving a common data engineering challenge in a simple, consistent, and scalable way, designed to reduce rework, speed up delivery, and embed quality by default.   If you want a copy of the pattern template head over to: https://agiledata.substack.com/i/172820886/pattern-name Discover more  AgileData Engineering Patterns over at https://agiledata.substack.com/s/agiledata-engineering-patterns   If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.   Subscribe: Apple Podcast | Spotify | Google Podcast  | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser |  Deezer | Podcast Addict |  Buy the Green Book now!   Simply Magical Data Ways of Working

Join Shane Gibson as he chats with Nick Zervoudis about patterns that you can use to quickly and easily define the ROI of your data products, before you build them. You can get in touch with Nick via LinkedIn or over at https://blog.valuefromdata.ai If you want want to read a summary generated with GenAI, head over to: https://agiledata.substack.com/i/172748370/google-notebooklm-briefing   If you want to download the transcript for the podcast, head over to: https://agiledata.substack.com/i/172748370/transcript   Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.com/   If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.   Subscribe: Apple Podcast | Spotify | Google Podcast  | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser |  Deezer | Podcast Addict |  Buy the Green Book now!   Simply Magical Data Ways of Working

Join Shane Gibson as he chats with Johnny Winter about the core patterns that make up Dimensional (Star Schema) Modeling. You can get in touch with Johnny via LinkedIn or over at https://greyskullanalytics.com/ If you want want to read a summary generated with GenAI, head over to: https://agiledata.substack.com/i/171239242/google-notebooklm-briefing   If you want to download the transcript for the podcast, head over to: https://agiledata.substack.com/i/171239242/transcript     Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.com/   If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.   Subscribe: Apple Podcast | Spotify | Google Podcast  | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser |  Deezer | Podcast Addict |  Buy the Green Book now!   Simply Magical Data Ways of Working

Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern for the AgileData Activity Event Tile.   The Activity Event Tile pattern tracks a sequence of events (e.g., subscription signups, subscription payments) for a core business concept by storing minimal event data and using a hydration layer to automatically generate pre-calculated metrics as views. This allows business users and analysts to easily understand business performance and event sequencing without complex SQL, providing immediate, consistent insights into activity movements and financial impacts   An AgileData Engineering Pattern is a repeatable, proven approach for solving a common data engineering challenge in a simple, consistent, and scalable way, designed to reduce rework, speed up delivery, and embed quality by default.   If you want a copy of the pattern template head over to: https://agiledata.substack.com/i/170387919/pattern-name Discover more  AgileData Engineering Patterns over at https://agiledata.substack.com/s/agiledata-engineering-patterns   If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.   Subscribe: Apple Podcast | Spotify | Google Podcast  | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser |  Deezer | Podcast Addict |  Buy the Green Book now!   Simply Magical Data Ways of Working

Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern for the AgileData Event Tile.   The Event Tile Data Modeling pattern captures business processes and transactions within AgileData's three-layered data architecture, modeling "who does what" at a specific point in time. It achieves this by storing only a small number of core business keys in insert-only event tables. These event records are then automatically hydrated into a "consume tile" by joining with all relevant detail attributes that were current at the exact moment the event occurred, ensuring an accurate, time-staged narrative. This provides data consumers with a rich, wide, and historically accurate view of events, simplifying the querying of complex historical changes and state transitions.   An AgileData Engineering Pattern is a repeatable, proven approach for solving a common data engineering challenge in a simple, consistent, and scalable way, designed to reduce rework, speed up delivery, and embed quality by default.   If you want a copy of the pattern template head over to: https://agiledata.substack.com/i/169697974/pattern-name Discover more  AgileData Engineering Patterns over at https://agiledata.substack.com/s/agiledata-engineering-patterns   If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.   Subscribe: Apple Podcast | Spotify | Google Podcast  | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser |  Deezer | Podcast Addict |  Buy the Green Book now!   Simply Magical Data Ways of Working

Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern of Automated Load Patterns based on Source Data Profiles.   The Automated Load Patterns based on Source Data Profiles pattern automatically profiles incoming data to determine its optimal loading method. It classifies data as either event data (immutable, append-only) or change data (evolving records) by analysing characteristics like unique key volume and column names over time. This automated classification then dictates the load strategy: an efficient partition replace for event data or a cost-effective upsert (end-dating historical records) for change data. This capability removes the manual burden and accelerates data onboarding, providing a trustworthy and efficient process even when the data type is initially unknown.   An AgileData Engineering Pattern is a repeatable, proven approach for solving a common data engineering challenge in a simple, consistent, and scalable way, designed to reduce rework, speed up delivery, and embed quality by default.   If you want a copy of the pattern template head over to: https://agiledata.substack.com/i/168912285/pattern-name Discover more  AgileData Engineering Patterns over at https://agiledata.substack.com/s/agiledata-engineering-patterns     If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.   Subscribe: Apple Podcast | Spotify | Google Podcast  | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser |  Deezer | Podcast Addict |  Buy the Green Book now!   Simply Magical Data Ways of Working