The Engineering Side of Data

Alex DeBrie and Bob Haffner recap their favorite announcements from 2023 re:Invent. Topics include the absence of a popular pub, the spread-out nature of the event, Dynamo talks and swag, the rise of gen AI, S3 Express One Zone for lower latency, and updates in Redshift.

JP Urrutia, data quality expert, discusses the importance of understanding and measuring data quality, challenges in a changing environment, data contracts, data quality in streaming, and the significance of data quality and tools. They also explore expectations setting, metadata, observability, and data visualization.

Roy Hasson and Bob Haffner recap the 2023 Snowflake Summit. #data #dataengineering #snowflake  Connect with Roy  Linkedin - https://www.linkedin.com/in/royhasson/ Connect with Bob  Twitter - @bobhaffner  LinkedIn - https://www.linkedin.com/in/bobhaffner  Follow the show on Twitter  @EngSideOfData

Joseph Machado and Bob Haffner discuss the many aspects of developer ergonomics and how they relate to data engineering.   #data #dataengineering  Connect with Joseph  Blog - https://www.startdataengineering.com/ Linkedin - https://www.linkedin.com/in/josephmachado1991/  Connect with Bob Twitter - @bobhaffner LinkedIn - https://www.linkedin.com/in/bobhaffner

Alex Debrie and Bob Haffner recap their favorite announcements from 2022 re:Invent   #data #dataengineering #aws    Connect with Alex Twitter: @alexbdebrie  Blog: alexdebrie.com  Book: dynamodbbook.com   Connect with Bob  Twitter - @bobhaffner  LinkedIn - linkedin.com/in/bobhaffner    Top Announcements  https://aws.amazon.com/blogs/aws/top-announcements-of-aws-reinvent-2022/   Yan Cui’s Choreography vs Orchestration blog post  https://theburningmonk.com/2020/08/choreography-vs-orchestration-in-the-land-of-serverless/

Join Eric Tolotti and Bob Haffner for a discussion about Data Lakes, Data Lakehouses and Data Warehouses #data #dataengineering #datalake #datalakehouse #datawarehouses Check out Eric's YT channel https://www.youtube.com/c/nullQueries Connect with Bob Twitter - @bobhaffner LinkedIn - linkedin.com/in/bobhaffner Show notes nullQueries’ Intro to the Data LakeHouse https://www.youtube.com/watch?v=yDXgvsnmUCs nullQueries’ Do you Need a Data Warehouse https://www.youtube.com/watch?v=K12lMYE3k0s nullQueries’  Dealing With Bad Analytics Requirements https://www.youtube.com/watch?v=8Td0A50cWzw

Join Alex Merced and Bob Haffner for a discussion about the Open Data Lakehouse concept   #data #dataengineering #datalake #datalakehouse    Connect with Alex  Twitter - @amdatalakehouse   Connect with Bob  Twitter - @bobhaffner  LinkedIn - linkedin.com/in/bobhaffner    Show notes   The DataNation Podcast   Available on iTunes/Spotify/Stitcher   The Subsurface Data Lakehouse Community  dremio.com/subsurface   Dremio  dremio.com   Follow the podcast on Twitter @EngSideOfData

Sven Balnojan and Bob Haffner discuss the goals and principles of Functional Data Engineering   #data #dataengineering #functionaldataengineering   Connect with Sven  Twitter - @sbalnojan  LinkedIn - linkedin.com/in/dr-sven-balnojan-a55b4072  Blog - https://medium.com/three-data-point-thursday   Connect with Bob  Twitter - @bobhaffner  LinkedIn - linkedin.com/in/bobhaffner   Follow the podcast on Twitter @EngSideOfData   Show Notes   https://github.com/sbalnojan/easy-functional-data-engineering   http://svenbalnojan.com/   https://maximebeauchemin.medium.com/functional-data-engineering-a-modern-paradigm-for-batch-data-processing-2327ec32c42a   Infrastructure as Code by Keif Morris  https://infrastructure-as-code.com/book/

Michael Meyer and Bob Haffner chat about data catalogs   #data #dataengineering #datacatalogs  Connect with Mike  Twitter - @dataguyatheart  LinkedIn - linkedin.com/in/michael-meyer-6972286   Connect with Bob  Twitter - @bobhaffner  LinkedIn - linkedin.com/in/bobhaffner   Follow the podcast on Twitter @EngSideOfData

Johnny and Bob discuss Glue the serverless ETL tool from AWS   #dataengineering #etl #aws    Connect with Johnny   Youtube Channel  https://www.youtube.com/c/JohnnyChivers   The QuestionBank - Completely free Bank of community Questions AWS Certifications developed on AWS Amplify  https://www.thequestionbank.io/   Personal Website for Contact, forum and free AWS learning resource  https://johnnychivers.co.uk/   Connect with Bob   Twitter - @bobhaffner  LinkedIn - linkedin.com/in/bobhaffner https://twitter.com/EngSideOfData