The Engineering Side of Data

Mário Pereira and Bob Haffner chat about Data Engineering at the Edge   #data #dataengineering #iot #edge #edgecomputing    Connect with Mário LinkedIn - linkedin.com/in/xmariopereira/   Connect with Bob Twitter - @bobhaffner  LinkedIn - linkedin.com/in/bobhaffner   Vopak is hiring (https://www.werkenbijvopak.nl/vacatures?lastchecked=discipline&discipline=9)

Adi Polak and Bob Haffner host a Twitter Spaces conversation on Careers and Community in Data Engineering.   #data #dataengineering  Connect with Adi  Twitter - @AdiPolak   Connect with Bob  Twitter - @bobhaffner  LinkedIn - linkedin.com/in/bobhaffner   Join the Community - https://lakefs.io/community/

Cindi, Mike and Bob are back with the sequel to their 2021 Data Vault conversation.   Check out the upcoming World Wide Data Vault Consortium!  https://wwdvc.com/  Part 1 of this discussion https://www.youtube.com/watch?v=4U9HcFS93tM Connect with Cindi  Twitter - @Data_Rebels   Connect with Mike Twitter - @dataguyatheart  LinkedIn - linkedin.com/in/michael-meyer-6972286   Connect with Bob  Twitter - @bobhaffner  LinkedIn - linkedin.com/in/bobhaffner   Show notes   Learn More: https://www.datavaultalliance.com - THE Standards Board for DV2 and Certification Education   https://www.datarebels.com - Authorized Training Partner, CDVP2 Certified Instruction, and Consulting Services   https://www.danLinstedt.com - Extensive Blogs by Daniel Linstedt, Data Vault Inventor and Found   https://kentgraziano.com/ - Kent Graziano's Data Warrior Blogs   https://twitter.com/dlinstedt  Participation and Getting Involved:  https://www.wwdvc.com - Annual Data Vault Conference  https://www.meetup.com/data-vault-north-american-user-group - Data Vault North American User' Group  https://www.linkedin.com/groups/9050802/ - Data Vault North American Users' Group LinkedIn Profile   Certified DV2 Training and Education:  https://datarebels.com/get-schooled/  https://datavaultalliance.com/certification/authorized-trainers/  https://datavaultalliance.com/event-directory/  https://www.arihovi.com/en/courses/data-vault-2-0-bootcamp-certification/  Other Resources:  Building a Scalable Data Warehouse with Data Vault 2.0 Published by Elsevier Paperback ISBN: 9780128025109 eBook ISBN: 9780128026489  Amazon:  https://www.amazon.com/Building-Scalable-Data-Warehouse-Vault/dp/0128025107/ref=sr_1_1?crid=335M6BS7BRLQA&dchild=1&keywords=building+a+scalable+data+warehouse+with+data+vault+2.0&qid=1633796921&sprefix=building+a+scala%2Caps%2C148&sr=8-1 #data. #dataengineering #datavault

Brian McMillan and Bob Haffner talk about Data Engineering for Data Discovery   #data #dataengineering #elt #etl #analysticsengineering  Connect with Brian  Like to discuss this further? First 5 people to schedule a meeting with me and receive a free copy of the book (https://calendly.com/building-data-products).   Purchase the book: https://www.minimumviablearchitecture.com    Brian McMillan – Brian [at] minimumviablearchitecture.com  Twitter – @brianmcmillan01  LinkedIn – linkedin.com/in/brianmcmillan01  GitHub – https://github.com/brianmcmillan/intro_to_data_and_analytics_engineering Schedule a discussion – https://www.minimumviablearchitecture.com/contact.html  The Book: Building Data Products: Introduction to Data and Analytics Engineering for non-programmers – https://www.minimumviablearchitecture.com   Full Length Demo - https://www.youtube.com/watch?v=xLjQhz1KJoQ&t=4s  Connect with Bob  Twitter - @bobhaffner  LinkedIn - linkedin.com/in/bobhaffner    Links: 3X - Kent Beck – https://www.youtube.com/watch?v=FlJN6_4yI2A Why Use Make (Mike Bostock) – https://bost.ocks.org/mike/make/ SQLite – https://www.sqlite.org/index.htm, https://blog.wesleyac.com/posts/consider-sqlite Building Production Applications Using Go & SQLite – https://www.youtube.com/watch?v=XcAYkriuQ1o)  CSVkit – https://csvkit.readthedocs.io/en/latest/ SQLite-Utils – https://sqlite-utils.datasette.io/en/stable/ Datasette – https://datasette.io Vega Lite –https://vega.github.io/vega-lite/

Dan Silberman and Bob Haffner discuss the traditional approach of Extract, Transform and Load (ETL) vs Extract, Load and Transform (ELT).   What each one means, why has ELT become so popular and how ELT will evolve. #data #dataengineering #elt #etl #analysticsengineering  Check out Mozart Data  https://www.mozartdata.com/  Connect with Bob Twitter - @bobhaffner  LinkedIn - linkedin.com/in/bobhaffner

Alex DeBrie joins Bob Haffner to recap the 2021 re:Invent from the data perspective   #data #dataengineering  Connect with Alex  Twitter: @alexbdebrie  Blog - alexdebrie.com  Book - dynamodbbook.com    Connect with Bob  Twitter - @bobhaffner  LinkedIn - linkedin.com/in/bobhaffner

Arjun Narayan and Bob Haffner discuss the state of streaming.   Connect with Arjun Twitter - @narayanarjun  LinkedIn - linkedin.com/in/arjunravinarayan/   Connect with Bob  Twitter - @bobhaffner  LinkedIn - linkedin.com/in/bobhaffner   Show Notes  Materialize website - materialize.com  Materialize Twitter - @MaterializeInc  Materialize LinkedIn - https://www.linkedin.com/company/materializeinc Kafka is not a database blog post - https://materialize.com/kafka-is-not-a-database/ Streaming SQL blog post - https://materialize.com/streaming-sql-intro/  #data #dataengineering #streaming

Cindi Meyersohn joins Michael Meyer and Bob Haffner for a discussion about Data Vault.     Connect with Cindi  Twitter - @Data_Rebels   Connect with Mike  Twitter - @dataguyatheart  LinkedIn - linkedin.com/in/michael-meyer-6972286   Connect with Bob  Twitter - @bobhaffner  LinkedIn - linkedin.com/in/bobhaffner    Show notes   Learn More:  https://www.datavaultalliance.com - THE Standards Board for DV2 and Certification Education   https://www.datarebels.com - Authorized Training Partner, CDVP2 Certified Instruction, and Consulting Services   https://www.danLinstedt.com - Extensive Blogs by Daniel Linstedt, Data Vault Inventor and Found   https://kentgraziano.com/ - Kent Graziano's Data Warrior Blogs   https://twitter.com/dlinstedt   Participation and Getting Involved:  https://www.wwdvc.com - Annual Data Vault Conference  https://www.meetup.com/data-vault-north-american-user-group - Data Vault North American User' Group  https://www.linkedin.com/groups/9050802/ - Data Vault North American Users' Group LinkedIn Profile   Certified DV2 Training and Education:  https://datarebels.com/get-schooled/ https://datavaultalliance.com/certification/authorized-trainers/  https://datavaultalliance.com/event-directory/  https://www.arihovi.com/en/courses/data-vault-2-0-bootcamp-certification/  Other Resources:  Building a Scalable Data Warehouse with Data Vault 2.0 Published by Elsevier Paperback ISBN: 9780128025109 eBook ISBN: 9780128026489  Amazon:   https://www.amazon.com/Building-Scalable-Data-Warehouse-Vault/dp/0128025107/ref=sr_1_1?crid=335M6BS7BRLQA&dchild=1&keywords=building+a+scalable+data+warehouse+with+data+vault+2.0&qid=1633796921&sprefix=building+a+scala%2Caps%2C148&sr=8-1

Caleb Welchans and Bob Haffner discuss GIS.  GIS is a topic that everyone in data should be familiar with.     Connect with Caleb  Twitter - @calebwelchans  LinkedIn - linkedin.com/in/welchans        Intro/Outro music by John Yasut   #data #dataengineering #gis  Connect with Bob  Twitter - @bobhaffner  LinkedIn - linkedin.com/in/bobhaffner   Please Like, Subscribe and Comment!

Johnny Chivers and Bob Haffner discuss Data Lakes on AWS. Connect with Johnny!   Youtube Channel  The QuestionBank - Completely free Bank of community Questions AWS Certifications developed on AWS Amplify    Personal Website - Contact, forum and free AWS learning resource    Please Like, Subscribe and Comment!