Coalesce 2024 edition: What’s next for data teams? (w/ Scott Breitenother)
Oct 20, 2024
auto_awesome
Scott Breitenother, founder of Brooklyn Data Co., shares insights from his journey navigating the evolving data landscape. He reflects on the early days of dbt and how data teams have shifted from traditional IT roles to modern, strategic frameworks. The discussion dives into the transformative nature of cloud-native technologies and the Iceberg framework. Breitenother also highlights the increased acceptance of the semantic layer in analytics and the importance of fostering an inclusive, supportive data community for diverse contributions.
Scott Breitenother emphasizes the critical role of community and collaboration in the success of data teams and the DBT ecosystem.
The evolution of data teams now requires a blend of management consulting and technical skills to effectively address complex data challenges.
Deep dives
Founding Brooklyn Data and Its Rapid Growth
Scott, the founder of Brooklyn Data, shares insights on starting the consultancy in 2018 and how it quickly gained traction. His connection to the DBT community played a pivotal role in the company’s success, providing access to essential data tools and strategic guidance. The firm was eventually acquired by Valier, a digital agency, which supported its growth and integration into a larger framework. Scott emphasizes the collaborative environment within the data space and acknowledges that the growth of Brooklyn Data was tied closely to the accomplishments of the DBT community.
Balancing Work and Personal Life
Scott discusses the challenges he faced in juggling his responsibilities at Brooklyn Data with personal commitments as a husband and father. He candidly admits that the early stages of building the company required significant sacrifices, including sleep. His passion for his work drove him to dedicate countless hours to developing innovative data solutions, making it feel more like a hobby than a job. Balancing work and family life remains a critical consideration as he approaches the next stage of his career.
The Shift in Data Team Dynamics
The evolution of data teams is highlighted as Scott explains the transition from IT-led data management to a new wave of data practitioners who understand business strategy. This shift enabled individuals with management consulting backgrounds to grasp both business needs and technical infrastructure, fostering a successful dynamic within teams. As data challenges increased in complexity, the team began integrating more technically skilled individuals, leading towards a separation of roles between analysts and analytics engineers. Scott believes this diversification is essential for creating efficient, responsive data teams in a growing landscape.
Community and the Future of Data Consulting
Reflecting on the DBT community's growth, Scott emphasizes the importance of inclusivity and adaptability to sustain the network's appreciated culture. He notes that as the community broadens, there is a need to retain the non-judgmental and helpful spirit that has characterized it from the beginning. Scott anticipates the development of various user personas within the community as more accessible tools are introduced, such as drag-and-drop interfaces. Ultimately, building connections and fostering collaboration among all members will be crucial to overcoming challenges and advancing in the evolving data landscape.
Show description: Scott Breitenother, founder of data consultancy Brooklyn Data Co., joins Tristan at Coalesce 2024 in Las Vegas to discuss the early days of dbt, the evolution of data teams, and what's next for the dbt community.
For full show notes and to read 6+ years of back issues of the podcast's companion newsletter, head to https://roundup.getdbt.com.
The Analytics Engineering Podcast is sponsored by dbt Labs.
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode