From Meta to independent data consultant, Seattle Data Guy moved to Denver, Ben Rogojan, the data scientist show #090
Feb 17, 2025
auto_awesome
Ben Rogojan, known as the Seattle Data Guy, is a former Meta data engineer turned independent consultant and popular YouTuber with a strong online presence. He dives into his transition from traditional employment to consulting, sharing insights on the evolving landscape of data engineering influenced by AI and low-code tools. Ben discusses the importance of effective stakeholder engagement and personal branding in building client trust. He reflects on the diverse tech cultures of Seattle, San Francisco, and Denver while emphasizing the need for work-life balance and taking time off.
Transitioning from a full-time role at Meta to independent consulting requires navigating challenges in work-life balance and flexibility.
Networking and establishing a personal brand are critical for securing initial clients in the competitive consulting landscape.
Effective data engineering not only necessitates technical skills but also understanding business objectives to ensure alignment with organizational goals.
Deep dives
Transition from Data Engineer to Independent Consultant
The journey from being a data engineer at a major tech company like Meta to becoming an independent consultant involves various challenges and shifts in mindset. The individual initially started creating content with the Seattle Data Guy brand before transitioning to consulting full-time, a decision accelerated by the impact of COVID-19 on work-life balance and the demand for flexibility. This change allowed him to work on diverse projects while managing his consulting business independently. He emphasizes the importance of building a personal brand and leveraging friends and connections to secure the first clients, showcasing how networking plays a critical role in establishing a consulting career.
Challenges in Data Engineering Today
Despite advancements in technology, many of the fundamental challenges in data engineering remain consistent over the years. Companies still grapple with outdated systems, like migrating databases from legacy systems to modern solutions, and the complexity of maintaining data pipelines is often exacerbated by poor documentation and high turnover of skilled personnel. Additionally, the proliferation of various data tools can overwhelm teams, with confusion over which technology to implement leading to inefficient practices. The consultant notes that while trends may shift from one platform to another—such as from BigQuery to Databricks—core data engineering problems persist, requiring attention and skilled resolution.
Importance of Understanding Business Needs
Effective data engineering requires not only technical proficiency but also a solid understanding of business objectives. The consultant stresses the necessity of translating data insights into business value, as this often dictates the direction of engineering efforts. Stakeholders in business typically have varying levels of technical knowledge, and part of the consultant's role involves educating them about the best practices in data management while ensuring that the solutions provided align with their strategic goals. He advocates for focusing on solving business problems rather than simply implementing complex technical tools, ensuring that projects remain relevant to organizational needs.
The Evolution of Tools in Data Engineering
The landscape of data engineering tools continues to evolve rapidly, prompting engineers to adapt to new solutions frequently. While low-code and no-code platforms are gaining popularity for their ease of use, they also pose risks, as they could lead to poorly designed, easily breakable systems. Engineers must discern when a low-code solution is appropriate versus when a more robust, bespoke approach is necessary. The consultant emphasizes that not all tools are appropriate for every scenario, and the focus should remain on building effective, maintainable solutions rather than getting distracted by shiny new tools that may not add real value.
Maintaining Client Relationships and Communication
Successful consulting hinges on developing and maintaining strong relationships with clients through effective communication. The consultant suggests erring on the side of over-communicating to ensure clients remain informed about project progress and any potential challenges. Establishing regular updates fosters trust and reassures clients that their interests are being prioritized. Furthermore, understanding the client's culture and engaging with them regularly can lead to more productive working relationships and a greater likelihood of repeat business or referrals.
Ben Rogojan, aka, Seattle data guy is an ex-Meta data engineer turned data engineering consultant and YouTuber. He has 100k followers each on YouTube and LinkedIn. We talked about how he become an independent consultant and the current state of data engineering.