Data Platform Engineer - Scale Up Environment?

A data engineering team or a data platform team has maybe multiple consumer internally, right? Data is data scientists. And so aside from the people, you would expect a lot of more use case, different way of using your products as a data platform engineer. They need to think how they can scale like, you know, okay, I'm doing a small pipeline that's reached a Google sheet and it's totally fine for this small use case. But then suddenly that Google sheets blow up because there is way more data giving a certain context to come back.

Transcript

Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.