Spark Pools

Start with the need and work towards the other, see if the solutions will fulfill those needs. Most places I've worked for don't need or aren't ready for that much technology yet. upfront costs of starting up a spark pools can be expensive. But you also have like a hidden cost like cost of the team, the cost of having a ton of people in a data governance meeting. Never mind getting the consensus to what to build. That can be quite an expensive venture. It's one of those things to that people should understand that buckle up and get prepared for.