Efficient Test Data Management and Sharding in Database Systems

1min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

Database systems generally begin with no data in the branch, prompting users to load bootstrap data sets for testing. Production data sets for testing are hard to obtain due to customer confidentiality concerns. However, the system offers primitives to simplify provisioning for testing purposes. Users can establish separate instances for testing without modifying or replicating production data. Sharding in database systems necessitates managing schema changes consistently across shards during upgrades, requiring coordination to implement changes per shard and commit them collectively.

Databases underpin almost every user experience on the web, but scaling a database is one of the most fundamental infrastructure challenges in software development. PlanetScale offers a MySQL platform that is managed and highly scaleable.

Sam Lambert is the CEO of PlanetScale and he joins the show to talk about why he started the platform, scaling databases, using Vitess for SQL shard orchestration, and more.

This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.

Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.

Please click here to see the transcript of this episode.

Sponsorship inquiries: sponsor@softwareengineeringdaily.com

The post Hyperscaling SQL with Sam Lambert appeared first on Software Engineering Daily.