The invisible bones holding up the Internet are its hardware. One of the most prominent benefits we are reaping from hardware innovations is cloud services. And as you may have guessed, the cloud isn’t actually just somewhere up in space: physical data centers services are necessary to keep them up and running.

In this episode of Traceroute, we take a closer look at hardware and why its advancement is crucial to the development of the internet. We discuss the importance and benefits of optimization for hardware to suit the needs of software. Joined by our guests Amir Michael, Rose Schooler, and Ken Patchett, we explore the synergy of software and hardware in data center services and its effects on the connected world.

Episode Highlights

The important Relationship Between Hardware and Software

Efficiency depends on understanding how software uses hardware and vice versa
Software consumes every just like hardware depending on the way it’s written
People want software and hardware “out of sight/out of mind,” but hardware is increasing in visibility due to data centers and the cloud
As the internet increases, so does the need for better hardware

Amir Michael: “There are thousands of people at large companies that are driving not only the design of the hardware, but the supply chains behind them as well. And if you just look at the financial reporting from these companies, they spend billions and billions of dollars on infrastructure.”

The Building Blocks Of Getting Online

Intel started in 1968, specializing in bulky but efficient memory chips. Now they lay transistors on top of atoms.
Microprocessors are in every device now, from cell phones to servers to routers, making foundational microprocessor capability critical
The biggest breakthrough came when Intel was able to use their infrastructure to support networking, and could then scale up to data centers and cloud architecture
This began the transformation of networking, with storage moving from big fixed function hardware over to software-defined
More growth in hardware is on the horizon with things like Artificial Intelligence, 5G, and edge computing

The Birth Of The Cloud

The “Metal Rush” of the early 2000s saw companies like Google and Yahoo building their own data centers
For smaller companies, this infrastructure development didn’t make sense
Small business turned to companies like Amazon, which had server resources to spare, and the cloud was born
Data centers have scaled in size, but now the need is to optimize efficiency
More and more, hardware is now tailored for specific software applications
Unlike software, developing hardware requires a longer production schedule and a more consistent supply chain, which can be difficult
The next step is density, where more computing power is packed into less space but with greater efficiencies.

Amir Michael: “You know, no one really goes into a bank anymore. Everything's just done over the network over these cloud resources today. It's how we've become accustomed to getting a lot of work done today. And so you need all that infrastructure to drive that. And I think it's just going to become more and more so in the future as well.

The Nuts & Bolts Of Data Centers

The cloud is simply a combination of data centers of various sizes across the globe that are all connected through a network
The first data centers relied on redundancy and stability, so they were built like bomb shelters with backup systems
Data centers started redesigning hardware to optimize it for different uses, depending on who’s renting the server...

Building search for AI systems with Chroma CTO Hammad Bashir

Database School

Chroma Cloud write path and object storage rationale

The AI-powered Podcast Player