Building Cloud-based GPU Servers

The benefits of selecting and standardizing on their own components for building cloud-based GPU servers, including collaborations on GPU instances and plans for introducing newer models in the future.

Transcript

chevron_right

Play full episode

chevron_right

Transcript

Episode notes

This podcast features a conversation between Brian and Jeffrey Gregor (he prefers Gregor). Gregor is the General Manager for OVHcloud® US, a leading cloud provider with a global presence. Prior to joining OVHcloud, Gregor was a Navy Officer, a highly decorated Navy Officer, with over 15 years serving the US.

OVHcloud was established in 1999, with some borrowed funds and hardware, as a web-hosting startup in northern France and has grown steadily, expanding across Europe. Following the expansion into Canada in 2015, OVHcloud opened offices in the US. Gregor joined OVHcloud when the company opened offices in northern Virginia. And the expansion continues.

We recently posted a deep-dive review for OVHcloud US, focusing on GPUs in the cloud and how to approach cloud training for AI. The review is worth the time as it provides background on OVH, how we performed our tests, and the results.

Gregor explains the

Streaming live on the StorageReview Discord.

00:00 Introduction

What you need to know about OVHcloud
Company structure
Services offered
New acquisition to target the edge market
Partnerships
- VMware
- Nutanix

06:00 Competition

Providing building blocks for multicloud
Fitting in the multicloud environment
Platform-as-a-Service
Open Source Software support
Footprint
- New investments
- Design and built servers
- Adding new data center in central US

11:00 Expanding OVH

Gridscale acquisition
- Provides cloud workloads
- growing points-of-presence
Why metal-bending offers OVH advantages
- Custom configurations
- Proprietary water cooling system
- Environmentally friendly
18-month hardware refresh
- Repurpose existing servers
- Not all customers need the latest and greatest

16:00 Making it cost-effective

Low-cost options
Access to a robust playground
Flexibility
- Avoiding long-term contracts
- Build freedom in the cloud
Delivering high-value, high-performance
Sweet spot is SMB, small enterprises

20:00 Helping customers move to the cloud

Providing a broad range of products and services
Predictable pricing
Taking the first step to migrate to the cloud
- Modernizing applications
- Familiarization
- Understanding the ecosystem
Managed services
- Kubernetes
  - public cloud
  - private cloud
Sustainability
- Liquid-cooling
- Repurposing storage
- Getting more life out of products and systems
Green from the beginning, not because it’s the right thing to do