All Jupiter Broadcasting Shows cover image

Docker U-Turn | Self-Hosted 95

All Jupiter Broadcasting Shows

00:00

How to Host a Web Whisper

The thing that really made whisper work and web whisper in particular for me was the CPP version. The individual who does a lot of that work is working on other projects to make more of these work on a lot of CPU cores. And it isn't as fast as the accelerators, you know, like the GPUs or like maybe the M1 neural chip. So I've been looking at this, trying to figure out how much of this stuff is going to be available to us directly offline, self hosting; and how much will be completely hosted or require an API. Real kind of mixed bag we're entering into right now.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app