Do You Have Any Counterintuitive Challenges With GPU Inference?

Inference is in any shape or form using a GPU. One of the things that differentiates how we do inference kind of at like our production level versus how you will see it on non-GPU servers, right? The time component for not just the inference, but even just spinning things up takes a lot longer. I think that really annoys more conventional back end developers too.

Transcript

Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.

The game changer for learning from podcasts!

Nelson

App Store

I used to use a different app that was able to save excerpts from podcast and really enjoyed it. I could listen to the podcast and quickly save things that I wanted to come back to later. Snipd take this to a whole new level with AI integration, creating summaries of podcasts and summarizing the main takeaways from what I’ve saved and snipped. I really love how it helps me prioritize what podcast to listen to with it summaries & deep dives.

No 1 podcast app

Steven

App Store

I tried everything and snipd is the no 1 app for podcasts if you like to remember things. Just tap your headphones three times and a snipped is created, transcribed, and saved to you library.