What is technical debt, and how does it apply to large language models? We dive into a really interesting conversation that goes from technical debt into system and code maintenance, which is probably a much better way to think about the challenges we have in maintaining the infrastructure systems, code, data and data lakes that we have to deal with on an everyday basis.
How do we maintain, store, track and update the LLMs themselves? How do we know and manage which model is being used when we retire a model?
References:
https://www.linkedin.com/pulse/how-google-measures-manages-tech-debt-abi-noda/
https://devops.com/are-llms-leading-devops-into-a-tech-debt-trap/
Transcript: https://otter.ai/u/ngUClgtMmLLKXCFalDxFNsNdVr4?utm_source=copy_url
Image: https://www.pexels.com/photo/anonymous-worker-in-heavy-duty-gloves-3846440/
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode