The hosts test local language models on Linux, pushing their limits. They discuss TailScale, Nixcon, and Scale Fundraising. The hosts explore testing AI models and browsing the internet. They also talk about Linode's cloud computing resources and tools. The 32-bit challenge, outsourcing tasks, and security threats are discussed. They search for a parking spot at Texas Linux Fest. Topics include rebuilding clusters, stacking for scale, and installing NixOS. They also discuss the NixOS hardware repository and topics related to Linux and Thunderbolt. Boosting and supporting open content is emphasized.
Running large language models on Linux and testing their limits
Introduction of a simple tool for desktop Linux that facilitates language model usage
Discussion of upcoming events in the Linux community such as tail scale, Nixcon, and Scale
Deep dives
Linux podcast and running language models on Linux
The podcast episode discusses running large language models on Linux. The hosts test different methods and explore the limits of these models. They also talk about a simple tool for desktop Linux and mention upcoming events like tail scale, Nixcon, and Scale.
Texas Linux Fest and Linux Fest Northwest
Texas Linux Fest is a growing conference in Austin with a vibrant tech scene. Linux Fest Northwest is a high-impact event held shortly after Texas Linux Fest. Both events offer opportunities to network, learn, and participate in the Linux community.
Speech note: AI-powered speech and text capabilities
Speech note is an impressive app for the Linux desktop that offers AI-powered voice transcription, translation, and speech generation. It allows users to convert speech to text, translate between languages, and even generate speech in different voices. The app runs locally and supports multiple processing capabilities, making it a valuable tool for various tasks.
Tech horror story and boost for Brent
A listener shares a tech horror story about accidentally frying a modem while installing it in a Gateway PC. They also recommend Session Buddy, a useful Chrome extension for managing tabs and sessions in the browser.
Marker: AI-powered tool to convert PDFs and ePubs to markdown
Marker is a powerful application that utilizes AI to convert PDFs, ePubs, and Mobi files to markdown. It offers faster speeds and greater accuracy compared to other tools like NuGet. With Marker, you can easily convert your documents for better readability and manipulation. It also supports low hallucination risk, ensuring accurate conversions. Whether you need to transform a PDF or ePub into markdown format, Marker is a reliable tool that simplifies the process.
Sharing Horror Stories of Data Loss and IT Mishaps
This podcast episode delves into real-life horror stories of data loss and IT mishaps. Listeners share their experiences, ranging from accidentally formatting hard drives to deleting critical configuration files. These stories serve as cautionary tales and remind IT professionals to double-check their actions, maintain backups, and be prepared for unexpected consequences. Through these anecdotes, the podcast highlights the importance of thorough planning, attention to detail, and staying calm in challenging situations within the IT field.
We test two popular methods to run local language models on your Linux box. Then, we push the limits to see which language models will toe the line and which won't.
Speech Note — Speech Note let you take, read and translate notes in multiple languages. It uses Speech to Text, Text to Speech and Machine Translation to do so. Text and voice processing take place entirely offline, locally on your computer, without using a network connection. Your privacy is always respected. No data is sent to the Internet.