In today's episode, we peek into Elixir's impact on operational costs and developer experience, highlighted by Amplified's move to Elixir and insights from José Valim. Learn about the latest community discussions, including a tip for Elixir package maintainers. Plus, there's a buzz about the upcoming NervesConf US. Join us for these stories and more! Show Notes online - http://podcast.thinkingelixir.com/186 Elixir Community News https://www.youtube.com/watch?v=mrFwWuD7gVo – DockYard posted an Elixir Roundtable interview with Chris Grainger discussing Amplified's switch from Python to Elixir, leading to a significant AWS bill reduction. https://twitter.com/cigrainger/status/1745371714660258169 – Chris Grainger tweeted about cutting AWS costs in half by utilizing tools like Nx, Axon, OTP, and Broadway after moving to Elixir from Prefect and Spark. https://twitter.com/josevalim/status/1745431023893024827 – José Valim discussed on Twitter the benefits of reducing operational complexity with Elixir and how it can also slash AWS bills. https://twitter.com/zachsdaniel1/status/1745894060890452476 – Zach Daniel reminds Elixir package maintainers on Twitter to update ex_doc to benefit from its ongoing improvements and suggests using mix hex.publish docs for updating documentation. José Valim suggested checking the Hex API for new ex_doc versions and willing to accept a PR for a warning implementation, exemplifying OpenSource collaboration. https://www.thestackcanary.com/phoenix-liveuploads-pdf/ – Andrés X Alejos created a tutorial on integrating Phoenix LiveView with pdf.js for handling PDF previews in applications. https://elixirforum.com/t/elixir-forum-2024-update/61007 – Elixir Forum 2024 Update mentions a discount section, the Ash Framework moving there for support, added chat features, and teases more features for 2024. https://nervesconf.us/ – NervesConf US announcement for May 9th, 2024, in Chattanooga, Tenn, calling for speakers and mentioning the CFP is open for all levels and Nerves-related topics. Do you have some Elixir news to share? Tell us at @ThinkingElixir or email at show@thinkingelixir.com Find us online Message the show - @ThinkingElixir Message the show on Fediverse - @ThinkingElixir@genserver.social Email the show - show@thinkingelixir.com Mark Ericksen - @brainlid Mark Ericksen on Fediverse - @brainlid@genserver.social David Bernheisel - @bernheisel David Bernheisel on Fediverse - @dbern@genserver.social Cade Ward - @cadebward Cade Ward on Fediverse - @cadebward@genserver.social Sponsored By:Fly.io: Fly.io is a great place to deploy your next Phoenix application! Check them out!

Dive into the world of structured LLM prompting with our latest guest who shares insights on their innovative project, InstructorEx. We'll explore how this tool is pushing the boundaries of large language models to return structured data, particularly JSON, and the benefits it offers when integrated into existing systems. The conversation takes a deep dive into the challenges and solutions of forcing LLMs to output data in desirable formats using Elixir technology, like Ecto schemas, and what it means to treat an LLM like a digital human, even applying it to tasks like spam detection in emails. Discover the intriguing concept of using a local database as a cache for LLM results. If you're curious about the intersection of structured data, Python experience transition to Elixir, and the future of LLM integration, this is an episode not to miss. Tune in for these engaging topics and more! Show Notes online - http://podcast.thinkingelixir.com/185 Elixir Community News https://twitter.com/spawnfest/status/1743987039345782978 – Announcement and prize awarding of the SpawnFest winners. https://spawnfest.org/2023.html – Official SpawnFest 2023 webpage with details on the projects and winners. https://github.com/spawnfest/heimdall – 1st Place Overall at SpawnFest, Heimdall is a web app for secure and easy sharing of sensitive data. https://github.com/spawnfest/fluffytrain – 2nd Place Overall at SpawnFest, Fluffytrain is a web app for generating working Elixir code using OpenAI GPT-4. https://github.com/spawnfest/tabtab – 3rd Place Overall at SpawnFest, tabtab is an autocompletion generator plugin for Erlang's rebar3. https://github.com/spawnfest/arizona – Arizona, an Erlang Web Framework, was one of the highlighted projects at SpawnFest. https://github.com/spawnfest/latch – Latch, a tool for viewing OpenTelemetry data in real-time was a highlighted project at SpawnFest. https://github.com/spawnfest/youcan – Youcan, an Elixir library for using UCANs in app authorization flows, featured at SpawnFest. https://ucan.xyz/ – UCAN.xyz, related to the Youcan Elixir library for user-controlled authorization networks. https://github.com/spawnfest/lorax – Lorax, a Livebook app implementing LoRA for fine-tuning language models, was highlighted at SpawnFest. https://github.com/spawnfest/karel_dreams – SpawnFest's highlighted project Karel_dreams, a Livebook app for controlling a robot with AI or script. https://twitter.com/josevalim/status/1744395345872683471 – José Valim celebrates Elixir's 13th anniversary and announces Elixir as a gradually typed language. https://twitter.com/bcardarella/status/1743370338254139712 – Announcement of LiveView Native v0.2.0-rc.1 release and upcoming changes. https://twitter.com/germsvel/status/1744686958196973787 – German Valesco shares a tip about LiveView helpers for creating pipe-friendly functions in Elixir. https://codebeamamerica.com/ – CodeBeam America conference information, happening on March 7-8, 2024 in San Francisco and virtually. https://twitter.com/sasajuric/status/1744649232793886963 – Tweet about CodeBeam America conference. Do you have some Elixir news to share? Tell us at @ThinkingElixir or email at show@thinkingelixir.com Discussion Resources https://github.com/thmsmlr/instructor_ex https://twitter.com/thmsmlr/status/1736645576324784375 https://www.stitchfix.com/ https://docs.pydantic.dev/latest/ https://github.com/boudra/jaxon https://github.com/ggerganov/llama.cpp https://fly.io/phoenix-files/using-llama-cpp-with-elixir-and-rustler/ https://hadoop.apache.org/ https://pig.apache.org/ https://www.r-project.org/ https://fly.io/blog/rethinking-serverless-with-flame/ BNF Grammar enforcement for JSON output https://www.linkedin.com/company/modal-labs/ https://airflow.apache.org/ Guest Information https://twitter.com/thmsmlr – on Twitter https://github.com/thmsmlr/ – on Github https://thmsmlr.com/ – Blog Find us online Message the show - @ThinkingElixir Message the show on Fediverse - @ThinkingElixir@genserver.social Email the show - show@thinkingelixir.com Mark Ericksen - @brainlid Mark Ericksen on Fediverse - @brainlid@genserver.social David Bernheisel - @bernheisel David Bernheisel on Fediverse - @dbern@genserver.social Cade Ward - @cadebward Cade Ward on Fediverse - @cadebward@genserver.social Sponsored By:Fly.io: Fly.io is a great place to deploy your next Phoenix application! Check them out!

In the news, we dive into a mix of intriguing Elixir updates and innovative developments. We explore the convenient and versatile Testcontainers project, designed to streamline your testing environment, and touch on Zach Daniel's efforts to integrate bulk operations into the Ash Framework. German Velasco has been busy sharing a wealth of tips on ElixirStreams.com, and we stumbled upon a rare gem, a Windows-focused Elixir library that bridges the gap with Azure authentication services. But the heart of our discussion revolves around the magic of "magic links" in Phoenix applications. We delve deep into how these links offer a seamless user experience by simplifying authentication, the challenges they may pose, and the impressive ways they can refine your developer workflow. Stay tuned for these updates and more in the show! Show Notes online - http://podcast.thinkingelixir.com/184 Elixir Community News https://github.com/testcontainers – Website for Testcontainers, a project for developing in multiple languages without needing a local test database. https://github.com/testcontainers/testcontainers-elixir – The Elixir-specific project under Testcontainers created by Jarl André Hübenthal, allowing for automated container management in test mode. https://twitter.com/ZachSDaniel1/status/1741260030748324287 – Tweet by Zach Daniel discussing his work on adding bulk operations into the Ash Framework. https://elixirforum.com/t/basic-bulk-actions-atomics-new-stream-options-error-2-expression/60496?u=zachdaniel – Elixir Forum thread where Zach Daniel explains the bulk operations feature for the Ash Framework. https://twitter.com/germsvel/status/1740707041373503771 – German Velasco's announcement on Twitter about his ongoing series of Elixir tips and a list of top videos on ElixirStreams.com. https://github.com/chgeuer/ex_windows_api_dataprotection – GitHub repository for an Elixir library that provides access to the Windows Data Protection API, useful for Azure services on Windows. https://www.youtube.com/watch?v=eM8vl7pgRJM – Andrew Stewart's video tutorial on adding magic links to a Phoenix application for passwordless authentication. https://andrewian.dev/blog/magic-links – Blog post by Andrew Stewart detailing the implementation of magic links in Phoenix applications. Do you have some Elixir news to share? Tell us at @ThinkingElixir or email at show@thinkingelixir.com Discussion Resources https://haveibeenpwned.com/ – Resource for checking if an email address or password has been part of a data breach. https://github.com/dashbitco/nimble_totp – NimbleTOTP - A tiny Elixir library for time-based one time passwords (TOTP) Find us online Message the show - @ThinkingElixir Message the show on Fediverse - @ThinkingElixir@genserver.social Email the show - show@thinkingelixir.com Mark Ericksen - @brainlid Mark Ericksen on Fediverse - @brainlid@genserver.social David Bernheisel - @bernheisel David Bernheisel on Fediverse - @dbern@genserver.social Cade Ward - @cadebward Cade Ward on Fediverse - @cadebward@genserver.social Sponsored By:Fly.io: Fly.io is a great place to deploy your next Phoenix application! Check them out!

We kick off the new year diving into the freshly released Elixir 1.16.0 with new features like enhanced documentation and improved error reporting. We explore the burgeoning Elixir Machine Learning ecosystem, and discuss the innovative use of Llama.cpp with Elixir for machine learning on less powerful hardware. We also touch on the release of Benchee 1.3.0, which focuses on improving memory usage in benchmarks, and introduce Magma AI Prompt IDE, a handy tool for Elixir developers looking to streamline their project knowledge and documentation process. Plus, we unveil Adobe's Elixir Styler for smarter code formatting, and share insights on the comprehensive Membrane SDK release for multimedia enthusiasts, and more! Show Notes online - http://podcast.thinkingelixir.com/183 Elixir Community News https://elixir-lang.org/blog/2023/12/22/elixir-v1-16-0-released/ – Announcement of Elixir 1.16.0 release, including features like code snippets in diagnostics, revamped documentation, and a living anti-patterns reference. https://www.thestackcanary.com/understanding-the-elixir-machine-learning-ecosystem/ – Andrés Alejos's introduction to Machine Learning in Elixir through a glossary of libraries. https://fly.io/phoenix-files/using-llama-cpp-with-elixir-and-rustler/ – Jason Stiebs's article on using LLama.cpp with Elixir and Rustler for running machine learning models on CPU with lesser hardware requirements. https://github.com/jeregrine/llama_cpp_ex – Github repository for "Llama CPP Ex," a Hex package by Jason Stiebs to integrate LLama.cpp with Elixir. https://pragtob.wordpress.com/2023/12/22/benchee-1-3-0-published-oh-save-the-memory/ – Blog post about the release of Benchee 1.3.0 focusing on memory savings. https://github.com/bencheeorg/benchee – Github repository for Benchee, a benchmarking tool for Elixir. https://pragtob.wordpress.com/2023/12/18/careful-what-data-you-send-or-how-to-tank-your-performance-with-task-async/ – Blog post by Tobi Pfeiffer on how the size of data passed between processes can impact performance in Elixir. https://github.com/elixir-lang/elixir/pull/13173/files – Github pull request showing code changes to the Elixir language. https://github.com/elixir-lang/elixir/pull/13194/files – Another Github pull request showing code changes to the Elixir language. https://github.com/marcelotto/magma – Marcel Otto's Github repository for Magma, an IDE for constructing complex prompts, especially aimed at Elixir developers. https://x.com/ElixirMembrane/status/1737791927636893981 – Announcement of the release of Membrane SDK, offering a comprehensive suite of Membrane plugins for multimedia processing. https://github.com/membraneframework/membrane_sdk – Github repository for Membrane SDK, with details on features and release cycle. https://elixircasts.io/elixir-styler – ElixirCasts video introducing and demonstrating Elixir Styler, an automated code styling tool. https://github.com/adobe/elixir-styler – Github repository for Adobe's Elixir Styler, which combines issue detection with auto-correction for Elixir code. Do you have some Elixir news to share? Tell us at @ThinkingElixir or email at show@thinkingelixir.com Find us online Message the show - @ThinkingElixir Message the show on Fediverse - @ThinkingElixir@genserver.social Email the show - show@thinkingelixir.com Mark Ericksen - @brainlid Mark Ericksen on Fediverse - @brainlid@genserver.social David Bernheisel - @bernheisel David Bernheisel on Fediverse - @dbern@genserver.social Cade Ward - @cadebward Cade Ward on Fediverse - @cadebward@genserver.social

As we close another year packed with developments in the Elixir ecosystem, we're rolling out the red carpet for a "Year End Review" episode! Before we do that, we cover the most recent news events like the release of Supabase's Supavisor, a connection pooler, crafted with a helping hand from Dashbit. We shed light on the partnership between Supabase and Fly.io introducing a managed Postgres option. Then, for front-end enthusiasts, we discuss the released beta of LiveView Native and more! And, if that's not enough, we've got loads to unwrap from highlights of the past year's achievements! Show Notes online - http://podcast.thinkingelixir.com/182 Elixir Community News https://elixirforum.com/t/elixir-v1-16-0-rc-1-released/60310 – Elixir 1.16.0-RC.1 announced, featuring minor improvements and better error reporting. https://github.com/elixir-lang/elixir/commit/8e9cbfcd8c219f9d3558158f1ebee5ec4fadd762 – Optimization of the Enum.random function in the Elixir programming language. https://twitter.com/planeterlang/status/1734882621577183524?t=Xn6DY9Qzc5nGLdqEskRjvQ – Announcement of Erlang/OTP 26.2 Release, a maintenance patch with bug fixes and improvements. https://www.erlang.org/news/166 – Erlang/OTP 26.2 release news with details on improvements. https://erlang.org/download/OTP-26.2.README – README document for Erlang/OTP 26.2, including the highlight on process_info/2 support for looking up specific keys in the process dictionary. https://twitter.com/kiwicopple/status/1734903746704945425?t=Xn6DY9Qzc5nGLdqEskRjvQ – Supabase announces Supavisor 1.0 as part of their launch week. https://supabase.com/blog/supavisor-postgres-connection-pooler – Blog post detailing the Supavisor Postgres connection pooler released by Supabase. https://github.com/supabase/supavisor – GitHub repository for Supavisor, the Postgres connection pooler by Supabase. https://www.youtube.com/watch?v=ogYNmJOFEpk – José Valim created an intro video for Supavisor included in the announcement blog post, hinting at Dashbit's involvement. https://supabase.com/blog/postgres-on-fly-by-supabase – Supabase partnership with Fly.io to manage Fly Postgres databases. https://twitter.com/kiwicopple/status/1735628135750602769?t=ZvCKMAXrZFtDX8pfjW14Lw – Twitter update on the Supabase and Fly.io partnership offering managed Postgres databases. https://www.youtube.com/watch?v=WyjwFP2QgeI – YouTube video featuring LiveView Native 0.2.0-beta.1 Getting Started guide. https://twitter.com/bcardarella/status/1736164327931924483?t=ZvCKMAXrZFtDX8pfjW14Lw – Announcement of LiveView Native v0.2.0-beta.2 release with bug fixes and performance improvements for client navigation. https://www.youtube.com/watch?v=ewf-18jacmo – Theo, a YouTube personality, gives his take on the FLAME idea, expressing concerns and impressions on Chris McCord's article and library. Do you have some Elixir news to share? Tell us at @ThinkingElixir or email at show@thinkingelixir.com Find us online Message the show - @ThinkingElixir Message the show on Fediverse - @ThinkingElixir@genserver.social Email the show - show@thinkingelixir.com Mark Ericksen - @brainlid Mark Ericksen on Fediverse - @brainlid@genserver.social David Bernheisel - @bernheisel David Bernheisel on Fediverse - @dbern@genserver.social Cade Ward - @cadebward Cade Ward on Fediverse - @cadebward@genserver.social Sponsored By:Fly.io: Fly.io is a great place to deploy your next Phoenix application! Check them out!

Developer Chris McCord introduces FLAME, a serverless approach with Phoenix framework, revolutionizing elastic compute. They delve into its unique scaling, Kubernetes option, and cross-language compatibility. The podcast also explores Elixir's evolution, LiveView Native beta, and machine learning in Elixir apps.

This podcast covers news on Phoenix and Elixir's groundbreaking feature, José Valim's proposal on local accumulators, Supabase's innovative libcluster_postgres library for Elixir node discovery, translating NumPy code to Elixir, and the Elixir community's approach to Advent of Code challenges.

In the latest episode, we delve into the rapidly evolving AI ecosystem and its implications for us as Elixir developers, highlighting the potential hazards of relying on proprietary services like OpenAI and the benefits of self-hosted, open-source AI models. We touch on the Elixir LangChain library, how Elixir's position of running our own AI models strengthens us, and the governance and financial risks of depending on a single AI provider. Tune in for why these topics matter and how they shape the future of development in the context of Elixir, plus the holiday season's impact on our show schedule, and more! Show Notes online - http://podcast.thinkingelixir.com/179 Elixir Community News https://twitter.com/chris_mccord/status/1724861258548052109 – Chris McCord teased a new visual on Twitter resembling a colorful flame logo with the text "Soon™", with more details to come. https://hauleth.dev/post/who-watches-watchmen-ii/ – Hauleth's blog post explores creating an Elixir service supervised by SystemD, building on his series about managing BEAM applications. https://www.elixirstreams.com/tips/how-page-title-is-updated – German Valesco explains the updating of the page_title in Phoenix LiveView with a tip and video demonstration. https://dockyard.com/blog/2023/11/08/three-years-of-nx-growing-the-machine-learning-ecosystem – Sean Moriarity discusses the past three years and the future of the Elixir Machine Learning Ecosystem and Nx in a blog post on Dockyard. https://twitter.com/TheErlef/status/1726654135750066390 – Announcement of the 3rd edition of a BEAM-focused devroom at the 2024 FOSDEM conference, set to take place in Brussels. https://beam-fosdem.dev/ – FOSDEM's BEAM devroom, an event for the Elixir community and enthusiasts, provides details about the upcoming sidetrack. https://www.youtube.com/playlist?list=PLqj39LCvnOWbHaZldxw_g02RaTQ4vQ1eY – The official playlist of ElixirConf US videos, with several more sessions expected to be added. https://www.youtube.com/watch?v=nw-030FD0Qc&list=PLqj39LCvnOWbHaZldxw_g02RaTQ4vQ1eY&index=46 – ElixirConf US video of Rafal Studnicki discussing keeping real-time auctions running during rollouts. https://www.youtube.com/watch?v=P44hFAhKPao&list=PLqj39LCvnOWbHaZldxw_g02RaTQ4vQ1eY&index=47 – Tyler Young's ElixirConf US presentation on migrating data without downtime. https://www.youtube.com/watch?v=4XaB4XWg-Qg&list=PLqj39LCvnOWbHaZldxw_g02RaTQ4vQ1eY&index=48 – Michał Śledź's session at ElixirConf US on rewriting Pion in Elixir. https://www.youtube.com/watch?v=E9pZP5jUYZg&list=PLqj39LCvnOWbHaZldxw_g02RaTQ4vQ1eY&index=49 – Andrew Berrien introduces ECSx and discusses a new approach to game development in Elixir at ElixirConf US. https://www.youtube.com/watch?v=F42B6AZ879Q&list=PLqj39LCvnOWbHaZldxw_g02RaTQ4vQ1eY&index=50 – Geoffrey Lessel's introduction to Vox, a static site generator for Elixir enthusiasts, at ElixirConf US. https://adventofcode.com/ – Advent of Code is approaching, presenting new coding challenges starting December 1st with a new rule against using AI for leaderboard rankings. https://twitter.com/ljgago/status/1724917401462997413 – Leonardo Gago tweets about his kino_aoc smart cell to assist with Advent of Code puzzles in Livebook. https://github.com/ljgago/kino_aoc – GitHub repository for KinoAoc, a Livebook smart cell created by Leonardo Gago for solving Advent of Code puzzles. Do you have some Elixir news to share? Tell us at @ThinkingElixir or email at show@thinkingelixir.com Discussion Resources The discussion explores the AI ecosystem's influence on Elixir developers, addressing risks and dependencies unrelated to Elixir itself. Concerns are raised about the dangers of building on top of OpenAI and the risk of service outages, as experienced with an AI fitness trainer. Open-source AI models are discussed as viable alternatives that offer the possibility of self-hosting and independence from proprietary systems. Mention of the Elixir LangChain library signifies an interest in being able to seamlessly switch AI models without altering application code. The discussion covers the risks of government regulation, policy changes, financial and governance uncertainties, and how they could affect dependencies on single AI providers. An industry desire for regulatory measures is expressed, aiming to build a legal buffer that could protect from competition. The conversation questions the broader implications of reliance on AI, including why the topic is intriguing and why self-hosted, open-source models are crucial. Arguably, Elixir is considered to have a strong position for running self-managed AI models, highlighting the alignment with open-source philosophies. Looking to the future, Elixir is positioned well to do this. A final note touches on the holiday season's effect on the podcast's show schedule with potential changes or pauses in the regular programming. Find us online Message the show - @ThinkingElixir Message the show on Fediverse - @ThinkingElixir@genserver.social Email the show - show@thinkingelixir.com Mark Ericksen - @brainlid Mark Ericksen on Fediverse - @brainlid@genserver.social David Bernheisel - @bernheisel David Bernheisel on Fediverse - @dbern@genserver.social Cade Ward - @cadebward Cade Ward on Fediverse - @cadebward@genserver.social Sponsored By:Fly.io: Fly.io is a great place to deploy your next Phoenix application! Check them out!

In this episode, we revisit the Safe Ecto Migrations guide and get an update on improvements. We also discuss the role and importance of OpenSource AI models. We cover updates in the Elixir LangChain library, the advantages of self-hosted AI models like Mistral, and learning how to run Bumblebee on Fly.io GPUs. Tune in for an insightful blend of database best practices and the cutting-edge of AI in Elixir, plus more! Show Notes online - http://podcast.thinkingelixir.com/178 Elixir Community News https://www.youtube.com/playlist?list=PLqj39LCvnOWbHaZldxw_g02RaTQ4vQ1eY – Playlist of 44+ ElixirConf US talks now available on YouTube. https://www.youtube.com/watch?v=eCnfdHtgAN4&list=PLqj39LCvnOWbHaZldxw_g02RaTQ4vQ1eY&index=39 – Owen Bickford's talk on Elixir's Secret Ingredient at ElixirConf. https://www.youtube.com/watch?v=gtCJ56GxKf0&list=PLqj39LCvnOWbHaZldxw_g02RaTQ4vQ1eY&index=43 – Jeffery Utter's ElixirConf presentation on Scaling Teams with Kafka on the BEAM. https://www.youtube.com/watch?v=VLO0ma-1uD4&list=PLqj39LCvnOWbHaZldxw_g02RaTQ4vQ1eY&index=44 – Andrew Bennett discusses Erlang Dist Filtering and the WhatsApp Runtime System at ElixirConf. https://www.youtube.com/watch?v=bBaZDAynM08 – Michael Lubas's insights into Elixir Security from a Business and Technical Perspective. https://dockyard.com/blog/2023/11/01/the-road-toward-live-view-native-v-0-2-part-2 – Update on the progress of LiveView Native, including multi-character sigils and Phoenix layouts. https://sessionize.com/lambda-days-2024 – Call for talks for the Lambda Days 2024 conference focused on functional programming in Kraków, Poland. https://twitter.com/germsvel/status/1722221427112456533 – Elixir 1.16 introduces the ability to run multiple tests with line numbers as shown by German Velasco. https://www.youtube.com/watch?v=bfrzGXM-Z88 – Theo's livestream with José Valim, discussing various topics for 2.5 hours. https://peterullrich.com/test-an-external-read-only-repository-in-phoenix – Peter Ullrich's method for testing an external, read-only repository in Phoenix. Do you have some Elixir news to share? Tell us at @ThinkingElixir or email at show@thinkingelixir.com Discussion Resources 7:43 - David introduces and explains Safe Ecto migrations. Updates on Safe Ecto for additional safety features and latest improvements. Review of the performance of using text columns in databases showing that they have the same performance as VARCHAR types. Examples provided of non-immutable expressions within database contexts. Highlighting an error that can occur when backfilling data without a sort order. Suggestion that Common Table Expressions (CTE) offers a more reliable method for certain database operations. David's call for a library to assist with running database operations through a UI, indicating the desire for tooling improvements. Consider the use-cases in the development and implementation of safety tools for databases. 18:47 - Mark discusses new Fly.io GPU hardware, model improvements, and the Bumblebee tool. Mistral LLM and its capabilities in the AI space. Insights into running Bumblebee on GPUs and performance considerations. Importance of Mistral being self-hosted. Explanation of why self-hosting AI models like Mistral is significant for developers and users. OpenAI's outage interrupted Mark's AI-powered workout trainer. Outlining the Elixir LangChain goals, its roadmap, and potential impact on AI and data processing. Discussion on how Large Language Models (LLMs) are effectively used for data extraction tasks. Discussion on what an AI router is and what problem it solves. Find us online Message the show - @ThinkingElixir Message the show on Fediverse - @ThinkingElixir@genserver.social Email the show - show@thinkingelixir.com Mark Ericksen - @brainlid Mark Ericksen on Fediverse - @brainlid@genserver.social David Bernheisel - @bernheisel David Bernheisel on Fediverse - @dbern@genserver.social Cade Ward - @cadebward Cade Ward on Fediverse - @cadebward@genserver.social Sponsored By:Fly.io: Fly.io is a great place to deploy your next Phoenix application! Check them out!

This week's news highlights Discord's deep-dive into how they've scaled their servers to support millions of concurrent users, leveraging Elixir's power. We cover how the Oban notifier has evolved to include Phoenix.PubSub and Redis integration, allowing more flexibility for your job processing needs. LiveView Native's tutorial experience looks promising to make mobile development smoother and more intuitive. Plus, we cover the Livebook PR merge upgrading to the Bandit library and more! Show Notes online - http://podcast.thinkingelixir.com/177 Elixir Community News https://discord.com/blog/maxjourney-pushing-discords-limits-with-a-million-plus-online-users-in-a-single-server – Discord blog post detailing the scaling of individual Discord servers and the technical challenges involved. https://github.com/discord/manifold – GitHub link to Discord's opensource Elixir library "Manifold" used for batch message passing between nodes. https://www.youtube.com/watch?v=HP86Svk4hzI – Chris Grainger discusses using Elixir + Phoenix + Nx in production with machine learning on the BEAM. https://github.com/livebook-dev/livebook/pull/2316 – A Livebook PR titled "Upgrade to bandit" merged by José Valim, signifying an endorsement for the Bandit library. https://twitter.com/cvkmohan/status/1719489327925694682 – Discussion on Twitter about using Bandit as an upgrade for a Phoenix app. https://elixirstream.dev/gendiff/phx_new/19CBA027FA97E2873CC24093F6AC1820 – A flag added to elixirstream.dev for diffing generated output, introduced in Phoenix 1.7.8. https://github.com/sorentwo/oban_notifiers_phoenix – Release of a new Oban notifier powered by Phoenix.PubSub, compatible with OTP and now able to use Redis. https://twitter.com/bcardarella/status/1720179762088272080 – Tease of the upcoming LiveView Native v0.2 and its tutorial experience using Livebook. https://podcast.thinkingelixir.com/174 – Previous interview about DockYard's BeaconCMS https://twitter.com/bcardarella/status/1721172482298663214 – Twitter post discussing the 'Variants' feature for A/B/C/D/etc. page variant testing in BeaconCMS. https://twitter.com/NervesMeetup/status/1721389396417728782 – Announcement tweet for the next Nerves embedded systems meetup. https://www.meetup.com/nerves/events/290189609/ – Meetup link for the Nerves embedded systems event featuring a walkthrough by Alex McLain. Do you have some Elixir news to share? Tell us at @ThinkingElixir or email at show@thinkingelixir.com Find us online Message the show - @ThinkingElixir Message the show on Fediverse - @ThinkingElixir@genserver.social Email the show - show@thinkingelixir.com Mark Ericksen - @brainlid Mark Ericksen on Fediverse - @brainlid@genserver.social David Bernheisel - @bernheisel David Bernheisel on Fediverse - @dbern@genserver.social Cade Ward - @cadebward Cade Ward on Fediverse - @cadebward@genserver.social Sponsored By:Fly.io: Fly.io is a great place to deploy your next Phoenix application! Check them out!