The Making of an Industry: The Rise of AI Engineering, with Swyx
Jan 24, 2024
auto_awesome
Swyx, developer, writer, and startup advisor, discusses the rise of AI engineers, the differences between AI and ML engineers, and the demand for this specialization. He also talks about successful products made using existing foundation models and the practical considerations of running AI models. The podcast explores the cost advantages of using APIs or cloud providers for AI engineering and the career implications of being an AI engineer.
The demand for AI engineers knowledgeable about foundation models is expected to be greater than the supply, creating opportunities for specialization and career growth.
AI engineers play a critical role in reshaping industries by leveraging shared sets of problems, creating communities, and applying AI concepts to put things into production applications.
Deep dives
The Rise of the AI Engineer
The podcast episode discusses the rise of a new type of front-end specialization called the AI Engineer. This role involves building with AI foundation models and enabling features and applications that were previously not possible for most companies or developers. The demand for AI engineers knowledgeable about foundation models is expected to be greater than the supply, presenting an opportunity for specialization. AI engineers have a unique skill set that allows them to leverage foundation models and build AI-powered capabilities into applications. The episode highlights various examples of companies that are successfully leveraging foundation models, such as mid-journey for image generation and perplexity for search engines.
Building with Foundation Models
The podcast explains that building with foundation models involves using pre-trained models that are capable of performing a variety of tasks. These models, often called general or foundation models, can be customized and utilized to create AI-enabled applications. By adding prompts and connecting APIs, developers can leverage these models to generate code, create UI elements, or perform other specific functions. The episode emphasizes that AI engineers play a crucial role in utilizing these foundation models effectively and scaling their applications to meet the demands of end-users.
The Role of AI Engineers
The podcast delves into the role of AI engineers and how they differ from ML engineers and AI researchers. The AI engineer is defined as a software engineer who builds with AI, applying AI concepts and limitations to put things into production applications. The episode highlights the importance of technical expertise for AI engineers, as they need to shape AI APIs to their liking and provide value to end-users. It also emphasizes that AI engineers play a critical role in reshaping industries by leveraging shared sets of problems and creating communities focused on the use of specific tools, technologies, and models.
Implications and Advice for AI Engineers
The podcast explores the career implications and offers advice for aspiring AI engineers. It suggests that AI engineering is primarily software engineering, with AI concepts being a specialization within that field. AI engineers should focus on learning software engineering fundamentals thoroughly before diving into AI-specific concepts. The episode encourages AI engineers to specialize in a specific domain and become experts in that field. It also highlights the importance of learning in public, connecting with experts, and building real projects to gain valuable experience and knowledge.
Meet Shawn Wang (Swyx) 🇺🇸! Swyx is a developer, writer, and startup advisor. If you listen to our show regularly, you know him as the biggest advocate for learning in public! Today, he's the founder of smol.ai and a podcast host and teacher at Latent Space. Last summer, Swyx wrote a blog post titled The Rise of the AI Engineer, which quickly went viral.
In this episode, Swyx will revisit that blog post to see if anything changed. You will learn why AI engineers are a thing, the differences between AI and ML engineers, and why the demand for this specialization is larger than the supply. Swyx also reveals what defines an industry (and why it's not only about tools) and gives many good examples of successful products made using existing foundation models. Swyx and Alex also talk about the inner workings of AI and whether it's a good idea to run AI models on your own hardware.