Mark Hinkle, CEO of Peripety Labs and a veteran in serverless technologies, discusses the intriguing role of AI agents in software development. He describes these agents as 'dumb robots' that automate tasks but rely on large language models for real intelligence. Hinkle highlights the transformative potential of AI in creating bespoke tools on-the-fly and emphasizes the necessity of effective management practices. The conversation also spans his three-decade journey through technological evolution and the shift towards innovative GPU utilization in AI.
AI agents are evolving as 'dumb robots' capable of automating software tasks while the intelligence lies in large language models.
The management of AI agents requires a shift towards treating them like virtual employees, emphasizing clear goals and collaborative engagement.
Deep dives
The Evolution of Computational Entities
Serverless functions and AI agents represent a shift in how computational entities are perceived and utilized. Traditionally, computation has been tied to resource consumption, but serverless architectures enable resource usage only during execution, optimizing efficiency and cost. AI agents, on the other hand, are designed to operate with specific goals, performing complex tasks without needing constant resource allocation. This evolution indicates a movement towards a more dynamic and flexible computational environment, where both serverless functions and AI agents can operate efficiently and effectively.
The Importance of Memory and Networking in AI
Memory plays a crucial role in the functionality of large language models, as it enables them to maintain context during interactions. Advances in memory technology and increased context windows allow these models to process and recall information more effectively. Additionally, networking improvements have led to enhanced data transmission rates to and from these models, thereby reducing bottlenecks associated with data analysis. Together, these elements enhance the performance of AI, making it more adept at handling complex queries and large datasets.
Managing AI Agents in Today's Technological Landscape
The management of AI agents fundamentally differs from traditional serverless functions, as it involves guiding these agents through natural language interactions rather than code. Technologists need to adapt their management strategies to treat AI agents as virtual employees, providing clear goals and expectations to ensure consistent output quality. By offering specific examples and frameworks, technologists can facilitate the learning process for AI agents, allowing them to align more closely with organizational needs. This shift emphasizes the evolving relationship between humans and technology, creating a collaborative environment that leverages the strengths of both.
AI agents are set to transform software development, but software itself isn’t going anywhere—despite the dramatic predictions. On this episode of The New Stack Makers, Mark Hinkle, CEO and Founder of Peripety Labs, discusses how AI agents relate to serverless technologies, infrastructure-as-code (IaC), and configuration management.
Hinkle envisions AI agents as “dumb robots” handling tasks like querying APIs and exchanging data, while the real intelligence remains in large language models (LLMs). These agents, likely implemented as serverless functions in Python or JavaScript, will automate software development processes dynamically. LLMs, leveraging vast amounts of open-source code, will enable AI agents to generate bespoke, task-specific tools on the fly—unlike traditional cloud tools from HashiCorp or configuration management tools like Chef and Puppet.
As AI-generated tooling becomes more prevalent, managing and optimizing these agents will require strong observability and evaluation practices. According to Hinkle, this shift marks the future of software, where AI agents dynamically create, call, and manage tools for CI/CD, monitoring, and beyond. Check out the full episode for more insights.
Learn more from The New Stack about emerging trends in AI agents: