Syntax - Tasty Web Development Treats

791: LLRT The Serverless Runtime w/ Richard Davison

Jul 5, 2024

56:40

Snipd AI

Richard Davison from AWS discusses LLRT, a new runtime for Lambda, tailored for performance. Topics include challenges with JavaScript in serverless, Rust's selection for development, Quick.js engine benefits, JIT compiler usage, and LLRT compatibility with Node.js.

AI Summary

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

LLRT provides significant speed enhancements for JavaScript on Lambda, focusing on low latency and efficient event-driven architecture.

Rust was chosen for LLRT's development to ensure superior speed, safety, and memory protection, promoting high performance and robust coding practices.

Deep dives

LLRT Runtime for JavaScript Offers Significant Cold Start Time Improvements

The LLRT runtime for JavaScript developed at Amazon showcases remarkable speed enhancements, offering over a 30 times improvement in cold start time. This runtime is designed to address specific features tailored for Lambda functions and serverless architecture, ensuring fast startup times and efficient event-driven architecture. While LLRT complements existing runtimes, focusing on low latency and optimized performance, it may not support custom APIs or complex web specifications like WebAssembly functions or extensive Web Streams API.

Intro

2min

Evolution of Web Development Tools and Technologies

13min

Running Node.js Functions on Lambda and Dealing with Cold Starts

4min

LLRT: Optimizing for Speed and Cost Efficiency in Serverless Computing

9min

Exploring QuickJS and Exceptional Programming Skills

5min

Exploring Rust for a Serverless Runtime and Optimization Strategies

13min

Exploring LLRT Node Compatibility

10min

Exploring Technical Projects and Defending JavaScript

2min

Scott and Wes chat with Richard Davison from AWS about LLRT, a new runtime tailored specifically for Lambda. They dive into the benefits of using LLRT, challenges with JavaScript in serverless, and why Rust was chosen for its development.

Show Notes

00:00 Welcome to Syntax!
01:07 Who is Richard Davison?
05:11 What is LLRT and what’s the motivation for building it?
08:25 AWS Lambda example.
11:20 What makes LLRT specifically tailored to Lambda?
14:55 Brought to you by Sentry.io.
15:22 Node.js in Lambda.
16:00 What are some challenges that people have with JavaScript in serverless?
17:20 Lambda memory configuration.
19:23 Managing cost of compute.
21:29 Simpler and faster than Node, Bun, Dino, but not a replacement.
22:31 The benchmarks.
27:00 Quick.js, the main reason for the performance gains.
- Fabrice Bellard QuickJS.
28:03 The Quick.js engine.
30:35 What was the reason behind creating Quick.js?
33:46 What made you pick Rust for LLRT?
36:34 Abstractions and the value of speed.
39:08 The JIT Compiler.
42:38 Compile cache.
43:27 De-optimizations.
44:59 Node.js Compat, what to use and avoid with LLRT.
- GitHub AWS Labs Compatibility Chart.
47:52 Will you target with WinterCG spec?
50:22 Streams API.
52:06 What about WebSockets?
53:10 Is this going to be promoted from a labs project?
54:49 Sick Picks + Shameless Plugs.