The History of XA Function and the Cost of Running Language Models

3min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

Learn about the origins of XA Function, their infrastructure for autonomous vehicles, and their goal of democratizing their product.

In this supper club, Scott and Wes welcome Kevin Hou, Head of Product Engineering at Codeium, a blazing fast AI-powered code completion and chat tool for developers.
  Show Notes 00:00 Welcome to Syntax!
31 An introduction to Codeium.
56 What information are you sending the AI to get such good completions?
Codeium compliance
15 Codeium runs a 'Language Server'.
15 Crawling dependency tree and abstract syntax tree.
07 Using Codeium Live.
34 How big of a codebase can you run this on?
39 Sending select amounts of data to AI.
06 Does Codeium maintain codebase preferences and styling (ie. snake case)?
39 Will Codeium scan the dependency?
23 AI UI, have we found the best format?
55 Crazy ideas in tech.
53 Additional AI UI inputs.
14 How do you make an AI model?
42 How does Codeium manage the product roadmap?
09 Do AI models get worse over time? How does Codeium validate that it's not?
Open AI Evals
39 How is Codeium THAT fast?
49 What programming langauges does Codeium use?
55 Codeium Playground.
Codeium Playground
15 Caching as a performance improvement.
58 What is the pipe between Codeium and editor?
17 Codeium chat service.
44 A WebSocket system allowing push and pull communication.
13 Closed Beta for GPT 4.0.
12 The dreaded closing quote bug.
26 Sometimes bugs bug Wes.
49 Supper Club Questions
40 Perplexity.ai
35 What editor does Kevin use?
31 Sick Picks + Shameless Plugs
  Sick Picks  Kevin: Lapse.com
 Shameless Plugs  Kevin: Codeium.com
 Hit us up on Socials!  Syntax: X Instagram Tiktok LinkedIn Threads
Wes: X Instagram Tiktok LinkedIn Threads
Scott: X Instagram Tiktok LinkedIn Threads
Randy: X Instagram YouTube Threads