Interconnects cover image

Interconnects

Latest episodes

undefined
Jun 12, 2024 • 13min

AI for the rest of us

The podcast delves into Apple's innovative AI system, discussing core models, alignment strategies, and on-device magic. They explore how Apple optimizes machine learning models on their devices, using adapters and pioneering AppIntents for standardized app functionality.
undefined
Jun 5, 2024 • 8min

A realistic path to robotic foundation models

Sergey Levine and Chelsea Finn from Physical Intelligence discuss a realistic path to robotic foundation models, key factors for the future of robotics, and the transformerification of robotics. They explore the shift towards horizontal robotics companies and the importance of building general robotics models for various tasks.
undefined
May 29, 2024 • 8min

We aren't running out of training data, we are running out of open training data

Exploring the scarcity of open training data, data licensing deals, scaling language models, and the shift towards synthetic and multimodal data for training. Synthetic data generation at a rate of 1 trillion tokens per day. High costs of data licensing deals. Search for better tokens and new frontiers in AI development.
undefined
May 22, 2024 • 9min

Name, image, and AI's likeness

Exploring AI's impact on personal branding and the controversy with OpenAI's latest model. Legal and ethical dimensions of AI on name, image, and likeness. Influence of AI on media, culture, and creativity, and the challenges faced by public figures in protecting their features from unauthorized use.
undefined
May 16, 2024 • 12min

OpenAI chases Her

OpenAI chases Her in this podcast, discussing GPT-4O's advancements and Google's mirror with Gemini. The episode explores creating AI companions like Samantha from 'Her' and the competitive drive for product innovation in AI.
undefined
May 13, 2024 • 14min

OpenAI's Model (behavior) Spec, RLHF transparency, and personalization questions

Exploring OpenAI's model behavior specification for transparency and steering AI models, the importance of detailing behaviors, system prompt complexities, balancing complexity in AI model behavior, and the significance of adhering to OpenAI's model behavior specification and community norms in AI usage.
undefined
May 1, 2024 • 13min

RLHF: A thin line between useful and lobotomized

Exploring the mechanisms for making models chattier, the chattiness paradox, and the next steps for RLHF research in AI generated audio with Python. Delving into the impact of style on model evaluation and improvement, advancements in training language models, and exploring preference alignment in data sets. Discussing biases in GPT-4, alternative models like alpaca and vacuna, and the importance of data in AI research.
undefined
Apr 30, 2024 • 10min

Phi 3 and Arctic: Outlier LMs are hints

The podcast discusses the future of AI industry with outlier LLMs, focusing on Phi 3 and Arctic models. It explores trends in open mixture of expert models and the impact of synthetic data on small models. The episode also touches on the training techniques of the new models, including Arctic's sparse mixture of experts architecture and Phi 3's evolution in the LLM space.
undefined
Apr 24, 2024 • 11min

AGI is what you want it to be

Exploring the ambiguous definition of AGI and its impact on AI discourse, focusing on the role of reinforcement learning and the challenges of defining genuine intelligence. Delving into various tests for AGI, such as the Modern Turing Test, and the debate around surpassing human abilities. Reflecting on the balance between compute power, energy efficiency, and the future of AGI in AI model training.
undefined
Apr 21, 2024 • 15min

Llama 3: Scaling open LLMs to AGI

Explore the challenges and advancements in scaling open large language models towards achieving AGI, including Meta's release of the LAMA3 model. Analysis of training models at Meta and comparisons with other hyperscalers. Discuss training and fine-tuning strategies for long context behavior. Exploration of pricing calculation methods, preference data, and AI platform features. Future prospects of the open LLM ecosystem through the upcoming llama 3 400b model.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode