Software People Stories cover image

Software People Stories

The potential of Large Language Models with Steven Aberle

Jan 7, 2023
36:06

Hope you had a wonderful start to the new year.

This episode is special for multiple reasons.

This is one of the few episodes when I had the conversation with a guest in person - and that was also video recorded, with a fireplace in the background, on a cold day!

You would be able to watch this conversation as a video on the PM Power youtube channel.

This episode was recorded in November, 2022 - much before ChatGPT was made available to the public and the subsequent increased interest.

My guest today, Steven Aberle, is a founder of a company that is in stealth mode, working on domain aware, Large Language model based processing for very niche applications.

In this conversation, Steven shares

  • How he joined the military half way through college and then went back to finish his studies
  • Getting interested in IT during the military service
  • Navigating away from the back end to the front and, focusing on how the users interact with the systems
  • Being in the Washington DC area, getting to work on Defense related areas
  • Working on defense proposals, that need to be technical, unique and bring out the uniqueness of the proposed approach
  • Creating a piece of patented technology for domain aware generative AI, based on Large Language models and transformers
  • The challenge for small technology companies to break into the defense procurement space
  • Couple of challenges with the open LLMs
  • Trained on open content available, thereby missing contextual insights that are more valuable
  • None of the data that is generated, can be attributed to the source material [explainable AI]
  • How he organizes his own learning even when moving across specialization areas
  • It is always about the data
  • His exposure and experience with ETL approaches, including working with unstructured data
  • About being a full stack engineer, to be aware of many areas
  • Not be as much of an expert as one may want to be in any one area, but connect the learnings to the new areas as well
  • His approach for being a T-shaped individual, going deep into LLM, on how they are trained 
  • Transformers are the next big wave now, after the cloud a couple of decades ago
  • The concept or role of a solutions architect and how that may be implemented in a large language model
  • Aspects related to LLMs and content / data more than just text, to also include images, figure descriptions etc
  • How generative AI has made the life of graphic designers / UX specialists much easier
  • Capturing conversations with solutions architects, use a transformer to generate a proposal-language based output

His answer to that question and a lot more - including questions he asked me, related to startups - effectively making role reversal - the guest becoming the host!

Steven Aberle is the Co-Founder of The Rohirrim, a start-up bringing Domain-Aware Generative AI to the Enterprise. He has 18 years of leadership and executive-level technology capacities and is a recognized expert in unstructured data processing at scale. Steve holds the patent for Domain-Aware Generative AI, Generative Stitching and Vector-Attributable Large Language Models.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode