Assessing Confidence Levels and Generating Guidelines

This chapter explores a tool's varying confidence levels in generating markdown files, especially within charting libraries. It highlights the creation of comprehensive guidelines and the necessity of concise rules alongside proper documentation links.

Transcript

chevron_right

Play full episode

chevron_right

Transcript

Episode notes

Zach Davis is a product-minded engineering leader and builder at heart, with over 12 years of experience building high‑performing teams and crafting developer tools at companies like Atlassian and LaunchDarkly. In this episode, he shares how he’s helping his 100-plus-person engineering team successfully adopt AI tools by creating centralized documentation, using agents to tackle technical debt, and improving hiring processes—all while maintaining high quality standards in a mature codebase.

What you’ll learn:

1. How to create a centralized rules system that works across multiple AI tools instead of duplicating documentation

2. A systematic approach to using AI agents like Devin and Cursor to analyze and reduce test noise in large codebases

3. How to leverage AI tools to document your codebase more effectively by extracting knowledge from existing sources

4. Why “what’s good for humans is also good for LLMs” should guide your documentation strategy

5. A custom GPT workflow for improving interview feedback quality and coaching interviewers

6. How to approach tech debt reduction with AI by creating prioritized task lists that both humans and AI agents can work from

—

Brought to you by:

WorkOS—Make your app enterprise-ready today

Lenny’s List on Maven—Hands-on AI education curated by Lenny and Claire

—