Raw Data with Rob Collie

Those Excel macros running your business were never meant to be permanent. Someone in accounting built them because the company needed custom software and didn't have the budget or patience for a two-year IT project. IT hates them. You know they're fragile. But they work. And compared to expensive software that never quite fits, working counts for a lot. In this episode, Rob and Justin dig into what might finally replace that world. Not in theory, but in practice. Over the next four years, is the real shift AI helping people build traditional software faster and cheaper? Or is it software that actually has AI running inside it at runtime? The difference matters if you're deciding where to invest time, money, or political capital. They also tackle who's going to build this next-generation line of business tools. Is it the Power BI crowd all over again? The VBA veterans reinventing themselves? Or a new kind of builder who sits closer to the business than IT ever could? If you're nursing a mission-critical spreadsheet you're afraid to touch, or paying too much for SaaS that almost fits, this conversation will feel uncomfortably familiar. And useful. Listen to the episode and start thinking about what replaces your macros before they replace themselves.

Every week brings a new AI model, a new benchmark, and a new reason to believe everything just changed. But for most companies, none of that matters if the people closest to the work can't use these tools to build something real. In this episode, Rob and Justin walk through what democratized data science really looks like. Not dashboards. Not prompts. Actual analysis and custom software built around a specific problem, driven by someone who knows the data well enough to challenge the answers. The difference isn't the technology. It's the person driving it. Someone who understands the data, the domain, and how to spot bad answers before they turn into bad decisions. That's where the data gene shows up again. When those people are empowered to build software fitted to how work happens, off-the-shelf tools stop feeling helpful and start feeling like friction. This episode is about noticing that shift while everyone else is still watching benchmarks. Be sure to subscribe on your favorite podcast platform for weekly reality checks on AI and Analytics delivered straight to your inbox.

Every week brings a new AI benchmark. Higher scores. Bigger claims. Louder voices insisting this changes everything. And yet, when you put AI in front of a real business problem, none of that noise seems to help. In this episode, Rob and Justin dig into why AI benchmarks often feel strangely meaningless in practice and why that disconnect is the point. Benchmarks aren't useless. They're just answering a different question than the one most businesses are asking. This isn't just random conjecture either. Rob walks through what he's learned building actual AI workflows and why a twenty percent improvement on a leaderboard rarely translates into anything you can feel on the job. They talk about why model choice usually isn't the bottleneck, why swapping models should be easy if you've built things the right way, and why the most successful AI work rarely shows up as a flashy demo. Most of the value is happening quietly, off-screen, inside systems that look a lot more like normal software than artificial intelligence. Rob and Justin also talk about why explaining AI is often harder than building it. The first demo people see tends to stick, even when it's the wrong one. Consumer AI feels magical. Business AI face plants unless it's built with intent, structure, and real context. This episode gives leaders better language for that gap, without hype or panic. If you're done chasing benchmarks and just want a way to think about AI that survives contact with reality, this episode's for you.

Everyone keeps asking whether AI kills Power BI or makes it stronger. Rui Romano flips that entire question on its head. As the Microsoft PM behind PBIP, TMDL, and all the file format work that rebuilt Power BI's foundation, he explains how the platform accidentally became one of the most AI-ready systems in analytics - and it wasn't by accident, not really. His team was solving problems for real developers who were tired of unsupported workarounds and offshore relay races. They weren't training agents. But the work they did means AI now feels native instead of duct-taped on. What we learned was that the semantic model is still the highest ground in this whole space. While other tools let AI stumble through raw tables and pray the math holds up, a proper model gives AI the one thing it absolutely cannot fake: context. Relationships. Business logic that works at every level of granularity without falling apart. Rui breaks down why that matters now more than ever, why all the hardening work his team did keeps your models from exploding when an agent gets ambitious, and why the future of BI isn't about cranking out another hundred pixel-perfect dashboards. It's about fast iteration, lower friction, and answers you can trust at scale. Dashboards still matter - but only the ones people use. This conversation goes deep on architecture, not hype. Rui talks about what's changing right now, what still needs work, and why natural language will eventually beat drag-and-drop for a lot of what we do today. If you've been wondering whether to invest in real semantic modeling or just let AI figure it out from scratch every single time, this episode makes the case for why foundations always win. Always. Listen in and get ahead of the shift. And if the episode lands for you, leave us a review to help other folks find the show.

This episode starts with a familiar scene. A role opens, the applications pour in, and suddenly you're staring at a mountain of resumes that deserve real attention but arrive faster than anyone can process. The mix had everything… experienced candidates, newcomers trying to break in, and a growing stack of AI-generated submissions that looked sharp until you asked a second question. That's where Haystack came in. Instead of using AI as a blunt filter, Rob and the team treated it like a collaborator. Teach it what matters. Teach it what P3 looks for in a teammate. Teach it how to separate real signal from polished noise. What came back wasn't a robot recruiter. It was clarity. And Haystack is only half the story. As the conversation unfolds, Rob and Justin zoom out into the broader pattern they're seeing across all the small, useful agents taking shape inside P3. The stuff that isn't blind hype. The stuff that quietly fixes overloaded parts of the business and makes the human decisions easier to get right. Because that's the through-line here. When AI handles the overflow, people get to spend their time on the work that actually requires judgment. Queue it up and hear what happens when AI stops pretending to be magic and starts doing real work. And if you've got a corner of the business that's begging for that kind of clarity, we can help you find the tiny build that changes everything.

Rob finally cracked his years long standoff with the podcast lair cat, and the fix was hilariously simple. That small victory ends up setting the tone for the whole episode, because everything that follows has the same energy: real problems that only make sense once you shrink the solution down. As Rob talks through the cat truce, Justin brings in a different kind of chaos. A customer service bot that sounded fully in command yet never actually did the thing it said it did. Pair that with a hiring queue full of AI written applications, and the whole picture starts to come into focus. Once you see the pattern, you can't unsee it. The wins only show up when the AI job gets small. The fantasy football tool works the moment AI stops trying to scrape the entire internet and instead only writes the human part. The hiring filter works when AI is there to catch repetitive patterns, not run the whole show. Even the experiments coming out of Danielson Labs click only because the AI calls are tiny and the real work sits in regular code. Everything points in the same direction. Let AI handle the one thing only AI can do, then let normal tech take it from there.

Everyone's talking about AI like it's plug-and-play. Spoiler: it's not. In this episode, Rob digs into why Big Tech's billions in AI R&D haven't yet turned into matching revenue — and what that means for the rest of us. The truth? The real business wins don't come from off-the-shelf models; they come from smart customization. Rob breaks down the "magic Lego brick" approach that separates hype from practical reality, showing how everyday tools like Power BI and Power Automate can connect to AI in surprisingly simple (and powerful) ways. He also revisits Bill Krolicki's "Vendor Bot" example to prove that you don't need to be a researcher or a billionaire to make AI deliver real results. If you've ever opened ChatGPT, asked it to "optimize operations," and gotten nowhere — this one's for you.

When the bubble pops, what's left standing? Everyone's calling AI a bubble — and yeah, there's some wild stuff happening behind the scenes. Billions changing hands between the same few tech giants. Investments that look more like circular loans than innovation. But what if the real bubble isn't AI at all? Rob breaks down what's really inflating, what's not, and why your business shouldn't lose sleep over it. The headlines may sound like the sky's falling, but the tools driving real results aren't going anywhere. Some bubbles burst. Others just float higher. Listen now to hear Rob's take on which kind this is and why the real value of AI doesn't care what the stock chart says.

Everyone's talking about AI. Almost no one's getting specific. And that's the problem. Rob and Justin break down the three categories that matter: chat agents you talk to, embedded assistants baked into your workflows, and headless systems running quietly in the background doing the grunt work nobody wants to do. This isn't theory. This is how AI is finally working for real companies. They walk through Vendor Bot, Scheduler Bot, and Budget Bot — small, focused tools that do one thing exceptionally well. Because here's what keeps happening: the "one bot to rule them all" projects collapse under their own weight every single time. But stack a few narrow, reliable bots together? That's when things get interesting. If you've been wondering why AI works for some teams and stalls for others, this episode has your answer. Spoiler: it's not about going bigger. It's about getting ruthlessly specific. The "we're all in on AI" era is over. The "we know where it fits" era just began. If you like the show, be sure to leave us a review or share it on your platform of choice.

AI without the committee: Most manufacturers are still holding meetings about AI. Bill Krolicki just built it. As CFO of Interpak, he didn't wait for a strategy deck or a vendor pilot—he wired Power BI and Power Automate into a self-running operation. His bots read supplier emails, catch late shipments before they blow up production, and update the ERP while everyone else is still asking who owns the spreadsheet. Rob Collie and Justin Mannhardt sit down with Bill to talk about what happens when finance stops waiting and starts building. From "Vendor Bot" to the soon-to-launch "Budget Bot," it's a front-row look at how AI turns from theory to throughput when a data person is actually in charge—no consultants, no six-month roadmaps, just results. If you've had your fill of AI hype and want to see what it looks like when someone actually ships something, this is your episode. And if you enjoyed it, leave us a review on your favorite podcast platform—it helps other no-BS practitioners find us.