UserLeap & Differentiating Insights (Audio)

Welcome to the 1,747 newly Not Boring people who have joined us since Sunday!If you aren’t subscribed, join 39,474 smart, curious folks by subscribing here:

This week’s Not Boring is brought to you by… UserLeap

Hi friends 👋 ,

Happy Thursday!

Our little Not Boring family is growing — nearly 7,000 of you joined the party in the past month alone. That’s wild. I continue to be amazed that this is my job.

One of my favorite parts of the job is writing Sponsored Deep Dives. (More on how I pick sponsors here). I love getting to tell you about the next big companies before they take off. The first two companies I did Sponsored Deep Dives on — MainStreet and Pipe — announced $60 million and $50 million fundraises this week, respectively.

Today’s sponsor, UserLeap, is already taking off. Public companies like Square, Opendoor, Adobe, and Dropbox use it to collect and categorize real-time customer feedback, and the company has raised $20 million from First Round and Accel.

You’ll be hearing about UserLeap a lot more, and interacting with it to share your insights on your favorite products across the internet. You heard it here first.

As always, I’ll tell you how I’m getting paid: today is a mix of CPM and CPA.

Let’s get to it.

UserLeap & Differentiating Insights

Acting On Continuous Research 

If you’ve made it to the bottom of these essays over the past few weeks, you’ve probably noticed something new: 

That’s a microsurvey I set up in five minutes working with today’s sponsor, UserLeap. UserLeap, which is backed by Accel and FirstRound, helps product teams continuously discover customer needs and evaluate the user experience via short, highly targeted surveys (microsurveys) displayed contextually within the product. 

The magic of UserLeap is that it quantifies qualitative feedback by collecting rich, written responses, in real-time, and using machine learning to analyze and categorize the responses to pull out themes. 

An example would help, and I’m an open book, so I’ll share what you’ve told me: 

I’m proud that 92% of responses are good and above, and it’s awesome to see that people generally love these Sponsored Deep Dives, but the point of continuous research is to adjust and improve in real-time. To whit, the most common negative feedback is that sponsored posts, “Feel like ads with no analysis.” Ouch. 

That’s only four people out of the 631 responses you’ve left, but UserLeap recommends that I take action, so let’s do it. This is going to be a meta-post: I’m using today’s sponsor’s product to make my Sponsored Deep Dives even better. I’m taking your input to heart and beefing up the analysis in this one. UserLeap’s working already. 

To that end, today, we’re going to cover: 

* The Need for Speed

* The Modern PM Tech Stack vs. User Research Tools

* Meet UserLeap

* Building Moats in a Competitive Market

* UserLeap’s Vision: The Two KPIs

UserLeap is free for up to 10,000 monthly tracked users (more on why later), and if you or your company builds something online, you should go sign up for it now: 

The Need for Speed

UserLeap founder and CEO Ryan Glasgow joined his first startup as founding PM in college. The company, ExtraBux, was acquired by eBates in 2010, but that’s not the important part of the story. The important part is that to build a relatively straightforward company, Ryan and team had to set up their own servers, build out their own infrastructure, and run their own PHP. 

That was a familiar experience for anyone starting a company a decade ago, or even five years ago. It will always be difficult to start, run, and grow a company, but just a few years ago, it was hard to just start one. Today, starting a company is much, much easier, because many of the startups launched over the past couple of decades were built specifically to make starting and scaling a company easier. Just last night, Lattice CEO and UserLeap investor Jack Altman tweeted:

This is an ever-present theme in Not Boring, so excuse me while I do the Ben Thompson self-referential thing for a minute. 

Just this Monday, Ben Rollert and I wrote about a wave of no-code and low-code startups Inspired by Excel that “aim to create powerful general purpose, highly flexible software targeted at a broad audience, including non-technical users.” With the rise of Inspired by Excel products, the universe of people who can create software products ballooned from the 25 million or so software developers in the world to everyone with a computer. 

Two weeks ago, in Power to the Person, I wrote about the idea that, “Thanks to new tools and technologies, we are nearing the point at which the costs of carrying out a transaction through the market are getting so low that firms are less necessary.” More powerful tools mean that one person is able to build a bigger business than multi-thousand-person companies could a few decades ago. One of the reasons for that is the explosion of API-first companies, about which I wrote:

When a company chooses to plug in a third-party API, it’s essentially deciding to hire that entire company to handle a whole function within its business. Imagine copying in some code and getting the Collison brothers to run your Finance team.

These developments are incredibly exciting. AWS, Google Cloud, Netlify, Stripe, and hundreds of other products mean that people and companies are able to focus on doing the things that they do best without having to worry about all of the slow and painful work of setting up servers, building their own authentication and security from scratch, figuring out how to accept payments, or doing many of the things that each individual startup had to do just to get off the ground not so long ago. 

As a result, the cost of starting a startup has come down dramatically over the past few decades, and particularly over this past one. More entrepreneurship is a great thing for the world, but it also presents a challenge, which I summarized in Shopify and the Hard Thing About Easy Things: 

Here’s the hard thing about easy things: if everyone can do something, there’s no advantage to doing it, but you still have to do it anyway just to keep up. 

The lower something’s cost, the more demand for it. As building products and starting companies got cheaper, more and more people started doing it. As fewer and fewer company hours and resources went towards setting up servers and infrastructure, more and more time has gone towards iterating on the product itself. 

Taken together, building something good enough has gotten easier, everything has gotten a lot faster, but standing out from all the noise is harder than ever.

The question, then, is no longer, “Can we get this product to market?” but “Can we create a product that customers love?” 

That has huge implications for how startups are built and what they focus on. It’s why CEOs are spending less time coding in dark rooms and more time on Twitter, to lend some of their personal brand to their company. It’s why every company now seems to talk about their “community.” It’s why “10x designers” are suddenly harder to hire than 10x engineers.

This trend isn’t new. It’s been obvious that things have been getting faster and more competitive for a while. That’s why most software that product teams use is fast, easy, and integrated. User research software has not kept up. 

The Modern PM Tech Stack vs. User Research Tools 

Almost daily on Twitter, one Product Manager or another tweets out their tech stack, the set of tools that they use to help build great products. Lenny Rachitsky, who literally writes the book (well, newsletter) on product management, polled his audience in December to see which tools the most PMs rely on (tweet here).

Each one of these tools is easy to set up, fast, and collaborative. Each has a free plan through which users can get a good sense of whether the product will work for their needs. This is what PMs have come to expect. 

For PMs and growth teams that want to better understand their users on a quantitative level, there’s a set of modern tools like Amplitude, Segment, and Hotjar. They’re slightly harder to set up than the products above because they need to integrate with the product or website to track how users behave, but once they’re in, it’s relatively easy for PMs and growth teams to build their own events tracking and dashboards without needing to go back to the engineering team. 

All of these tools remove bottlenecks and let PMs move more quickly to build and iterate on the product without needing to rely on (or take time from) engineers. 

And then there’s user research. 

Certainly, user research software exists. The industry has come to call itself “experience management.” And it’s massive. Qualtrics, the leader, is worth $22 billion. Its founder now owns the Utah Jazz. Medallia has a market cap of $4.4 billion, and SurveyMonkey, which is aimed at SMBs, is worth $2.6 billion. 

But none of these is built for the way that modern software development happens, starting with the sales and onboarding process. Buying and integrating Qualtrics or Medallia takes a long time. I’ve been through the process. It’s frustrating and expensive. A good rule of thumb for whether a company should be disrupted is whether or not it’s easy to find pricing on its website. Go try to find Qualtrics or Medallia’s pricing.

Welcome back. No luck? 

From his time as a PM, Glasgow realized that user research, which was becoming more important as competition increased, still operated on a timeframe that was out of sync with the rest of the business. Software hasn’t worked on quarterly or annual release cycles for a long time -- companies ship changes and improvements to their product and website every minute -- but user research still typically works on a much slower cycle. 

If you’ve worked in a customer facing or user research role, the standard research process might be familiar: quarterly projects, lots of planning and survey design, email surveys with 2-5% response rates, then tons and tons of unstructured responses for the user researcher to sift through and manually tag and categorize, followed by a presentation to the exec or product team, from which a decision may or may not be made, three months after the question was asked.

That process makes sense for big, irreversible projects like rebrands, market expansions, and product extensions, but it’s far too slow for most of the things for which a tech company needs user insights. So companies often just skip structured customer research, and rely on numbers and anecdotes to make product decisions. That’s a problem: companies have modern tools like Amplitude and Segment to tell them what is happening in their product, but only slow, outdated, and complex tools to tell them why.

That’s why Glasgow started UserLeap.

Meet UserLeap

After ExtraBux, Glasgow went on to be the founding PM at four more companies, including Vurb (acquired by Snap) and Weebly (acquired by Square). Over the course of those experiences, he learned three lessons: 

* Customers have crucial insights, but it’s impossible to read their minds.

* Analyzing a lot of open-ended, qualitative data is hard and tedious.

* Customer research tools haven’t kept up with the modern Product Manager tech stack.

Glasgow left Weebly in 2018 to build UserLeap based on those insights. UserLeap flips the traditional user research process on its head, enabling continuous user research, through ongoing microsurveys embedded in the product. 

UserLeap is like Stripe for Research. It’s trivial to plug in, and that ease masks a ton of complexity and power behind the scenes. Here’s how it works: 

* Sign up for a free UserLeap account. 

* Drop in a couple lines of code.

* Anyone on the team can spin up microsurveys, using a library of templates or their own imagination.

* UserLeap is built on an events-based architecture, meaning that surveys are triggered based on things that a user does on the site. 

* Users answer short quantitative or qualitative questions. 

* UserLeap's AI groups similar answers and presents categorized insights, saving hours of manual tagging and sorting in spreadsheets. A human review process ensures high accuracy, while also providing data which allows the AI to become increasingly more accurate.

By making the process fast and easy, UserLeap is trying to answer the question: how can any customer facing employee become a user researcher? 

In one of my favorite pieces written in the last year, Why Figma Wins, Kevin Kwok wrote:

The core insight of Figma is that design is larger than just designers. 

UserLeap’s parallel insight is that user research is larger than just user researchers. In other words, UserLeap is attempting to do for customer research what Looker is doing for business intelligence and Figma is doing for design. By pushing user research tools throughout the organization, companies can glean valuable insights dramatically more quickly. 

So how do you build a product that turns anyone into a user researcher? You make the assumption that those people don’t know how to do user research, and that they’re busy. You make it easy, you make it intuitive, and you make it fast. 

Everything about UserLeap is built for speed, starting with the sales process. 

Instead of top-down sales, UserLeap, like many modern SaaS businesses, takes a product-led growth approach. Its pricing is front and center: free for up to 10k tracked accounts, $124/month for up to 25k, $275/month up to 50k, and $425/month up to 100k. The generous free plan means that customers can start testing the product before ever talking to a salesperson. 

Setup is also incredibly simple. Even a non-technical person can implement microsurveys with no code, and UserLeap integrates easily with products like Segment, with a deep bench of integrations with tools like Amplitude and mParticle on the very near-term roadmap.

One notoriously data-driven company set aside a full Hack Week to install and integrate UserLeap, and finished the whole process in 30 minutes. They canceled the rest of the Hack Week. 

See for yourself: get UserLeap up and running in less time than it takes to read a Not Boring essay. 

Once UserLeap is up and running, it’s trivially easy to start running microsurveys and getting actionable insights. UserLeap is like an API-first company in that it gives you the full powers of a best-in-class user research team with a few lines of code. For example, UserLeap’s library of templates lets non-user researchers start with the thing they’re trying to do, click a couple of buttons, and get a well-designed survey live. 

For example, Superhuman CEO Rahul Vohra famously broke Product-Market Fit (PMF), previously a “you know it when you have it” phenomenon, down to a science. If 40% of your customers would be “very disappointed” if they could no longer use your product, you have PMF. 

Teams spend months agonizing over this question. UserLeap turned it into a template, including tips on who to target and when to use it. 

At Breather, we measured Net Promoter Score (NPS) by paying for a product called Delighted that emailed our users when they finished a reservation to ask how likely they were to recommend Breather to a friend. UserLeap, you guessed it, turned that into a template.

There are templates for most things PMs want to achieve: Gauge Feature Satisfaction, Identify Customer Goals, Improve the Onboarding Experience, Understand Churn, and thirteen more. If a template isn’t there today, chances are UserLeap’s own team of researchers will spin one up for you.  

With UserLeap, you can ask both quantitative questions -- “How likely are you to recommend [product] to a friend or family member?” -- or open-ended, qualitative questions -- “What made you give that rating?” 

If you’ve done any user research before, the thought of continuous open-ended microsurveys at scale probably just made you a little nauseous. Normally, that means having to download responses into a spreadsheet and spending hours tagging and categorizing them. That’s the most magical part of UserLeap: its AI does that for you. 

In my survey, for example, UserLeap pulled out nine positive themes, automatically. 

Clicking into “The research and depth,” you can see that UserLeap was able to group a bunch of related open-ended responses into one, easy-to-understand category. 

It would have taken me hours to do that myself. Frankly, I probably wouldn’t have done it. 

And that’s just for my small response pool. Some of the fastest-growing tech companies in the world (and Lenny) use UserLeap to collect millions of responses from customers.

Khatabook, the fast-growing Indian startup, collects over half a million responses each month via UserLeap, 10-15% of which are open-ended text. Before UserLeap, pulling insights from all of that text would have required hiring teams of people to manually tag and categorize responses, or using word clouds to quickly see the words people mention most and trying to divine what that means. Instead, UserLeap’s AI matches and groups words and concepts that mean the same thing, pulling out real, actionable insights. 

Customers seem to like it. “I fucking love open-ended response analysis,” one UserLeap customer CEO said, “I used to go through my Typeform responses and tag them every morning from 6-8am. This saves me so much time.” 

UserLeap expands the number of people who can do user research and dramatically speeds up the process, which means that companies are doing a lot more user research. That creates a ton of open-ended responses, which would have been a nightmare to deal with, but like a polite dinner guest, UserLeap cleans up after itself. 

UserLeap is the first-to-market and best-funded company in the continuous research space, but it’s not the only one. The way it thinks about competition and moats in a competitive space is instructive for anyone building software products today.

Building Moats in a Competitive Space

UserLeap’s approach to competition is pretty meta. The same macro trends that make now the right time for UserLeap -- software is getting faster, easier to build, and more competitive -- mean that UserLeap itself will face more competition. If you look up “survey” on ProductHunt, there are dozens of small competitors. 

In order to win, UserLeap is relying on the same power it gives its customers: speed. 

No one has ever taken a product-led growth strategy targeted at the middle market and enterprise to user research before. UserLeap is first. They believe that you can’t start downmarket and move upmarket -- you need to start at the top -- but that even in enterprise software, customers expect a consumer-like brand and experience. That’s the approach that’s worked for Figma, Loom, and Airtable. 

The product-led approach relies on a generous free plan. GitHub just announced that it’s giving away its personal product for free, as did Notion. Potential customers can have UserLeap up and running, for free, before they can even get their first sales call with Qualtrics set up. Incumbents can’t compete with that speed. Meanwhile, since UserLeap makes its money upmarket, giving away its basic plan for free means that new entrants targeted at SMBs would have to be willing to bleed money for years in an attempt to win those customers’ business versus UserLeap. 

Product-led growth targeted upmarket requires doing two hard things at once -- making the product fast and smooth, and making it robust enough for enterprises. To that end, UserLeap has raised $20 million from top venture capitalists including Accel, First Round, Elad Gil, and Figma’s Dylan Field in order to build out a robust product. They’ve barely spent money on marketing until now, choosing to focus on getting the infrastructure ready for scale. 

UserLeap is doing a ton of work on scale-level infrastructure. The company’s VP of engineering scaled Uber’s realtime marketplace logistics platform from three to 300 cities around the world. Just this week, an engineer joined from SpaceX. The event-based attribution system that they’ve built, which none of the incumbents offer and would have to start over to build, took a significant amount of time and talent. It’s paying off. In December alone, UserLeap handled more than 10 billion API interactions. 

As more companies use UserLeap, it gets smarter, and its lead extends. It has dozens of neural network models running, and has already logged nearly 10 million responses on top of a strong machine learning structure, with humans in the loop to train the data. Glasgow likens it to a self-driving car:

If you want to win the self-driving race, it’s all about miles driven with the right sensors, collecting the right data. If your neighbor drives the same car as you, it gets to know your neighborhood, where the potholes are, where the stop signs are. Similarly, the words and phrases customers use are similar within industries, so we’re getting smarter at organizing the responses and delivering insights for each industry.

Incumbents, in this analogy, are like GM and Ford. They’ve logged a ton of miles, but without the right structure or sensors in place to collect data, they’re going to struggle to catch up with Tesla. 

As UserLeap gets smarter, its customers do too. What gets measured gets managed. By making it easier to measure and understand customers, Glasgow hopes to expand what companies optimize for. 

UserLeap’s Vision: The Two KPIs

UserLeap’s vision is for a world in which companies have two sets of KPIs: one north star for the business side and one north star for customers. The companies that will win are the ones that best align the two. 

Remember how hard it was to cancel those cleaning startups like Homejoy and Handy? Those companies optimized for a business KPI -- reduce churn -- at the expense of customer happiness. Over time, the latter catches up to the former. Amazon, on the other hand, famously gave up short-term profits for years by focusing relentlessly on giving customers the lowest possible price. That bet has paid off. 

UserLeap believes that by understanding how a customer feels about your product in real-time, and how that changes with each change you make, they can shrink the gap between business goals and customer happiness. To do that, it’s expanding the market of who can become a user researcher, and giving the people responsible for business KPIs the ability to collect customer insights as they iterate and build. By integrating with all the tools your business uses, and embedding directly into the product at the right points in the customer journey, UserLeap can tie customer insights to business results, and prove the causal relationship between the two. 

What happens to the user researcher in this vision? As with designers in companies that use Figma and data scientists in companies that use Looker, user researchers at companies that use UserLeap are freed up to stop spending time sorting through open-ended text responses. They can spend more time on bigger, less reversible decisions that require the full arsenal of skills they bring to bear, like new products, new markets, and brand positioning. 

UserLeap’s vision is one that resonates with me: one in which power shifts from the company to the customer. Competition naturally does that, and that’s the way everything is heading, with or without UserLeap. UserLeap is there to make sure that companies actually know what their customers want so they can better serve them, and in turn, build stronger businesses that stand out in crowded and hypercompetitive markets. 

If your business is built on software and has customers, get started with UserLeap for free.

Know a product manager or user researcher who would love UserLeap?

And of course, I gotta ask… how did you like this week’s Not Boring?

Loved | Great | Good | Meh | Bad

Packy 

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.notboring.co