Lenny Distilled

Marketplace lessons from Uber, Airbnb, Bumble, and more

November 09, 2023

Featuring: Ramesh Johari (Professor, Stanford University)

8 quotes · 5 insights

Watch Full Episode

Learning beats winning when experimenting

Experimentation was never historically in science about winners and losers. Experimentation is always very hypothesis driven. It's about, what are you learning?
Ramesh JohariProfessor, Stanford University 00:43:20
Learning isn't free. When you don't know something, it seems not even a question that you would allocate some of your samples to all options. After the fact you're like, 'Treatment was better. What the heck were we thinking? Why'd we give all those samples to control?'
Ramesh JohariProfessor, Stanford University 58:02

Platform thinking unlocks exponential growth

A marketplace business never starts as a marketplace business, because what we think of as a marketplace business is something which at scale is removing the friction of the two sides finding each other. But when you start, you don't have that scale.
Ramesh JohariProfessor, Stanford University 00:15:05
Maybe we shouldn't talk about the concept of a marketplace founder. Really there's founders. Every founder is a marketplace founder. It'll be a choice they make after they grow as to whether they want to build a platform.
Ramesh JohariProfessor, Stanford University 00:16:58

A/B testing has fundamental limitations

You can't experiment your way out of everything. What people decide to test in a world that has promoted experimentation for everything tends to be more incremental by design.
Ramesh JohariProfessor, Stanford University 41:15

AI amplifies judgment, doesn't replace it

What AI has done for us is it's massively expanded the frontier of things we could think about our problem, hypotheses we could have, maybe things we could test. I really think actually what that does is puts more pressure on the human, not less.
Ramesh JohariProfessor, Stanford University 01:09:35

Data tells you what, not why

Prediction is inherently about correlation. But when we ask people to make decisions, we're asking them to think about causation. The distinction between causation and correlation matters a lot.
Ramesh JohariProfessor, Stanford University 00:34:15
What AI has done for us is it's massively expanded the frontier of things we could think about our problem, hypotheses we could have, maybe things we could test. I really think actually what that does is puts more pressure on the human, not less.
Ramesh JohariProfessor, Stanford University 01:09:35

The Missing Stamp

Every episode of Lenny's Podcast, distilled into the insights that matter and the quotes that make them stick.

LENNY WAS HERE__STAMP_DATE__

Lenny, if you're reading this, the stamp's ready when you are. 🧡🔥