Lenny Distilled

Behind the product: Duolingo streaks

Featuring: Jackson Shuttleworth (Group PM, Retention Team, Duolingo)

10 quotes · 7 insights

Watch Full Episode

Design for simplicity, not cleverness

The more that we can make the feature easily comprehensible to users, the more retentive it is. We've run a number of experiments to do this.
Jackson ShuttleworthGroup PM, Retention Team, Duolingo 00:33:32

The first version should embarrass you

We really resist the urge to do the big V1. Rather than design the big complex feature for V1, just do the simplest encapsulation of what that feature can be, see if it has legs, and then just add to it iteratively over time.
Jackson ShuttleworthGroup PM, Retention Team, Duolingo 01:10:44

Seven days is the magic retention threshold

Once you get to seven days, loss aversion kicks in, and you retain. Going from a one to a two-day streak, huge jump in retention, two to three day streak, slightly less but still huge and it's up until day seven.
Jackson ShuttleworthGroup PM, Retention Team, Duolingo 00:19:13
Give more flexibility when a user is starting their streak. Eventually, once people get on long streaks, you don't want to give them as much flexibility.
Jackson ShuttleworthGroup PM, Retention Team, Duolingo 00:48:03

Comprehension beats friction reduction

What we realized when we ran this experiment is DAUs moved not one bit. The users that we were capturing were the least engaged users imaginable.
Jackson ShuttleworthGroup PM, Retention Team, Duolingo 00:15:03

Duolingo tested adding an opt-out button to their streak goal feature, where users commit to maintaining daily learning streaks of specific lengths.

It was a huge win to let them do that. The learning here was that this intentionality of saying, no, I want it was where we were getting so much of the engagement from this feature.
Jackson ShuttleworthGroup PM, Retention Team, Duolingo 00:22:58

Test everything, but test the right version

I'd say test everything, we've run in the last four years over 600 experiments on the streaks, so every other day.
Jackson ShuttleworthGroup PM, Retention Team, Duolingo 00:00:30

Meet users where they already behave

We send two notifications related to your core streak each day, the first is a practice reminder, we send it 23 and a half hours after you practice the day before.
Jackson ShuttleworthGroup PM, Retention Team, Duolingo 00:54:56
Because people care about their streak, that notification reminding them, hey, come back and... People see this by and large as a positive notification and not a negative notification.
Jackson ShuttleworthGroup PM, Retention Team, Duolingo 56:53

Users need different things at different lifecycle stages

Give more flexibility when a user is starting their streak. Eventually, once people get on long streaks, you don't want to give them as much flexibility.
Jackson ShuttleworthGroup PM, Retention Team, Duolingo 00:48:03

The Missing Stamp

Every episode of Lenny's Podcast, distilled into the insights that matter and the quotes that make them stick.

LENNY WAS HERE__STAMP_DATE__

Lenny, if you're reading this, the stamp's ready when you are. 🧡🔥