Lenny Distilled

How to measure AI developer productivity in 2025

October 19, 2025

Featuring: Nicole Forsgren (Senior Director of Developer Intelligence, Google)

12 quotes · 9 insights

Watch Full Episode

Problem documentation beats solution brainstorming

What are the biggest barriers to your productivity, or what are the biggest challenges to getting work done? Let them pick three, just three. Of those three, how often does this affect you? Is this hourly? Is this daily? Is this weekly? Is this quarterly?
Nicole ForsgrenSenior Director of Developer Intelligence, Google 00:53:10

Deep work requires protected time, not stolen moments

Now, we can also make a 45-minute work block useful because getting into the flow is actually kind of handed off, at least, in part to the machine or the machine can help us get back into the flow by reminding us of context and generating diagrams of the system.
Nicole ForsgrenSenior Director of Developer Intelligence, Google 00:00:45

AI changes work patterns, not just outputs

Now, we can also make a 45-minute work block useful because getting into the flow is actually kind of handed off, at least, in part to the machine or the machine can help us get back into the flow by reminding us of context and generating diagrams of the system.
Nicole ForsgrenSenior Director of Developer Intelligence, Google 00:00:45

Tailor your message to each executive's concerns

We don't want to make them work to understand what it is that we're doing and the value that we provide.
Nicole ForsgrenSenior Director of Developer Intelligence, Google 00:50:18

Strategy without execution is worthless; execution without strategy is waste

We can ship trash faster every single day. We need strategy and really smart decisions to know what to ship.
Nicole ForsgrenSenior Director of Developer Intelligence, Google 00:00:18
Most teams can move faster. But faster for what? We can ship trash faster every single day. We need strategy and really smart decisions to know what to ship.
Nicole ForsgrenSenior Director of Developer Intelligence, Google 00:00:18

Teach AI like junior engineers, not magic tools

"That" refers to the DORA framework's four key metrics mentioned earlier. "Pipeline" refers to software development and deployment pipelines.

We can't just use that blindly now when we're using AI, as an example, because we have feedback loops much earlier and not even just at the local build and test phase. We have feedback loops throughout, and even sometimes in the middle of some of the pipeline.
Nicole ForsgrenSenior Director of Developer Intelligence, Google 00:15:01
We can't just put in a command and guess something back and accept it. We really need to evaluate it. Are we seeing hallucinations? What's the reliability? Does it meet the style that we would typically write?
Nicole ForsgrenSenior Director of Developer Intelligence, Google 00:00:32

Remove blockers, don't add process

Sometimes all you have to do is change a process. They changed it so that instead of... I think someone had to print it out and walk it down three or four flights, and they get approval. And then someone else had to walk it back up, and so it was just that interim. They didn't replat anything. They didn't redesign anything major. They just sent an email.
Nicole ForsgrenSenior Director of Developer Intelligence, Google 00:23:46

AI breaks traditional productivity metrics

Most productivity metrics are a lie. If the goal is more lines of code, I can prompt something to write the longest piece of code ever. It's just too easy to gain that system.
Nicole ForsgrenSenior Director of Developer Intelligence, Google 00:00:03

Speed matters, but only when you know what to build

We can ship trash faster every single day. We need strategy and really smart decisions to know what to ship.
Nicole ForsgrenSenior Director of Developer Intelligence, Google 00:00:18
Most teams can move faster. But faster for what? We can ship trash faster every single day. We need strategy and really smart decisions to know what to ship.
Nicole ForsgrenSenior Director of Developer Intelligence, Google 00:00:18

The Missing Stamp

Every episode of Lenny's Podcast, distilled into the insights that matter and the quotes that make them stick.

LENNY WAS HERE__STAMP_DATE__

Lenny, if you're reading this, the stamp's ready when you are. 🧡🔥