AI dramatically shifts productivity baselines

We find engineering teams that are very, very AI forward are reporting about eight to 10 hours saved per week. Whenever I hear a stat like this, I think an important element is this is the worst it will ever be. This is now the baseline. The truth is the value is changing every day, so you need to ride that wave along with it.

The non-technical people using AI agents and programming tools to build things is really what's been surprising and really amazing. The people that are able to embrace it to optimize for their particular work day and their particular set of tasks are really who are showing the most impact from these tools.

"This" refers to the error analysis process for AI product evaluation that Shreya described earlier in the conversation.

Usually, I'll spend three to four days really working with whoever to do initial rounds of error analysis. This is one-time cost. Once I figured out how to integrate that in unit tests, or I have a script that automatically runs it on samples, I would say maybe 30 minutes a week after that.