Do not treat metric gathering as entertainment. It's not there for you to be like, 'Oh, that's interesting, how novel,' and then not act on it. So real news is information that changes what you do in the real world.
Metrics without action are entertainment
Growth → Experimentation & Metrics
Real news is information that changes what you do in the real world. And if you don't change what you're doing, what you are doing is just getting entertainment.
"This" refers to insights derived from data measurements - understanding the "why" behind user behaviors rather than just observing what happened.
The insight will provide value when you have this, why answered? Why is this person doing this thing? Here's why. And then you are going to act differently.
"Eval" refers to evaluation frameworks used to systematically test and measure AI model performance across different metrics and user segments.
The goal of eval is to guide the product development. So you see eval, because I think I'm a big fan of eval, is that it helps you uncover opportunities where the progress are doing well.
More from Crystal Widjaja:
Also in Experimentation & Metrics: