The consensus in education technology right now is reassuring: measure what matters, optimize your learning management system, track engagement through the right KPIs, and you'll solve retention. Everyone from vendors to district IT directors nods along. It's the sensible lane.
But here's what troubles me. We've become so focused on which metrics "actually matter" that we've stopped asking whether the metrics themselves are the problem. The obvious question is "what should we measure?" The better question is what this obsession with measurable engagement breaks.
Consider what happens when a school decides to optimize for login frequency, course completion rates, or time-on-platform. These are real metrics. They feel concrete. But they're also fundamentally measuring compliance, not learning. We've built elaborate systems to track whether students showed up, not whether they understood anything.
The irony is thick. Schools implement sophisticated LMS platforms partly because they want better data. Then that data becomes the goal. A student who logs in sporadically but thinks deeply gets penalized. A student who clicks through assignments in ten minutes gets rewarded. The system has created perverse incentives that the metrics themselves never anticipated.
This matters more now because engagement tools have become simultaneously more effective and more invasive. SMS reminders work. Push notifications work. Gamification works. The research suggests these things genuinely increase the behaviors we're measuring. So we deploy them. But increased measurement and increased nudging have a joint effect: they shift the entire relationship between student and learning from intrinsic to transactional.
When everything is tracked, quantified, and optimized for engagement, something invisible gets lost. It's not dramatic. It's the kind of thing you don't notice until it's gone: the space for genuine curiosity, the freedom to learn something slowly, the permission to fail without it being logged and flagged.
I'm not arguing against data literacy or smarter measurement. I'm arguing that our current framework assumes more measurement equals better outcomes. Sometimes it does. But sometimes more visibility into engagement metrics actually reduces the conditions under which deep learning happens.
Think about the schools genuinely succeeding. They're not always the ones with the most sophisticated analytics dashboards. Often they're places where teachers know their students, where learning feels like something that matters beyond a grade, and where there's enough slack in the system for exploration. These conditions don't show up well in LMS reports.
The accessibility deadline extensions we're seeing in headlines reflect a similar pattern: we build systems first, then scramble to make them inclusive. But what if we're building the wrong systems to begin with? What if optimizing for measurable engagement in an LMS is like optimizing for clicks on a website when what matters is whether anyone actually reads?
Here's my contrarian take: the next meaningful shift in EdTech won't come from better metrics or smarter LMS dashboards. It'll come from institutions brave enough to leave some learning unmeasured. To accept that not everything important is quantifiable. To recognize that the perfect learning experience might actually look pretty quiet when you're looking at engagement reports.
That's uncomfortable for a industry built on dashboards and data. It should be.