Here's what's happening in education technology right now, and it should concern anyone who cares about actual learning: we're building elaborate measurement systems that make vendors rich while doing almost nothing for students.
The industry loves to talk about "going beyond Kirkpatrick." Measuring learning outcomes! Attribution models! Data dashboards that promise to show us what "actually matters." It sounds rigorous. It sounds scientific. It sounds like progress.
It's mostly theater, and the incentives are completely backwards.
Let me be direct about who benefits from this measurement complexity. Learning and development platforms charge premium rates for sophisticated analytics. Consulting firms sell implementation services. Assessment vendors expand their product lines. Meanwhile, the teachers and instructors actually responsible for student growth are drowning in reporting requirements that consume time better spent on, well, teaching.
The current reward structure punishes simplicity and rewards elaboration.
Consider what happens when a school or organization adopts an advanced learning measurement platform. They're not primarily buying better instruction. They're buying the ability to produce impressive reports for stakeholders. Boards see dashboards. Administrators see metrics. Districts can point to "data-driven decision making." The optics improve immediately. Student outcomes? Those tend to lag behind the reporting timeline by months or years.
Vendors know this. They've optimized their entire business model around it.
This matters because incentive structures drive behavior. When the measurable outcome is "we have comprehensive learning analytics," that's what gets funded and built. When the measurable outcome is "students actually understand mathematical reasoning" or "students approach language problems with genuine fluency," well, those outcomes are harder to capture in a quarterly earnings call.
The recent discourse around learning typologies and cognitive science is genuinely interesting. Understanding how conscious and unconscious mind interact matters. Knowing that students learn in diverse ways matters. But here's the uncomfortable truth: this knowledge becomes most valuable to vendors when it can be operationalized into a new product category. A "learning typology assessment tool." A "cognitive interaction dashboard." Something to sell, measure, and report.
I'm not arguing against measurement itself. Good teachers have always assessed learning. They do it in real time, through conversation, through observation, through work samples. They adjust instruction based on what they observe. This feedback loop is immediate and responsive.
What I'm arguing against is the false equivalence between elaborate measurement infrastructure and actual instructional improvement. They are not the same thing. Sometimes they're inversely related.
The education sector would benefit from asking harder questions about whose interests are served by complexity. When a measurement system requires expensive software, trained analysts, and ongoing support contracts, who gains from that arrangement? Spoiler: it's usually not the student sitting in the classroom.
This isn't an argument for going backward. But it is an argument for honesty about trade-offs. Every hour an educator spends navigating a complex assessment platform is an hour not spent on instruction. Every dollar spent on measurement infrastructure is a dollar not spent on direct support for learning.
The industry would rather not have this conversation. Complexity is profitable. Simplicity is not.
What would actually matter? Investing in the conditions that research consistently shows improve learning: well-trained teachers, manageable class sizes, adequate resources, and the autonomy for educators to actually use their professional judgment. None of that needs a dashboard.
But it also doesn't generate the recurring revenue that measurement platforms do.
Until we realign incentives so that vendors and institutions benefit from simpler, more direct measures of whether students are actually learning, we'll keep watching the measurement industry grow while teaching conditions stagnate. That's not progress. That's just profitable theater wearing a science costume.
The question isn't whether we can measure learning. The question is why we've decided that complex measurement infrastructure is more important than the actual conditions that make learning possible.