The consensus is comfortable and boring: AI is too expensive, so startups are pivoting to efficiency. Glean crosses $300M in revenue partly by selling cost reduction. Everyone nods. Smart business.
But here's the better question: What does an entire market organized around "making AI cheaper" actually break?
Start with the obvious. When every vendor in a space competes on trimming costs, you get a race to the bottom that commoditizes everything above the infrastructure layer. That's not innovation. That's a death march where margins collapse and only the largest players with scale survive. We've seen this movie before.
But the real damage runs deeper.
An AI market built on cost-cutting as the primary value proposition assumes that the core problem is overprovisioning and waste. Maybe it is. But what if the actual constraint isn't money? What if it's accuracy, interpretability, alignment, or something we haven't named yet?
When capital and talent flow toward incremental efficiency gains, they stop flowing toward fundamental rethinking. You get better spreadsheet tools. You don't get new kinds of reasoning systems. You optimize the thing that exists rather than question whether the thing should exist in that form.
This matters because we're in a window where the underlying architectures are still somewhat malleable. The decisions companies make now about what to build for cost efficiency will calcify into the foundation of the next decade. If that foundation is "squeeze more tokens per dollar," we've made a collective bet on a particular direction.
Look at recent trends in the broader tech ecosystem. Blue Origin's New Glenn testing failure got headlines for the explosion. But the actual story was about the limits of iteration when you're already committed to a specific design path. Changing course is expensive. Continuing forward is expensive too. You're stuck.
Startups aren't in that position yet. They can still pivot. But only if they're asking the right questions. And right now, the market is loudly insisting they ask about efficiency.
There's another angle here about what gets excluded from the conversation entirely. When the industry consensus is that AI is a cost problem, what happens to the companies and researchers asking about whether current approaches are even solving the right problems? They become unfundable. Not wrong, just unfundable. Unglamorous. Off-consensus.
That's how you create systemic blind spots.
The honest version of this column would note that efficiency improvements matter. Customers do care about cost. And there's real entrepreneurial skill in building tools that do more with less compute. I'm not arguing those things are worthless.
But I am arguing that when "cost optimization" becomes the dominant frame for an entire category, it's a sign that the conversation has narrowed. And narrowed conversations in technology tend to produce narrower outcomes.
Here's what I'd actually want to see: startups asking what a post-efficiency market looks like. What comes after everyone has wrung out the waste? What capability becomes the limiting factor when cost is no longer the primary constraint?
Those questions are harder. They're less fundable. And they're not what every investor is asking you about in pitch meetings right now.
Which is probably exactly why they're worth asking.