Glean

The Trillion-Dollar Delusion at the Model Layer Silicon Valley is obsessed with the raw power of foundational neural networks. Yet, a fundamental shift is occurring in how the world's largest organizations view these technologies. The assumption that proprietary giants like OpenAI or Anthropic will naturally dominate every layer of the enterprise software stack is hitting a massive wall of reality. Building a massive neural network is a monumental feat of engineering, but it does not automatically translate into a viable business model at the application layer. Enterprises are not looking for raw, uncalibrated intelligence. They want answers to specific operational problems. This disconnect is creating a massive space for application-focused platforms to build defensible moats. The value is migrating rapidly from the model layer—which is commoditizing faster than anyone predicted—to the orchestration and context layers. This is where proprietary data, system integrations, and enterprise workflows actually live. Why Open Source Models Are Eating the Market The economic reality of running proprietary models is forced to change. The pricing structures of frontier model providers are proving unsustainable for high-volume enterprise workloads. We are seeing a major inflection point. Roughly 90% or more of typical business use cases can now be handled entirely by alternative models, including open-source options. This is a massive shift that is changing how CFOs think about their technology budgets. The initial wave of enterprise AI adoption was driven by excitement, but it quickly ran into severe budget overruns. Companies were setting up annual budgets only to burn through them in a matter of weeks. Open-source models offer a way out of this financial trap. By bringing inference workloads into their own cloud environments or using highly optimized open-source APIs, enterprises are seeing cost reductions of up to 90%. This trend is accelerated by the rapid performance gains of open-source projects, particularly those coming out of international ecosystems. Models like those from Chinese developers are regularly dominating performance benchmarks on platforms like OpenRouter. For businesses, this means the model itself has become a interchangeable utility. The focus has shifted from "which model is smartest?" to "how can we run this task at the lowest possible cost?" The Battle Over Institutional Memory There is a deeper, more strategic reason why enterprises are growing increasingly skeptical of proprietary model providers. It comes down to ownership of institutional memory. When an employee does a job over several years, they build up deep, unwritten knowledge about how an organization actually functions. As we transition to a world where AI agents perform these tasks, that compounding learning will accumulate directly inside the agent itself. If an enterprise relies entirely on a closed, proprietary agent run by a single tech provider, they are effectively outsourcing their core operational intellect. They lose control over the compounding knowledge that makes their business competitive. This is not just a concern about data privacy or training leaks. It is a fundamental question of operational dependency. To maintain control over their destiny, organizations must own the orchestration layer. By using platforms that sit between the raw models and their internal systems, companies can swap models in and out as technology evolves. They keep their proprietary context, system integrations, and agentic learnings entirely within their own corporate boundaries. The Failure of the Microsoft Copilot Bundle Many industry insiders assumed that Microsoft would easily sweep the enterprise AI market by bundling Microsoft Copilot into its existing enterprise agreements. This strategy of selling a "good enough" product bundled with existing software has worked for decades. However, the unique mechanics of generative AI are breaking the classic bundling playbook. Generative AI is inherently a high-compute, consumption-based technology. When software was purely seat-based, a company could bundle a new tool for free and absorb the marginal cost of delivery. With AI, every single query incurs a real, physical cost in GPU compute. This makes it incredibly difficult to offer true "free" bundles at scale without destroying margins. As enterprises transition to consumption-based pricing models, the bundling advantage starts to dissolve. If an organization is paying for the actual compute and value delivered per task, they will naturally gravitate toward best-of-breed solutions rather than a mediocre bundled option. The battleground is shifting back to product quality and actual return on investment. The Core Reason Enterprise AI Spend Feels Broken The current conversation around enterprise AI is dominated by a growing frustration over return on investment. Many executives are asking where the actual productivity gains are. This frustration stems from a fundamental misunderstanding of how to deploy these systems. Most organizations are simply throwing raw models at their databases in a rudimentary fashion, letting the AI brute-force its way through unstructured data. This approach is incredibly slow, highly inaccurate, and absurdly expensive. It burns through millions of tokens just trying to assemble the basic context needed to answer a simple query. To make AI actually perform, businesses have to invest in the infrastructure around the model. This means building semantic search capabilities, managing data permissions, and structuring the raw inputs before they ever hit the LLM. Furthermore, the idea that companies can simply replace their entire workforce with AI is proving to be a dangerous fantasy. AI is excellent at speeding up specific sub-tasks, like writing initial drafts of code or parsing documents. However, it cannot replace the final, critical human decisions that keep a business competitive. The real winners will not be the companies that cut headcount to zero, but those that use AI to supercharge their teams and deliver ten times the output. The Rise of the Generalist Composite Worker As these technologies mature, we will see a dramatic restructuring of corporate roles. The traditional corporate ladder is built on hyper-specialization. We have separate teams for design, engineering, product management, and sales. AI is going to collapse these boundaries, giving rise to the "composite worker." With AI handling the technical heavy lifting, a single creative individual will be able to act as a designer, product manager, and engineer all at once. We will see a shift away from specialized technical roles toward highly capable generalists who know how to orchestrate AI systems to build products end-to-end. Conversely, roles that focus entirely on intermediate data processing, basic analysis, or administrative coordination are highly vulnerable. Simple analyst roles, database configurators, and administrative recruiters will likely be consolidated into broader, highly leveraged positions. The bar for human performance is going up, and the organizations that adapt to this new labor structure first will dominate their markets.