Platform
Industries
Company
Platform
Industries
Company

Roey Lalazar

Roey Lalazar

|

|

Buy the Infrastructure. Build the Agents.

The biggest mistake I see is companies believing they're in the AI platform business when they're actually in the business they're trying to improve with AI. The build vs buy debate is where that gets expensive. 

The first thing to make clear is that it’s a false dichotomy. Most enterprises will both build and buy. The trick is knowing which layers are worth building and which are worth buying. What I’ve seen is that many enterprises end up building the generic infrastructure every enterprise eventually needs, instead of the agents that are unique to their business.

A team builds an agent on top of the cloud infrastructure they already have. A few months later they want to expose it through another channel, monitor it in production, evaluate it, share capabilities with another agent, or let another team build on top of it. That's usually when they start to understand the difference between an impressive AI MVP and transforming their entire organization.  

Now they need orchestration. Evaluations. Observability. Governance. Model routing. Deployment tooling. Reusable skills. Every capability required to run agents reliably in production. Before long, engineers are maintaining model routing, evaluation infrastructure and provider abstractions. None of that was part of the original business case, but all of it becomes necessary once AI moves into production.

Most of these decisions make sense in isolation. Existing cloud commitments make building feel convenient. Vendor lock-in concerns make it feel safer. Months of engineering investment make it feel difficult to reverse. But then gradually your best engineers stop building the workflows that power your business and start building the infrastructure every enterprise eventually discovers it needs.

Building an enterprise AI platform is a full-time engineering problem. By the time many companies realise the platform itself isn't the transformation, they've already spent months or years building infrastructure instead of deploying agents that create measurable business value at scale.

That's why "build versus buy" isn't a particularly useful way to think about enterprise AI. It combines two different questions into one: what infrastructure should you run on, and what capability should you own?

History - and economics - tell us enterprises should buy the infrastructure and build the agents.


Economies of scale matter

An AI platform isn't something you build once. Every few months there are new models, new modalities, new evaluation techniques, new protocols, new failure modes and new capabilities that business users would want to leverage. The platform has to track the frontier.

For a platform company, spread across hundreds of customers, that investment compounds. Every production deployment, every edge case and every failure makes the platform better for the next customer. Inside a single enterprise, the same work becomes an internal engineering project with no scale effects. It has to compete for budget every year against the business itself. If you believe a platform company can build this well, recreating it internally means committing hundreds of engineers to infrastructure your customers will never see.


Requirements aren't reasons to build

The two arguments I hear most often for building in-house are vendor lock-in and sovereignty. They're both legitimate requirements, but neither means you need to build an AI platform. If portability matters, require open protocols, model independence and the ability to export everything. If sovereignty matters, deploy the platform in your own cloud or on-premise. Those are architecture and procurement decisions. Building years of infrastructure to satisfy requirements that can be written into a contract is an expensive way to solve the problem.


We've seen this movie before

This isn't the first infrastructure decision enterprises have faced. When companies moved from monoliths to microservices, they didn't build their own virtualization engine. They bought VMware, OpenShift or Kubernetes, then used that infrastructure to migrate their applications and build new services on top of it. Instead of trying to reinvent virtualization, they used virtualization infrastructure as a foundation to reinvent the software that was unique to their business.

AI doesn't fundamentally change that equation, but it does obscure it. Coding agents make almost everything feel buildable, which blurs the distinction between can we build this? and should we own this? 

Our engineers use those same coding agents every day. Building the platform is still our full-time job because coding agents don’t give you the experience that comes from running agents in production across hundreds of enterprises. That part still has to be learned the hard way. It takes a lot of field experience, endless iterations, and full time ownership of engineers, product, designers and machine learning folks to make something truly enterprise grade.  


Buying infrastructure is what lets you build the right things

I don't think enterprises should outsource their AI capability. In fact the opposite - your engineers should build and own your agents.

Those agents encode your products, your policies, your customers and your internal processes. That's where your competitive advantage lives. Every month your engineers spend building orchestration, governance, model routing or evaluation infrastructure is another month they aren't building the agents that actually transform the business.

The infrastructure underneath those agents also changes continuously, but for a completely different reason. It changes because the industry keeps moving. That's work that benefits from being shared across hundreds of companies instead of being repeated inside every enterprise.

The value isn't in building an AI platform. The value is in transforming your business with AI.