As organizations take a closer look at cloud performance and spend, many leaders are asking whether workloads are in the right place. According to a Barclays survey, 86% of CIOs are rethinking their cloud strategy.
When costs rise or performance falls short, it’s natural to wonder whether applications belong somewhere else. But a focus on workload location can obscure the more important question: Were those workloads modernized for the environment they were moved into?
Reframing the conversation reveals that cloud challenges are often not just location problems. In many cases, workloads were never fully modernized, governed, or optimized to deliver the outcomes organizations expected.
The answer isn’t to retreat from the cloud, nor is it to double down on it. The path forward is to build a more intentional hybrid environment that places workloads according to their specific requirements — not assumptions about where they should run.
Also Read: CIO Influence Interview with John Elliott, Cybersecurity Author Fellow at Pluralsight
Modernization matters more than location
More than two-thirds of business leaders are considering repatriating workloads from the cloud. But rather than treating that as evidence the cloud failed, it points to a deeper issue: many workloads were never fully modernized for it in the first place.
Some organizations lifted and shifted applications without redesigning them for the cloud. Others brought on-premises governance models into cloud environments with different users, permissions and management layers. In many cases, organizations focused heavily on the technology itself without fully considering how employees would use it day to day.
Now, the consequences are becoming clearer. Applications that were never optimized for their environments often struggle to gain user adoption, deliver expected performance improvements, or achieve projected cost savings. In fact, 89% of CFOs report rising cloud costs negatively affecting margins.
The problem, then, isn’t simply where workloads are running — it’s whether they were ever modernized and prepared to succeed in that environment. Instead of asking which environment is best overall, leaders should evaluate the unique requirements of each workload and determine which environment best supports them.
One healthcare organization, for example, discovered that latency issues were limiting the effectiveness of an RFID-based patient tracking system. Rather than move everything back to one environment, it adjusted where parts of the workload ran to better support the application.
That’s the kind of decision-making organizations need to apply more broadly. The goal is to place each workload where performance, governance and user needs align most closely.
3 principles for smarter workload placement
Once organizations move beyond the cloud-versus-on-premises debate, the next challenge is determining where workloads can deliver the greatest value. Three principles can guide those decisions.
1. Stop treating the cloud as a destination
One of the biggest mindset shifts organizations need to make is recognizing that the cloud is no longer a separate initiative. It’s part of the enterprise environment.
A useful comparison is e-commerce. Twenty years ago, buying something online was treated as distinct from traditional commerce. Today, it’s a normal part of how business gets done. The cloud has undergone a similar transition, becoming one of many tools used to support enterprise operations.
This mindset shift matters because it moves away from treating the cloud as the default destination or gold standard for modernization. Instead of measuring success by location alone, you can evaluate which environment best supports each workload’s needs, leading to better decisions around performance, governance, cost, and user experience.
2. Put users at the center of modernization
Modernization only creates value if people use what the organization has built. A cloud-based application may be more advanced than the tool it replaces, but if it’s harder to use or doesn’t fit how employees work, adoption suffers.
To avoid this, involve users early in the modernization process. Engage the teams that rely on it, test how it fits into existing workflows and identify where friction shows up in practice. These insights can reveal usability challenges and latency issues that infrastructure metrics alone may miss.
When applications improve the experience and outcomes for the people who depend on them, organizations are more likely to realize the full value of modernization. Otherwise, they risk paying more for tools employees do not fully adopt.
3. Use AI as an accelerator, not a decision-maker
AI is becoming a useful tool for infrastructure management, helping organizations analyze usage patterns and identify opportunities to optimize existing environments. But its recommendations are only as reliable as the data behind them.
I use the phrase “good data in, good data out” to guide AI usage on my teams, remembering that the inverse is equally true: “bad data in, bad data out.” Before relying on AI-driven recommendations, organizations need to make sure the underlying data is accurate, current, and complete.
With a strong data foundation in place, AI can help teams identify patterns that would otherwise be difficult to spot, such as an application driving unexpected costs or experiencing latency issues. But those insights should start the conversation, not end it. Leaders still need to evaluate them against business goals, user needs, and operational realities.
Focus on workload fit
Cloud repatriation is prompting organizations to rethink workload placement and make infrastructure decisions based on business value, not cloud loyalty.
A hybrid mindset starts with recognizing that no single environment is the right fit for every application. By evaluating each workload’s requirements, involving the people who depend on it, and using AI to inform decisions, organizations can make more intentional placement decisions over time.
When organizations focus on outcomes rather than location alone, they make better workload decisions — and get more value from both cloud and on-premises investments.
About The Author Of This Article
Cesar Ceniceros is Director of Azure Cloud Services at SHI International
About SHI International
SHI International provides business teams with the IT solutions and services they need to support organizational growth and employee experience.
Catch more CIO Insights: How Are CIOs Aligning Technology with Workforce Agility?
[To share your insights with us, please write to psen@itechseries.com ]
