CIO Influence
CIO Influence News Cloud Machine Learning

VMware Cloud Foundation Brings Leading AI Models to the Private AI Cloud

VMware Cloud Foundation Brings Leading AI Models to the Private AI Cloud

logo

Nemotron 3, Gemma 4, cotomi, Qwen3.7-Max, and GLM-5.2 Validated to Run on VMware Cloud Foundation

Broadcom Inc. (NASDAQ: AVGO), a global technology leader that designs, develops, and supplies semiconductor and infrastructure software solutions, today announced that leading AI models from providers including Google, NVIDIA, NEC, Alibaba Cloud, and Z.ai, are validated to run on VMware Cloud Foundation (VCF), enabling customers to bring these AI models on-premises and deliver โ€œmodel as a serviceโ€ to their users. As enterprises accelerate the movement of inference workloads to private cloud driven by privacy, security, governance, and AI tokenomics, VCF provides the AI- and Kubernetes-native platform that gives organizations across industries a production-ready path to deploying a wide variety of AI models.

According toย Broadcom’s Private Cloud Outlook 2026, 56% of enterprises are already running or planning to run production AI inferencing on private cloud. VCF is a unified private cloud platform capable of running inference workloads, agentic applications, containerized services, and traditional VMs together, eliminating the operational fragmentation of managing separate stacks.ย Independent benchmark testing under MLPerf Inference v5.1ย standards confirms that VCF delivers performance on par with bare metal, making it the ideal platform of choice for enterprises deploying AI at scale on premises.

โ€œBroadcom is committed to giving enterprises the broadest set of AI models for their on-premises infrastructure, all validated on VCF,โ€ said Chris Wolf, global head of AI and advanced services, VMware Cloud Foundation Division, Broadcom. โ€œWorking with the worldโ€™s leading AI model providers, weโ€™re giving organizations a clear path to data sovereignty and cost-effective AI at scale, with leading models available securely and delivered as a service to their user community through VMware Cloud Foundationโ€™s built-in services.โ€

Leading Models Validated for VMware Cloud Foundation
VCF empowers enterprises to accelerate AI workload deployment at lower costs through an open and extensible ecosystem. Support for mixed compute across AMD, Intel, and NVIDIA frees enterprises to choose their preferred GPU and CPU hardware for their AI workloads. Leveraging vLLM as the default model runtime gives customers the ability to run more than 150 open source models on VCF. Today, Broadcom is announcing the following models have been tested and validated to run on VCF:

  • Nemotron 3: The NVIDIA Nemotron 3 family of open, multimodal models delivers leading accuracy and efficiency to help agents complete tasks faster. Combining hybrid Mamba-Transformer MoE architecture, 1 million context and multi-environment reinforcement learning, Nemotron 3 enables scalable, long-running agentic workflows across enterprise applications.
  • Gemma 4: Google DeepMind’s latest open source, open-weight multimodal model family, purpose-built for developers and the research community for bringing local execution, and enabling enterprises to build and deploy autonomous AI agents.
  • cotomi: NEC’s proprietary AI model optimized for Japanese language, trained on curated, highly reliable datasets. It empowers enterprises by seamlessly combining high-speed processing with a 40% improvement in token efficiency.
  • Qwen 3.7-Max: Alibaba’s Qwen 3.7-Max is a proprietary multimodal model that offers impressive one-million-token context windows, advanced multimodal reasoning, and agentic-era design, giving global enterprises sovereign, on-premises access to one of the world’s most capable AI model families.
  • GLM 5.2: Z.ai (formerly Zhipu AI)’s open source General Language Model enables enterprises to deploy coding and reasoning agents locally for multi-step autonomous workflows with data sovereignty and optimal hardware performance.

Also Read:ย CIO Influence Interview with John Elliott, Cybersecurity Author Fellow at Pluralsight

Partner and Industry Commentary
โ€œVMware Cloud Foundation gives enterprises the secure, governed foundation they need to put Gemma 4 to work across their most demanding workloads,โ€ said Olivier Lacombe, Director of Product Management, Google DeepMind. โ€œBy combining Gemma 4โ€™s multimodal reasoning and agentic capabilities with VCFโ€™s zero-trust security architecture and Model Context Protocol support, enterprises can build and deploy autonomous AI agents entirely within their own infrastructure without compromising on data sovereignty or operational control.โ€

โ€œNECโ€™s cotomi was purpose-built for enterprises that need AI to truly understand the nuances of Japanese language and business context, and VMware Cloud Foundation gives those enterprises the private, secure infrastructure to deploy it at scale. With cotomi running on VMware Cloud Foundation, organizations gain an AI model capable of acting as a secure autonomous agent across their workplace systems โ€” without sensitive data ever leaving their own environment,โ€ said Akio Yamada, Chief AI Officer, NEC Corporation. โ€œFurthermore, NEC offers the NEC Private Infrastructure powered by VMware service, providing customers with a private cloud environment hosted in NEC data centers. We will continue to explore opportunities to further integrate cotomi with VMware Cloud Foundation.โ€

โ€œEnterprise customers need AI inference that respects data sovereignty and regulatory boundaries, particularly in markets where data sovereignty, not just residency, is non-negotiable,โ€ said Craig McLellan, CEO of ThinkOn. โ€œBy deploying advanced, enterprise-grade AI models on VMware Cloud Foundation, ThinkOn delivers a sovereign AI framework that gives organizations complete control over their intellectual property. Customers gain production-ready inference capabilities on private cloud infrastructure, with the governance and compliance controls their industries require.โ€

Catch more CIO Insights:ย How Are CIOs Aligning Technology with Workforce Agility?

[To share your insights with us, please write toย psen@itechseries.comย ]

Related posts

Sitecore Experience Manager Cloud (XM Cloud) Now Available

Appdome Introduces Live Security Update, Adding Real-Time Control to Build-Time Mobile App Defense

PR Newswire

KIOXIA Unveils Next-Gen Memory and SSD Solutions at CES 2024

Business Wire