The Combination of Wekafs™ and Nvidia® Enables Customers to Accelerate AI/ML Initiatives That Dramatically Accelerate Their Time-to-Value and Time-to-Market
WekaIO™ (Weka), one of the fastest-growing data platforms for artificial intelligence/machine learning (AI/ML), life sciences research, and high-performance computing (HPC), announced the WekaFS™ Limitless Data Platform’s ability to leverage the newly-turbocharged NVIDIA HGX™ AI supercomputing platform to deliver the best performance and throughput required of most-demanding enterprise workloads.
Recommended ITech News: Fibocom Launches FM350 5G Module with Intel and MediaTek to Inspire New 5G Solutions for PC
WekaIO Announces Support of NVIDIA’s Turbocharged HGX™ AI Supercomputing Platform. Read the full story
The NVIDIA HGX platform supports three key technologies: the NVIDIA A100 80GB GPU; NVIDIA NDR 400G InfiniBand networking; and NVIDIA Magnum IO GPUDirect® Storage software.
Weka’s launch-day support of NVIDIA’s next-generation technologies is the result of a close collaborative relationship between the companies and the continued commitment by Weka to provide customers with the latest features needed to best help store, protect, and manage their data.
WekaFS™ recently delivered among the greatest aggregate NVIDIA Magnum IO GPUDirect® Storage throughput numbers of all storage systems tested at Microsoft Research. Tests were run on a system that has WekaFS deployed in conjunction with multiple NVIDIA DGX-2™ servers in a staging environment and allowed engineers to achieve the highest throughput of any storage solution that had been tested to date.i This high-level performance was achieved and verified by running the NVIDIA gdsio utility as a stress test and it showed sustained performance over the duration of the test.
Recommended ITech News: OpenLegacy Fashions a Digital Transformation for Monoprix
“Advanced AI development requires powerful computing, which is why NVIDIA works with innovative solution providers like WekaIO,” said Dion Harris at NVIDIA. “Weka’s support for the NVIDIA HGX reference architecture and NVIDIA Magnum IO ensures customers can quickly deploy world-leading infrastructure for AI and HPC workloads across a growing number of use cases.”
Different stages within AI data pipelines have distinct storage requirements for massive ingest bandwidth, need mixed read/write handling and ultra-low latency, and often result in storage silos for each stage. This means business and IT leaders must reconsider how they architect their storage stacks and make purchasing decisions for these new workloads. Leveraging the upgrades to NVIDIA’s platform, customers are better able to take advantage of significant performance gains with far less overhead, process data faster while minimizing power consumption, and increase AI/ML workloads while achieving improved accuracy.
Using WekaFS in conjunction with the new additions to the NVIDIA HGX AI supercomputing platform provides channel partners with the opportunity to deploy high-performance solutions to a growing number of industries that require fast access to data – whether on premises or in the cloud. Industries we serve that require an HPC storage system that can respond to application demands include manufacturing, life sciences, scientific research, energy exploration and extraction, and financial services.
“NVIDIA is not only a technology partner to Weka but also an investor,” said Liran Zvibel, Co-founder and CEO at WekaIO. “As such, we work closely to ensure that our Limitless Data Platform supports and incorporates the latest improvements from NVIDIA as they become available. We have overcome significant challenges to modern enterprise workloads through our collaborations with leading technology providers like NVIDIA and are looking forward to continuing our fruitful relationship into the future.”
WekaFS is the world’s fastest and most scalable POSIX-compliant parallel file system, designed to transcend the limitations of legacy file systems that leverage local storage, NFS, or block storage, making it ideal for data-intensive AI and high-performance computing (HPC) workloads. WekaFS is a clean-sheet design integrating NVMe-based flash storage for the performance tier with GPU servers, object storage, and ultra-low latency interconnect fabrics into an NVMe-over-Fabrics architecture, creating an extremely high-performance scale-out storage system. WekaFS performance scales linearly as more servers are added to the storage cluster allowing the infrastructure to grow with the increasing demands of the business.
Recommended ITech News: Tuya Smart Showcases New IoT Device Connectivity Capabilities at 2021 Mobile World Congress (MWC)
