Panasas software architect Curtis Anderson co-chairs the MLPerf Storage working group to develop ML storage benchmarks
Panasas , the data engine for innovation, announced its collaboration with MLCommons , the consortium behind MLPerf , to create industry-wide benchmarks for machine learning (ML) storage. Panasas will work with MLCommons to help steer these benchmarks by establishing best practices for measuring ML storage performance and ultimately helping to develop the next generation storage systems for AI/ML.
Latest ITechnology News: Oracle Reinforces Commitment to France by Opening a Second Cloud Region
Panasas builds industry-leading price/performance data storage solutions that drive innovation across a vast range of computing environments. The Panasas ActiveStor portfolio features the all-NVMe ActiveStor Flash system, which enables outstanding small and random file performance and enhanced support for AI/ML projects. All Panasas solutions are powered by the company’s flagship PanFS parallel file system, a reliable and autonomic data engine that orchestrates networked servers into a single file system serving data to clients at up to hundreds of gigabytes per second.
MLCommons, the open and global engineering consortium dedicated to making machine learning better for everyone, promotes widespread ML adoption and democratization through benchmarks, large-scale public datasets, and best practices. Panasas approached MLCommons to discuss the storage challenge in the ETL (extract, transform, and load) process and its impact on the overall performance of the ML pipeline. The discussion was timely, as MLCommons had been in the early stages of forming the MLPerf Storage working group to develop a storage benchmark that evaluates performance for ML workloads including data ingestion, training, and inference phases.
MLCommons invited Panasas to attend the foundational meetings, after which Curtis Anderson, software architect at Panasas, was named co-chair. “The end goal of the MLPerf Storage working group is to create a storage benchmark for the full ML pipeline which is compatible with diverse software frameworks and hardware accelerators,” said David Kanter, founder and executive director of MLCommons. “I’d like to thank Panasas for contributing their extensive storage knowledge, and Curtis specifically for the leadership he is providing as a co-chair of this working group.”
Latest ITechnology News: Uniphore Solutions Now Available as Genesys Premium AppFoundry Application
“It is an honor to be a co-chair of the MLPerf Storage working group, and I look forward to the meaningful progress that this team will accomplish,” said Anderson. “AI/ML practitioners are doing some of the most revolutionary work today, and I am excited to help develop the benchmarks that will enable them to determine the storage systems they need to carry out their projects.”
Panasas builds a portfolio of data solutions that deliver exceptional performance, unlimited scalability, and unparalleled reliability – all at the best total cost of ownership and lowest administrative overhead. The Panasas data engine accelerates AI/ML and high performance applications in manufacturing, life sciences, energy, media, financial services, and government. The company’s flagship PanFS data engine and ActiveStor storage solutions uniquely combine extreme performance, scalability, and security with the reliability and simplicity of a self-managed, self-healing architecture.
Latest ITechnology News: Sternum Joins NXP Marketplace as Its First Real-time IoT Security and Observability Solution
[To share your insights with us, please write to sghosh@martechseries.com]
