CIO Influence
CIO Influence News Cloud Networking

Pepperdata Introduces Observability and Optimization for Spark On Kubernetes

Pepperdata Introduces Observability and Optimization for GPUs Running Big Data Apps
Optimize, Observe and Scale Complex Big Data Applications in the Cloud or on Premises

Pepperdata, the leader in big data performance management, announced that the Pepperdata product portfolio now provides autonomous optimization and observability for Spark applications running on Kubernetes.

Kubernetes is a key part of the modern hybrid, multi-cloud architecture in today’s enterprises. Spark is the #1 big data application running on Kubernetes, according to a recent survey of enterprise users. As big data applications move from Spark on legacy systems to Spark on Kubernetes, the performance of these applications can change dramatically.

Recommended ITech News: Docusign, The Global Leader In Document Management, Partnered With Trans Sped One Of The Most Dynamic Digital Transformation Companies In Romania

Pepperdata offers full-stack observability for Spark on Kubernetes, allowing developers to manually tune their applications, while autonomously optimizing resources at run time. The combination of manual and autonomous tuning is necessary to deliver the b********* and performance for these applications. Pepperdata uses machine learning across clusters, containers, pods, nodes, users and workflows to give you a complete understanding of your environment.

Unlike traditional infrastructure monitoring or manual tuning—which are limited in both scaling and speed—Pepperdata will automatically optimize Kubernetes resources while providing a correlated and granular understanding of the applications and infrastructure. Observability provides actionable information to debug and understand complex applications, and autonomous optimization ensures that the compute resources are used efficiently.

Recommended ITech News: Kurt Sievers, President and CEO of NXP Semiconductors, Joins GSA’s Board of Directors

Features include:

  • Autonomous optimization of resources and workloads on Amazon EKS, HPE Ezmeral and Red Hat OpenShift
  • Application and infrastructure observability for Spark on EKS, Ezmeral and OpenShift as well as YARN
  • A self-service dashboard so developers can manually tune using recommendations for speed or resource utilization
  • Detailed usage attribution for chargeback

“Kubernetes is becoming increasingly important for a unified IT infrastructure, both in the cloud and the data center. Spark is the number one big data application moving to the cloud, but Spark applications tend to be quite inefficient. Optimization is key to successful implementations,” said Ash Munshi, CEO, Pepperdata. “We saw this early on with our customers, which is why we invested in the development of Spark on Kubernetes, together with Red Hat, Palantir and Google.”

Recommended ITech News: Viking Enterprise Solutions Introduces New NVMe-over-Fabrics Enterprise Storage Solution

Related posts

Xoriant Establishes Center in Downtown Toronto

CIO Influence News Desk

HP Simplifies Managed Print Services With New Cloud-based Subscription Plan For Hybrid Work Environments

CIO Influence News Desk

dotData Announces Automated Feature Engineering On The Databricks Platform

CIO Influence News Desk