Optimize Spark Performance on Kubernetes–Best Practices - ERP Spain.com - España y América Latina

Running Spark on Kubernetes is growing in popularity. Reasons include the improved isolation and resource sharing of concurrent Spark applications on Kubernetes, as well as the benefit to use a homogeneous and cloud-native infrastructure for the entire stack. But running Spark on Kubernetes in a stable, performant, cost-efficient and secure manner also presents specific challenges. In this webinar, Alex Pierce will talk about best practices for optimizing Spark performance on Kubernetes. Topics include: – Making Spark-on-k8s reliable at scale – Core concepts and setup of Spark on Kubernetes – Configuration tips for performance and efficient resource sharing – Spark-app level dynamic allocation and cluster level autoscaling – Monitoring and security best practices