Amazon EMR on EKS - Build Custom Images for Apache Spark on Kubernetes

Опубликовано 24 июня 2021, 19:36

See how to build your own containers images for running Apache Spark jobs on EMR on EKS.

Customers often want to customize their Spark images with EMR on EKS. This functionality allows you to build your own container image based off of the default EMR Spark runtime and run your Spark jobs on Kubernetes with the custom image.

See how to build a custom Dockerfile that installs additional software and run a Spark job that builds a map of air quality data in the continental US using data from OpenAQ ( registry.opendata.aws/openaq ).

Learn more about customizable runtime images for Amazon EMR on Amazon EKS - amzn.to/35K918R.

Subscribe:
More AWS videos - bit.ly/2O3zS75
More AWS events videos - bit.ly/316g9t4

#AWS #AmazonEMR