Dataproc Persistent History Server: Up & Running

1 822
30.4
Опубликовано 2 марта 2023, 23:04
The challenge with ephemeral clusters and Dataproc Serverless for Spark is that you will lose the application logs when the cluster machines are deleted after the job. Persistent History Server (PHS) enables access to the completed Hadoop and Spark application details for the jobs executed on different ephemeral clusters or serverless Spark. It can list running and completed applications. These are important for troubleshooting and exploring.

Check out this video to understand more about Persistent History Server!

Persistent History Server Best Practices and Code Snippets → goo.gle/3mjVkZL
Dataproc Persistent History Server Documentation → goo.gle/3JakmUg
Run faster and more cost-effective Dataproc jobs → goo.gle/3IHAye5

Subscribe to Google Cloud Tech → goo.gle/GoogleCloudTech
Свежие видео
10 дней – 1 428 1530:18
Android x Wicked: Wickedly Open to Elphaba
16 дней – 1 322 5120:55
Wireless Noise Cancelling Earbuds for $90
20 дней – 4 966 56120:29
I Tried Real Augmented Reality Glasses!
20 дней – 88 0926:26
I'm giving away 14 years of drawings
23 дня – 261 1995:08
Running Windows…On Your iPhone?
автотехномузыкадетское