Dataproc Persistent History Server: Up & Running

1 817
30.3
Следующее
Популярные
26 дней – 2 6554:02
Gemini for Developers - Vertex AI
Опубликовано 2 марта 2023, 23:04
The challenge with ephemeral clusters and Dataproc Serverless for Spark is that you will lose the application logs when the cluster machines are deleted after the job. Persistent History Server (PHS) enables access to the completed Hadoop and Spark application details for the jobs executed on different ephemeral clusters or serverless Spark. It can list running and completed applications. These are important for troubleshooting and exploring.

Check out this video to understand more about Persistent History Server!

Persistent History Server Best Practices and Code Snippets → goo.gle/3mjVkZL
Dataproc Persistent History Server Documentation → goo.gle/3JakmUg
Run faster and more cost-effective Dataproc jobs → goo.gle/3IHAye5

Subscribe to Google Cloud Tech → goo.gle/GoogleCloudTech
автотехномузыкадетское