Troubleshoot throttled jobs in Google Cloud Dataproc

Опубликовано 14 декабря 2022, 17:55

Is your Cloud Dataproc job stuck in RUNNING state and not doing anything? Would you like to troubleshoot and resolve such issues with your job?

Check out this video to learn the concepts like what is a Dataproc job, how to submit the job and life of a Dataproc job. Watch this video for a live demonstration of how to troubleshoot and resolve a throttled job and taking a long time to complete due to low concurrent jobs being allowed to run at a time using different troubleshooting tools - Cloud Logging and Cloud Monitoring. This video will also cover other possible causes for job throttling.

Chapters
0:00 - Intro
0:12 - What is a Dataproc job?
0:53 - Life of a Dataproc job
1:57 - Troubleshoot Dataproc job taking long time to complete
3:18 - Cause: Job Throttling due to low max concurrent jobs
4:19 - Solution for Job Throttling due to low max concurrent jobs
5:08 - Other Causes for Job Throttling

Life of a Dataproc job → goo.gle/3VWelhV

Troubleshoot job delays → goo.gle/3W0aFvx

Subscribe to Google Cloud Tech → goo.gle/GoogleCloudTech​