Troubleshoot Slow or Stuck Jobs in Google Cloud Dataflow

659
18.3
Published on 4 Oct 2022, 19:58
Are you experiencing slowness with your jobs or your jobs getting stuck in Cloud Dataflow ?

Slow/Stuck Dataflow jobs can be caused by a number of factors, but they can be investigated and solved with a handful of steps! Check out this video to learn the common reasons for Dataflow jobs getting slow or stuck along with steps to troubleshoot and resolve them.

Chapters:
0:00 - Intro
0:20 - How to identify if Dataflow job is slow or stuck
0:45 - How to use Cloud Logging for troubleshooting slow/stuck jobs
1:15 - Troubleshoot and resolve slow/stuck jobs due to workers taking long processing time
1:50 - Troubleshoot and resolve slow/stuck jobs if processing is stuck in Write Files
2:22 - Troubleshoot and resolve slow/stuck jobs due to hot key issues
3:40 - Troubleshoot and resolve slow/stuck jobs caused due to OOM errors
5:28- Troubleshooting Guide

Troubleshoot common Dataflow errors → goo.gle/3RmysCu

Subscribe to Google Cloud Tech → goo.gle/GoogleCloudTech
autotechmusickids