Practical learnings from running thousands of Flink jobs | Amazon Web Services

Опубликовано 21 октября 2022, 19:23

Task Managers constantly running out of memory? Flink job keeps restarting from cryptic Akka exceptions? Flink job running but doesn’t seem to be processing any records? We share practical learnings from running thousands of Flink Jobs for different use-cases and take a look at common challenges they have experienced such as out-of-memory errors, timeouts and job stability. We will cover memory tuning, S3 and Akka configurations to address common pitfalls and the approaches that we take on automating health monitoring and management of Flink jobs at scale.

• RocksDB Tuning: bit.ly/3MP42IF
• Troubleshooting RocksDB Write Stalls: bit.ly/3MU0JzH
- Kinesis Data Analytics for Apache Flink: go.aws/3eRrJmZ

Subscribe:
More AWS videos - bit.ly/2O3zS75
More AWS events videos - bit.ly/316g9t4

ABOUT AWS
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers — including the fastest-growing startups, largest enterprises, and leading government agencies — are using AWS to lower costs, become more agile, and innovate faster.

#Flink #AsyncSink #KinesisDataAnalytics #AWS #AmazonWebServices #CloudComputing