Build your first connector for Amazon MSK Connect | Amazon Web Services

Опубликовано 2 мая 2023, 18:00

Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications. Amazon Managed Streaming for Apache Kafka (MSK) makes it easy to ingest and process streaming data in real time with fully managed Apache Kafka. It eliminate operational overhead, including the provisioning, configuration, and maintenance of highly available Apache Kafka clusters. MSK offers a feature Amazon MSK Connect, which allows you to run fully managed Apache Kafka Connect workloads on AWS. This feature makes it easy to deploy, monitor, and automatically scale connectors that move data between Apache Kafka clusters and external systems such as databases, file systems, and search indices.

This talk will introduce you to MSK Connect and will walk you through the steps for developing and deploying your first connector on MSK Connect. We will walk you through the code of an existing connector and explain the details of the implementation so that you can confidently build your first connector for MSK Connect.

Florian Mair is a Solutions Architect and data streaming expert at AWS. He is a technologist that helps customers in Germany succeed and innovate by solving business challenges using AWS Cloud services. Besides working as a Solutions Architect, Florian is a passionate mountaineer, and has climbed some of the highest mountains across Europe.

Learn more at: go.aws/42cufrD & github.com/awslabs/eventbridge...

Example source code for the code walkthrough: github.com/build-on-aws/buildi...

1. Introduction to MSK Connect (00:00-02:28)
2. Build your MSK connector (02:29-23:37)
3. Configure and deploy your connector on MSK Connect (23:38-27:33)
4. Test your connector (27:34-28:41)

Subscribe:
More AWS videos go.aws/3m5yEMW
More AWS events videos: go.aws/3ZHq4BK

Do you have technical AWS questions?
Ask the community of experts on AWS re:Post: go.aws/3lPaoPb

ABOUT AWS
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers — including the fastest-growing startups, largest enterprises, and leading government agencies — are using AWS to lower costs, become more agile, and innovate faster.

#kafka #streaming #AWS #AmazonWebServices #CloudComputing