TrueBlue: Scaling Job Matching with a Serverless Delta Lake

2 827
16.8
Опубликовано 18 мая 2022, 18:46
When TrueBlue wanted to accurately match blue collar jobs to North American workers, they decided they wanted to build a serverless data processing solution that not only scaled but easy to manage. In this episode Director of Data Science Engineering Carlos Lara dives into how they use the AWS Database Migration Service to extract data, and Amazon EventBridge and Amazon SQS to do time sequenced processing of it. We also explore how they use AWS Step Functions to orchestrate a workflow of Glue jobs to perform continuous upserts into table snapshots for data scientists to consume.

Check out more resources for architecting in the #AWS​​​ cloud:
amzn.to/2ZIbygO​

#AWS #AmazonWebServices #CloudComputing #ThisIsMyArchitecture
автотехномузыкадетское