Prudential Financial: Delivering Data Velocity at Scale with AWS Glue and AWS Step Functions

Опубликовано 23 июля 2024, 17:04

Prudential Financial has built a low-touch, integrated data platform with a range of capabilities that service a large community of technical & non-technical users. Services that have simplified usage, lowered the cost of development & achieved lower time-to-value include: Fast and easy data discovery & automated governance, Zero-code data availability services for data in minutes, Near real-time provisioning service for secure access to data, Zero-code unassisted lake house pipelines, Zero-code automatic change data detection & management, Zero-code self-managed lake house ecosystem, Low code & flexible curation environments for data lakes & warehouses. The enterprise data platform is built with loosely coupled AWS services as the backend & user-experience portal as the front door. The architecture uses an order manifest to guide domain experts on automated ingestion or sources, desired outputs, and refresh intervals. The architecture is orchestrated by AWS Step Functions, deploying resources at the tenant level to support both data warehouse and data lake architectures in Amazon Redshift and Amazon S3, facilitating both AI/ML and Business Intelligence (BI) use cases. AWS Lake Formation is used to ensure governance standards across the whole architecture.

Check out more resources for architecting in the #AWS​​​ cloud:
amzn.to/2ZIbygO

#AWS #AmazonWebServices #CloudComputing #ThisIsMyArchitecture #DataGovernance #GenAI