Cyber Data Lake: How CIS Analyzes Billions of Network Traffic Records per Day

Опубликовано 20 июня 2019, 20:08

As network traffic exponentially increased, the Center for Internet Security (CIS) needed a way to cost-effectively scale Albert, its IP traffic-monitoring tool. With over 10 terabytes of data and more than 10 billion logs for daily analysis, its existing on-premises architecture could no longer meet the performance requirements for providing low-latency analytics. Learn how CIS worked jointly with AWS Professional Services to develop an architecture that uses native AWS services, such as Amazon Athena, Amazon S3, Amazon EC2, and AWS Lambda to build a scalable, cost-effective system. This new architecture provides ingestion, enrichment, and access to all of CIS's data in near real time, enabling answers that previously took days, in just a few minutes.