How Twitter Is Migrating 300 PB of Hadoop Data to GCP (Cloud Next '19)

Опубликовано 12 апреля 2019, 17:52

Twitter has been migrating their complex Hadoop workload to Google Cloud. In this session, we deep dive into how Twitter's components use Cloud Storage Connector and describe our initial usage, features we implemented, and how Google helped us build those features in open source. We describe how Cloud Storage fits into our ecosystems and the experience and features which have helped us. We'll also talk about unique challenges we discovered in data management at scale.

Migrating Hadoop to GCP → bit.ly/2KbS1Ap

Watch more:
Next '19 Storage Sessions here → bit.ly/Next19Storage
Next ‘19 All Sessions playlist → bit.ly/Next19AllSessions

Subscribe to the GCP Channel → bit.ly/GCloudPlatform


Moderator: Sameer Farooqui
Panelists: Vrushali Channapattan, Joep Rottinghuis, Lohit VijayaRenu

Session ID: STO201
product: Cloud - General; fullname: Vrushali Channapattan, Joep Rottinghuis, Lohit VijayaRenu; event: Google Cloud Next 2019;