Building a petabyte scale reporting pipeline on GCP

Опубликовано 15 сентября 2020, 16:25

Waze for Cities Data allows Waze global public sector partners, mostly municipal officials or traffic departments, to access visualized traffic analysis dashboards with connected-citizen data stored in BigQuery. This program enables over 1,200 partners to access a single dashboard view customized query results to implement better planning.

Learn how the PSO team worked with Waze to build a data pipeline on GCP using Cloud Datastore, GAE, and GCS to automate ingesting of partners polygon traffic data from BigQuery dataset. See how the ingested data was fed into a Data Studio dashboard to enable user based views and how we implemented centralized billing along with Stackdriver audit log analyzer to measure partner BigQuery usage.

Speakers: Minhaz Kazi, Michael Wallman, Tommy Hunt

Watch more:
Google Cloud Next ’20: OnAir → goo.gle/next2020

Subscribe to the GCP Channel → goo.gle/GCP

#GoogleCloudNext

DA312
product: BigQuery, Data Studio; fullname: Minhaz Kazi, Michael Wallman;


re_ty: Publish; product: Cloud - General; fullname: Minhaz Kazi; event: Google Cloud Next 2020;