Scheduling dbt jobs with serverless

Опубликовано 15 января 2021, 0:00

Scheduling serverless dbt and BigQuery service blog post → goo.gle/39ApWw2

Looking for a way to easily transform data from BigQuery? In this episode of Serverless Toolbox Extended, we show you how to transform BigQuery datasets into easy-to-read dashboards via a data build tool (dbt). Moreover, we’ll show you how to use Cloud Build, Cloud Run, and Cloud Scheduler to build a dbt container image, eliminate server maintenance, and automatically trigger run times for dbt commands. Watch to learn how you can use serverless to run a dbt command and transform your datasets in BigQuery!

Timestamps:
0:00 - Overview
1:03 - Running dbt with BigQuery
3:08 - Creating runtimes for dbt with Cloud Run
4:00 - Running a shell script in Cloud Run
5:00 - Containerizing code with Cloud Build
5:19 - Deploy container to Cloud Run
7:04 - Setting up Cloud Schedule to automatically run your dbt
10:00 - Summary

Checkout more episodes of Serverless Expeditions → goo.gle/ServerlessExpeditions
Subscribe to get all the episodes as they come out → goo.gle/GCP

#ServerlessExpeditions #ServerlessExpeditionsExtended

Product: Cloud Build, Cloud Run, Cloud Scheduler; fullname: Martin Omander, Mete Atamel;