Gemma 4 production stack: Model Armor, ADK Agents, Tracing

Published on 18 Apr 2026, 19:00

GCP credit → goo.gle/handson-ep8-lab1
Lab → goo.gle/guardians

Gemma 4 is deployed. Now we secure it, build an agent on it, and make it observable.

🛡️ Model Armor — scans every prompt and response for jailbreaks, PII, and harmful content via a Load Balancer Service Extension.
🤖 ADK Agent — built with Agent Development Kit, powered by vLLM, deployed to Cloud Run via CI/CD.
📊 Prometheus Sidecar — scrapes vLLM metrics: token throughput, GPU utilization, latency.
🔍 Cloud Trace — OpenTelemetry tracing through the agent, end to end.

Security. Agents. Observability. One stack. 👇

Chapters:
0:00 - Intro
8:25 - Erecting the shield of SecOps: Setup Model Armor
38:37 - Raising the watchtower: Agent pipeline
57:17 - The palantir of performance: Metrics and tracing
1:07:46 - The boss fight
1:12:30 - Wrap up

More resources:
Agent Development Kit (ADK) docs → goo.gle/4uflScr
Model Armor documentation → goo.gle/4mz57Ga
Cloud Trace documentation → goo.gle/4euYyCB

Watch more Hands on AI → youtube.com/watch?v=qCBreTfjFH...
🔔 Subscribe to Google Cloud Tech → goo.gle/GoogleCloudTech

#Gemma4 #ModelArmor

Speakers: Ayo Adedeji, Annie Wang
Products Mentioned: Cloud Run, Cloud Build, Model Armor, Agent Development Kit, Cloud Trace, Gemma 4