From prompt to PR: sandbox-validated dbt changes before human review
Careem's AI agent writes and validates dbt models end to end before a human ever reviews the PR.
Overview
A five-person data warehouse team managing 100+ concurrent requests and 5,000+ active ETLs moved beyond "let Claude generate SQL, have engineers review it." Implements a four-layer validation architecture (SQL compilation, dbt tests, Airflow orchestration, OpenMetadata lineage) that must pass before human review; 45% of new models now carry an "ai-generated" tag.
What you'll take away
- 01
Confidence in AI-generated code comes from end-to-end validation, not the code generator — Careem's agent compiles, tests, and materializes every change in a sandbox before a human reviews it.
- 02
A spec-locking step makes the agent ask clarifying questions about grain, metric definitions, and filters upfront, closing off a common failure mode where "revenue" could silently mean three different things.
- 03
The results: metric delivery time dropped from two-to-three weeks to hours, about 90% of new models now come from this framework, and severity incidents have fallen close to zero.
Session speakers
Niyazulla Khan Pathan
CareemAkash Srivastava
Careem