Contra - A professional network for the jobs and skills of the futureCustomer-Facing AI Analytics Chat with Snowflake and dbt
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Title: Customer-Facing AI Analytics Chat on Snowflake
# Problem 20K+ business customers wanted answers about their own business without building dashboards or waiting on support. Pointing an LLM straight at raw tables gave wrong joins, inconsistent metric definitions and numbers that didn’t match the product’s dashboards, so nobody trusted the answers.
# What I did
- Explored options for Semantic layers and integrated dbt Smentic layer to company stack.
- Defined business metrics once in the dbt Semantic Layer, the single source of truth for internal, external analytics (this grew eventually to ~300 metrics)
- Built a chat interface where the LLM picks governed metrics and dimensions from the semantic layer instead of writing free-form SQL.
- Kept it multi-tenant and secure: each customer only ever sees their own data
Built an evaluation framework to measure and protect accuracy:
- A golden set of real customer questions, each with the expected metric, dimensions, filters and answer
- Covers frequent lookups, time comparisons, filtered breakdowns and multi-metric questions
- Automated scoring: correct metric and filter selection, plus result match against the expected answer.
- Separate LLM agents evaluates the answer in predefined criteria and steps.
# Result
- 92% of eval questions answered correctly
- Answers in under 10 seconds
- 300+ governed metrics available in plain English to 20K+ customers
- Same numbers in chat as in the dashboards; new metrics show up in chat as soon as they’re added to dbt.
# Tools:
- Snowflake, dbt Semantic Layer, Kimball dimensional modeling, LLMs, Python
Post image
Back to feed
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started