Hiflylabs/awesome-dbt
Hiflylabs/awesome-dbt has 1,748 GitHub stars and 194 forks. GitHot measured 0 stars in 24 hours, +2 in 7 days, and +6 in 15 days. Last checked 2026-11-09 19:15 UTC. Last push 2026-11-04.
A curated list of awesome dbt resources
Measured star growth
- in 24h
- 0
- in 7 days
- +2
- in 15 days
- +6
- in 1 month
- Update delayed
Net star changes over overlapping periods, not daily totals. Missing measurements are left blank. Stars measure attention, not software quality.
README.md
OriginalAwesome dbt

A curated list of the best dbt resources: courses and guides, tools and packages, and the community around them. Maintained by Hiflylabs since 2021, with the help of 60+ contributors.
Contributions are welcome! Add your resource at the top of the most specific section (the list is newest-first), as - [Name](https://link) - Description. See the contribution guidelines; a bot checks placement and format on every pull request.
Contents
- Learning
- Development
- AI & LLMs
- Testing & Data Quality
- CI/CD
- Orchestration & Ingestion
- Data Modeling
- Data Governance
- Security & Privacy
- BI & Semantic Layer
- Machine Learning
- Scaling dbt
- dbt Cloud
- Packages
- Adapters
- Sample Projects
- Community
- Contributors
Learning
General material to learn dbt and analytics engineering. Topic-specific guides live in their topic's section.
Courses
Structured courses, free and paid.
- Advanced dbt - Paid Uplimit course on advanced dbt topics.
- Mastering dbt: Beginner to Pro - Paid Udemy course that covers theory, building a dbt project from scratch, and deploying to dbt Cloud.
- Zero to Hero dbt - Complete course covering both theory & practice through real-world Airbnb use-case.
- Data Engineering Zoomcamp - Data engineering course on cutting edge tools including dbt.
- Analytics Engineering with dbt - Paid course offered by Uplimit covering the basics of dbt.
- Refactoring SQL for Modularity - Free dbt Labs course on refactoring legacy SQL into modular dbt models.
- dbt Fundamentals - Official free course by dbt Labs. Excellent for learning the basics of dbt.
- Learn DBT from Scratch - Guides you through a setup paired with Snowflake, with extras.
Tutorials & Cheat Sheets
Hands-on walkthroughs and quick references.
- dbt Jinja Functions Cheat Sheet - Datacoves' cheat sheet covering the Jinja additions in dbt Core.
- The Ultimate Guide to dbt - A comprehensive canvas guide to dbt, from the basics to advanced topics.
- Understanding the scopes of dbt tags - How tags set in
dbt_project.yml, property files and config blocks combine and inherit. - Jinja cheatsheet - Quick reference for the Jinja syntax used in dbt models and macros.
- Tips and Tricks about working with dbt - Tips from community members.
- dbt-tips - Excellent companion to your dbt practice with rich collection of tips.
- dbt for Data Transformation – Hands-on - Hands-on tutorial for building your first project in dbt Cloud.
Best Practices
How to structure, style and maintain a dbt project.
- How we style our dbt projects - Official dbt Labs style guide for models, SQL, YAML and Jinja.
- How we structure our dbt projects - Official dbt Labs guide to organizing staging, intermediate and mart models.
- Best Practices for your dbt Style Guide - Standards for well organized base layer with Airbyte ingestion.
- Clean your warehouse of old and deprecated models - Clean out warehouse models which are not existent in the project.
- GitLab dbt Guide - GitLab Data Team's guide to setting up and working with dbt.
- Your Essential dbt Project Checklist - Checklist on items necessary for a successful dbt project.
Platform Guides
Running dbt well on a specific warehouse or cloud.
- Run dbt on Snowflake and DuckDB with shared Iceberg tables - One dbt project that runs some models on Snowflake and others on DuckDB, both reading and writing the same Iceberg tables through Snowflake's Horizon catalog, with no S3 bucket or IAM setup.
- Best Practices for Leveraging Amazon Redshift and dbt - Best practices for running dbt on Redshift, including performance tuning and dbt code optimizations.
- Accelerating Data Teams with dbt & Snowflake - A dbt & Snowflake workshop on financial data.
- Doing More With Less: Using DBT to load data from AWS S3 to Snowflake via External Tables - An alternative guide to set up your dbt-external-tables workflow.
- Beware of DBT Incremental Updates Against Snowflake External Tables - Things you should be aware of when using external tables with dbt.
- Start Modeling Data - Configuring BigQuery for your dbt project.
- dbt + Materialize: Streaming to a dbt project near you - How to own your real-time transformation workflows like batch-based alternatives.
- Deploying and Running dbt on Azure Container Instances - Demonstration of integration with Azure.
User Stories
How teams use dbt, and what they learned.
- Building an extension framework for dbt - How Monzo built an extension framework for dbt.
- Leveraging DBT as a Data Modeling tool - Reflection on one-year usage of dbt.
- Who's really using dbt? - Behind the community of analytics engineers.
- dbt and the Analytics Engineer — what's the hype about - Behind the upheaval of the analytics engineer profession.
Development
Tools for writing, checking and generating dbt code.
Editors, IDEs & UIs
Editor extensions and local web UIs for working on dbt projects.
- Lunapad - Open-source notebook for running, exploring, and debugging dbt projects with interactive data analysis.
- dbt-ui - A modern web-based user interface for dbt-core projects.
- dbt-Workbench - An open UI for dbt providing model browsing, lineage visualization, run orchestration, documentation, environment management — without vendor lock-in. Designed for local, on‑prem, and air‑gapped deployments.
- dbt-command-center - A local web application that provides a user-friendly interface to monitor and manage dbt runs.
- Turntable VS Code extension - Docs composer and column-level lineage in VS Code.
- dbtpal - A Neovim plugin for dbt model editing.
- dbt Power User - VS Code extension for dbt: model lineage, query preview, autocompletion and documentation.
Linting & Conventions
Linters, formatters and checks that keep a project consistent.
- dbt-doctor - CLI health check and linter for dbt projects (SQL, YAML, Jinja): 190+ custom rules, optional SQLFluff, 0–100 score, GitHub Actions CI, and coding-agent skills.
- dbtective - Rust-powered linter that checks dbt projects and their metadata against best practices.
- dbt-bouncer - Configure and enforce conventions for your dbt project.
- dbt-score - Linter for dbt metadata.
- dbt-checkpoint - Pre-commit hooks that check your dbt project (docs, tests, naming) before changes are committed.
- oliver-twist - Audits the dbt DAG and generates a summary report.
- dbt-project-evaluator - Highlights areas of a dbt project that are misaligned with dbt Labs' best practices.
- sqlfmt - Formats your dbt SQL code so you don't have to.
- SQLFluff - SQL linter that supports dbt and Jinja templating.
- dbt-coverage - Checks dbt docs and tests coverage.
- dbt-meta-testing - Enforce documentation and test coverage on your models.
Code Generation
Scaffold projects and generate models, sources and YAML.
- cookiecutter-dbt - Cookiecutter template for dbt projects.
- dbt-cue - Generate dbt yml files using the CUE language.
- dbt-osmosis - Automated YAML management and a Streamlit workbench to speed up dbt development.
- dbt-invoke - CLI for creating, updating, and deleting dbt property files.
- dbt-codegen - Macros that generate dbt code, and log it to the command line.
- dbt-coves - CLI tool for generating a scaffold for your dbt project.
Developer Utilities
Smaller helpers for day-to-day dbt work.
- backfill - Terminal footer that pays you while dbt runs - one sponsored line on the bottom row during long commands (dbt Core and dbt Cloud CLI), 50% ad revenue share. Open-source Go CLI; never reads your code, queries, or output.
- dbt-ibis - Write your dbt models using Ibis, the portable Python dataframe library.
- fst: flow state tool - A tool to help you stay in flow state while developing dbt models.
- dbt-feature-flags - Feature Flags in dbt models.
- dbt-container-skeleton - All the basics to get a nice containerized dbt development environment.
- dbt-artifacts-parser - Work with
catalog.json,manifest.json,run_results.jsonandsources.jsonas Python objects. - dbtenv - A version manager for dbt.
- Run changed models based on Git status - Handy bash function to run changed models since last commit.
- fzf-dbt - Search dbt models interactively from terminal.
- How we set up our computers for working on dbt projects - Tools and setup tips that improve the dbt development experience.
AI & LLMs
Generative AI for dbt: giving agents access to your project, and LLM-powered tools built on it.
Agents, MCP & Skills
MCP servers, agent skills and harnesses that let coding agents and assistants work with dbt.
- schemagate - Imports dbt semantic models (
semantic_manifest.json) so an MCP server or LangChain retriever gives the LLM only the tables a question needs: about 91% fewer schema tokens on text-to-SQL, #1 on the BIRD Mini-Dev leaderboard. - dbprint - Snapshots each warehouse table's DDL, joins and column values (value lists, null shares, ranges) into files committed to your repo, which coding agents read through an MCP server or a skill instead of querying the warehouse. Reads column lineage from a compiled dbt manifest, so a note on a source column reaches the model columns built from it.
- Dex - Agent skills (Claude Code, Codex) that author dbt models, tests, and MetricFlow semantic models as reviewable diffs, profile source warehouses read-only, and detect schema, grain, and semantic drift. Apache-2.0.
- dlin - Gives coding agents instant dbt lineage: no dbt compile, no Python, no grep. Fast model-level lineage CLI parsing SQL files directly (or a
manifest.json), with experimental column-level lineage too. - Altimate Code - Open-source data engineering harness with 100+ deterministic tools for building, validating, optimizing, and shipping data products — usable from any LLM, across your warehouses. Ranked #1 on ADE-Bench (78%).
- Bonnard - Governed, multi-tenant MCP access to customer data. Turn your dbt models into a secure, per-customer MCP for AI agents.
- dbt-agent-skills - A curated collection of agent skills, built and maintained by dbt Labs, to help AI coding agents work more effectively with dbt.
- dbt-cli-mcp - MCP server that wraps the dbt CLI, so agents can run, test and inspect dbt projects.
- dbt MCP Server - Official dbt Labs MCP server: lets AI agents query the dbt Semantic Layer, discover models and lineage, and run dbt commands.
AI Assistants & Tools
LLM-powered analysts, assistants and generators built on dbt projects.
- Dot - AI data analyst for Slack, Microsoft Teams and the web. Syncs your dbt project (model and column docs, SQL, lineage) to write more accurate SQL, and exports its dashboards back to dbt as exposures.
- Ragstar - AI data analyst that builds a knowledge base from your dbt models and docs and answers questions in a web app or Slack (formerly dbt-llm-tools).
- turboYAML - An AI-powered CLI tool for converting dbt SQL files to YAML using OpenAI.
- datapilot - CLI for Altimate's AI teammate that checks SQL and dbt projects against best practices.
- Entity matching with LLMs in dbt - An experiment in productionizing LLMs: a dbt pipeline that asks a language model whether two product records are the same item.
Testing & Data Quality
Test your models and keep an eye on the data they produce.
Testing
Testing frameworks, packages and guides, from unit tests to data contracts.
- SQL Data Checks - Free browser tool that writes copy-ready SQL for freshness, row count, null rate, duplicate key and job heartbeat checks across 10 dialects.
- grainguard - Static checker that flags SUM, COUNT and AVG computed after joins that can repeat rows (fan outs and chasm traps). Infers the grain of every model from unique tests and the SQL itself, with no warehouse connection, so it runs in CI or pre-commit.
- data-contract-validator - Fails the pull request when a model stops producing what a downstream consumer expects. Reads columns from
catalog.json/manifest.json(falling back to a sqlglot parse of the SQL) and compares them against reverse-ETL destinations such as HubSpot CRM and against FastAPI/Pydantic services, in CI or pre-commit. - Misata - Generate known-answer seed and test data for dbt models: declare the expected aggregates (revenue curves, rates, rollups) and assert your models return them exactly.
- dbt-testgen - Generate dbt tests based on sample data.
- dbt-assertions - Package to assert rows in-line with dbt macros.
- Power up your data quality with grouped checks - How to use grouped checks in dbt-utils to keep your data on track.
- pytest-dbt-core - A pytest plugin for testing your dbt projects.
- Writing Unit Tests for dbt - Test-driven development in dbt with the dbt-unit-testing package.
- dbt-unit-testing - Package which contains macros to support unit testing.
- Environment-dependent Unit Testing in dbt - Guide on how to run unit tests in dbt dynamically.
- dbt-expectations - Great Expectations-style tests as dbt macros. Maintained fork by Metaplane of the original calogica package, which is no longer supported.
- How do you test your data - Suggestions on testing your data powered by the community.
- How to unit test sql transforms in dbt - Unit test using source defer and generic custom tests.
Data Observability
Monitoring, anomaly detection and alerting on the data your models build.
- Upstrace - Column-level drift detection and lineage-based root-cause analysis for dbt projects.
- Aegis DQ - Agentic data quality framework that runs YAML rules against your warehouse (DuckDB, BigQuery, Snowflake, Databricks, Athena, PostgreSQL), then uses LLMs to diagnose failures, trace root causes, and propose SQL fixes. Pairs naturally with dbt models as the validation layer after
dbt run. - Scherlok - Zero-config data quality CLI that complements
dbt testwith auto-detected anomalies (volume, schema drift, freshness, distribution, cardinality) on every materialized model afterdbt run. - DataKitchen Open Source Data Observability - Open source observability and alerting across your data estate, with fast data quality test generation and execution.
- diqu - CLI companion that turns dbt test results into detailed alerts on the platforms your team already uses.
- dq-tools - Store dbt test results and visualize them in a BI dashboard built on 6 data quality KPIs.
- BigQuery Stale data detection - Stale data detection with dbt and BigQuery dataset metadata.
- Elementary - Data observability for dbt: anomaly detection as dbt tests, plus a report of test results and run history.
- Metaplane - Data observability platform on top of your dbt and BI stack.
- Soda - Integration of Soda's data observability platform and dbt.
- re_data - A dbt package for monitoring metrics and detecting anomalies.
CI/CD
Ship changes safely: slim CI, data diffs, deployment patterns and pull request workflows.
- speedrunner - Makes every dbt command start faster by keeping dbt preloaded in a background daemon and forking it per call, with no configuration. Measured:
dbt ls3.9 s to 1.2 s,dbt --help2.7 s to 30 ms, same output as plain dbt. - reladiff - Diff large datasets within or across databases. Maintained continuation of Datafold's data-diff, which is archived.
- dbt-plan -
terraform planfor dbt: diffs compiled SQL between two revisions to predict the DDLdbt runwould emit. Names the columns anon_schema_change: sync_all_columnsmodel will drop, the downstream models and data tests that drop breaks, and enforced-contract violations. Reads files only -- no warehouse connection -- so it runs locally beforedbt runand on fork pull requests, where warehouse-connected checks cannot. - Guide to Running DBT in Production - A complete CI/CD process for a dbt project: defer (slim CI) and unit tests for CI, automatic deployment to lower environments, and Write-Audit-Publish with dbt clone for production.
- DBT CI/CD Demo with BigQuery and GitHub Actions - A demo CI/CD implementation using GitHub Actions, including slim CI and unit tests.
- dbt-ci-cd - Example setup that demonstrates best practices for testing and deploying dbt models.
- dbt-data-diff - Data-diff solution for dbt-ers with Snowflake.
- How to Create CI/CD Pipelines for dbt Core - Implement dbt Cloud's Slim CI job pattern with dbt Core.
- dbt-beyond-the-basics - Showcase of advanced options when running CI for dbt.
- Continuous Integration and Automated Build Testing with dbt Cloud - Detailed walkthrough of setting up Slim CI in dbt Cloud.
- Datafold - Data diffs in CI: see how a change affects the data before it's merged.
- DDO - Perform DataOps & administrative CI/CD on your data warehouse.
- dbt-dry-run - Auto Trader's tool that validates a whole dbt project with BigQuery dry run jobs, catching invalid SQL in seconds without running any models.
- Slim CI/CD with Bitbucket Pipelines - How to set up slim CI on Bitbucket.
- Test SQL Pipelines against Production Clones using DBT and Snowflake - Use Snowflake zero-copy clones to run slim CI checks against production data.
- Performing a blue/green deploy of your dbt project on Snowflake - A tidy, fail-safe way to run dbt in production with two parallel production environments.
- How we speed up our CI runs by 10x using Slim CI - Limit data in long-running CI checks to speed up development.
- How to review an analytics pull request - Checkpoints to consider when reviewing an analytics engineer PR.
- How to set up a dbt data-ops workflow, using dbt cloud and Snowflake - Leverage GitHub Actions to set up CI/CD with dbt Core.
Orchestration & Ingestion
Schedule and run dbt, and load the data it transforms.
- Datanika - Open-source platform that runs dbt-core transformations alongside dlt-powered extract and load, with 36 connectors, cron scheduling, and run history in one web UI. AGPL-3.0, self-hostable with Docker Compose or Helm.
- ModelDock - Hosted dbt-core scheduler. Connect your repo, pick dbt-core and adapter version, set a cron, run dbt-core in isolated Docker containers. No Airflow to manage.
- ingestr - CLI tool to copy data from any source to any destination with a single command. Load data into your warehouse before dbt transforms it. Supports 50+ sources including PostgreSQL, MongoDB, Salesforce, Shopify.
- Bruin - Run and schedule dbt-style SQL transformations without Airflow. Adds data ingestion (50+ sources) and built-in data quality to the transformation layer. Open-source CLI or managed Bruin Cloud for teams who want dbt Cloud-like experience with ingestion included.
- dlt (data load tool) - Open source Python library for loading data into your warehouse, ready for dbt.
- Orchestrate dbt Core jobs with Airflow and Cosmos - Run your dbt Core projects as Apache Airflow DAGs and Task Groups.
- modal-dbt - Run dbt jobs on Modal, a serverless application platform.
- Why I moved my dbt workloads to GitHub and saved over $65,000 - Save by replacing dbt Cloud with GitHub Actions.
- prefect-dbt - Prefect integration for running dbt Core and dbt Cloud jobs from your Prefect flows.
- Run dbt in Azure Data Factory - Primer about dbt on Azure Data Stack.
- Dagster dbt integration - Load dbt models as Dagster assets and orchestrate them alongside the rest of your pipelines.
- Building a Scalable Analytics Architecture with Airflow and dbt - Leveraging the dbt manifest in Airflow.
- Building a robust data pipeline with the dAG stack: dbt, Airflow, Great Expectations - Demonstration of a data orchestration project with Airflow.
Data Modeling
Modeling patterns: Kimball, Data Vault and slowly changing dimensions.
- dbt-scd2-utils - Materializations for SCD Type 0, 1 and 2 tables on Snowflake with shared audit columns, soft-delete handling, a metadata-preserving full refresh and an
scd2_joinmacro for temporal joins. - metadv - Python library for generating models from a declarative YAML configuration. It supports multiple data modeling approaches including Data Vault 2.0, Anchor Modeling, and Dimensional Modeling, with template packages for popular dbt libraries.
- trange_join - Macro to join dbt snapshots.
- How to create Kimball dimensional models with dbt - A step by step guide on how to build Kimball dimensional models with dbt.
- dq-vault - Data Quality Observation of Data Vault layer.
- dbtvault-generator - Generate AutomateDV (formerly dbtvault) files from YAML metadata.
- TurboVault Engine - Generates a complete dbt project of Data Vault models for the datavault4dbt package from source metadata (successor of turbovault4dbt).
- datavault4dbt - Macros for staging and creation of all DataVault-Entities you need, to build your own DataVault2.0 solution.
- AutomateDV - Package for generating and executing ETL for Data Vault 2.0 (formerly dbtvault).
Data Governance
Know what you have and where it comes from.
Lineage
Column-level lineage and impact analysis.
- sqllens - TypeScript SQL parser and static analyzer: type inference, schema diagnostics, and column-level lineage. Reads Jinja-templated SQL (dbt models) natively, without rendering.
- dbt-colibri - Self hostable column-level lineage for dbt core projects.
- dbt-column-lineage - Visualize the column-level lineage of dbt models.
- dbt-column-lineage-extractor - Extract column-level lineage from dbt projects.
- dbt-lineagex - A Column Level Lineage Graph for dbt.
Docs, Diagrams & Catalogs
Documentation sites, ERDs and data catalogs built from dbt metadata.
- dbt Docs on Databricks Apps - Serve the site from
dbt docs generateas a Databricks App, with a small Python server that handles the docs' client-side routing. - quickdbd-cli - Interactive ER diagrams from a dbt
manifest.json(keys and relationships inferred from tests) or QuickDBD/DBML text, readable at 200+ tables, with schema diffs as PR comments and a VS Code extension. - ERD Studio - VS Code extension that puts a visual ERD designer inside your dbt repo. Two-stage (logical/physical) canvas, drift detection against
manifest.json, auto-generatedselectors.yml, and AI-readable semantic models (YAML/JSON) with a built-in harness for Claude, Copilot, Gemini, and Codex. - docbt - Documentation Build Tool - Generate YAML documentation for dbt models with optional AI assistance. Built with Streamlit for an intuitive and familiar web interface.
- metaplane cli - CLI that builds a browsable UI of your latest dbt run from the target folder.
- dbt_to_dbdiagram - Generate an ERD via dbdiagram.io from a dbt project.
- DataHub - Open source data catalog with governance and observability: view models, docs, test results and column-level lineage across dbt projects and downstream dashboards.
- dbt-exposures-crawler - Automate the creation of dbt exposures from different sources.
- Speeding up the dbt™ docs by 20x with React Server Components - A rewrite of dbt docs using Next.js with React Server Components and SSG.
- dbt Docs as a Static Website - How to deploy dbt docs as a static website with App Engine and GitHub Actions.
- dbterd - CLI to generate DBML file from dbt manifest.json.
- Automatically generate ERD - Automatically generate ERDs and display in your docs site.
- dbt-docs-to-notion - A GitHub action for exporting dbt model docs to a Notion database.
- dbt-erdiagram-generator - Generates ERDs from a dbt project.
Security & Privacy
Masking, tagging and anonymizing sensitive data.
- dbt-snow-mask - A dbt package for Snowflake Dynamic Data Masking.
- dbt-privacy - Macros to make it easier to protect your customers' data.
- dbt-tags - Tag-based masking policies management in Snowflake.
BI & Semantic Layer
Metrics, semantic layers and BI tools that build on dbt models.
- Cube - Semantic layer that turns every dbt model into a governed cube with dimensions, measures, joins and descriptions. Re-syncs from CI or on every push by parsing your project, without touching the warehouse.
- MetricFlow - Define metrics in code and generate the SQL to compute them. Powers the dbt Semantic Layer and replaces the deprecated dbt_metrics package.
- dbt_semantic_view - Materialize Snowflake Semantic Views with dbt and reference them from downstream models.
- dal - Build a GraphQL API on top of your dbt project.
- "Semantic-free" is the future of Business Intelligence - How to leverage dbt as a data catalog and semantic layer (joins, synonyms, etc.) that BI tools can just plug into.
- How HomeToGo connected dbt and Superset to make metadata more accessible and reduce analytical overhead - A dbt<>Superset connector that leverages Superset's API capabilities and dbt's manifest.
- looker-gen - Generate LookML from dbt.
- Business Intelligence Standards - Best practices in Business Intelligence standards for integrating with dbt.
- FlexIt Analytics - Business Intelligence platform with deep dbt Cloud and CLI integration.
- Self-service Business Intelligence - Eliminate the need for a data modeling semantic layer in BI.
- dbt-metabase - Model synchronization from dbt to Metabase.
- dbt2looker - Generate Looker views for dbt models.
- dbt-superset-lineage - Push and pull metadata between dbt and Superset.
- Lightdash - Open source Looker alternative with deep dbt integration.
- Superset - Open source visualization layer for your Modern Data Stack.
Machine Learning
Feature engineering, in-warehouse models and ML workflows around dbt.
- dbt-ml-inline-preprocessing - Feature engineering macros (scaling, encoding, imputation) that run inline in your dbt models.
- dbt_linreg - Linear regression in SQL using dbt.
- dbt_ml - Package for dbt that allows users to train, audit and use BigQuery ML models.
- dbt + Machine Learning: What makes a great baton pass? - Landscape of ML utilities around dbt.
- dbt-feature-store - Macros to build a feature store right within your dbt project.
- dbt-ml-preprocessing - A SQL port of scikit-learn's preprocessing module, provided as cross-database dbt macros.
Scaling dbt
Keep large projects fast, cheap and manageable.
Large Projects & Mesh
Repository layout, multi-project setups and dbt Mesh.
- Accelerating and Scaling dbt for the Enterprise - Guide for large scale dbt projects.
- dbt-loom - A dbt-core plugin to weave together multi-project dbt-core deployments.
- dbt Monorepo Workflow - How to get started with a team dbt workflow in a monorepo.
- How to configure your dbt repository - Mono-repo or not mono-repo?
Performance, Monitoring & Cost
Run metadata, warehouse cost and query performance.
- dbt-hodor - Reuses unchanged models and rebuilds only when their code or upstream data changed, cutting run time and warehouse cost. A free, self-hosted alternative to dbt State.
- dbt-query-tags - Automatically tag dbt-issued queries with informative metadata, on multiple warehouses (successor of dbt-snowflake-query-tags).
- dbt_artifacts - Builds a mart of tables from dbt artifacts in your warehouse, to monitor runs, models and tests over time.
- dbt-dag-monitoring - A dbt package for monitoring Airflow DAGs and tasks.
- dbt_otel_export - Takes dbt runs and turns them into OpenTelemetry traces.
- BigQuery Ingestion-Time Partitioning and Partition Copy With dbt - Combining ingestion-time partitioning and partition copy is a great way to achieve better performance for your models.
- snowflake-resource-monitoring - Package by dbt Labs to monitor Snowflake usage.
- usagedata - Database- and table-level usage insights from Snowflake.
- dbt-snowflake-monitoring - A dbt package to help you monitor Snowflake performance and costs.
- Analyzing Fishtown's dbt project performance with artifacts - Using project artifacts to identify anomalies and room for refactoring.
dbt Cloud
API clients, integrations and automation for dbt Cloud.
- dbt-cloud-download-artifacts-action - A GitHub action for downloading dbt artifacts from dbt Cloud CI jobs.
- dbt-streamdeck - Stream Deck plugin that shows the status of dbt Cloud models and jobs.
- dbt_cloud_run_cost - Package to calculate dbt Cloud usage-based cost.
- Discovery API use-cases - Use-cases and examples for the dbt Cloud Discovery API.
- Raycast dbt Metadata - Queries the dbt Cloud API to return some useful information about your models (number of tests, time they took to run etc…).
- GitHub Action: Cancel Running CI Job - Cancels stale dbt Cloud CI runs when new commits arrive, so CI always tests the newest code.
- dbtc - Unofficial Python client for the dbt Cloud APIs.
- Raycast dbt Jobs - Raycast integration to monitor dbt Cloud Jobs.
- Terraform provider for dbt Cloud - Manage dbt Cloud as infrastructure as code, now maintained by dbt Labs.
Packages
General-purpose dbt packages. Packages for a specific topic are listed in that topic's section.
- dbt-unirate - Currency exchange rate macros and models for dbt, powered by the UniRate API.
- dbt_diving - A free to use dbt package with helper macros.
- dbt-incremental-stream - A dbt package for Snowflake Streams.
- dbt-reconfigured - A dbt package containing reconfigured macros.
- dbt-census-utils - A collection of dbt macros for working with Census data.
- dbt_tld - A self-updating dbt library that will maintain a list of current IANA/ICANN recognized top level domains.
- dbt-translate - Translate numbers into words.
- dbt_constraints - Generate database constraints based on the tests in a dbt project.
- dbt-date - Date logic and calendar functionality.
- dbt-fivetran-utils - General macros and helpers.
- dbt-external-tables - Macros to stage your external sources.
- dbt_audit_helper - Macros for data audits that compare columns values and schemas between tables.
- dbt-profiler - Data profiling and doc block generator.
- dbt_utils - General macros library. A must have.
Adapters
Connect dbt to more platforms.
- dbt-fabricspark - A code package from Microsoft for enabling dbt to work with Synapse Spark in Microsoft Fabric.
- dbt-fabricsparknb - Generates Fabric Spark notebooks from dbt, by Insight; a fork of Microsoft's dbt-fabricspark.
- dbt-timescaledb - The TimescaleDB adapter plugin for dbt.
- dbt-fabric - A dbt adapter for working with Microsoft Fabric Data Warehouses.
- dbt-excel - A dbt adapter for working with Excel.
- Supported Adapters - Trusted and community adapters listed by dbt Labs.
Sample Projects
Complete projects to learn from, most of them runnable out of the box.
- dbt-snowflake-template - Production-ready template deploying dbt project to Snowflake using GH Actions.
- Data Build Tool (dbt) Pizza Shop Demo - A series of posts that illustrate data modeling and Airflow integration, targeting multiple data warehouses.
- Make Open Data - A production grade ELT with tests, documentation and CI/CD (GHA) about french open data (housing, demography, geography, etc). Can be used to learn with voluminous and ambiguous data. Contributions are welcome.
- datafold-dbt-ci-advanced - Add 4 more integrations to your dbt CI pipeline: Slim CI, pre-commit hooks, Data Diffs, and Slack notifications.
- NBA_Data_Modeling - Ingest, store, transform and serve insights from the official NBA API.
- dbt-fake - Daily updated fake data for dbt learning and projects.
- awesome-public-dbt-projects - A curated list of awesome public dbt projects.
- mdsinabox - MDS in a box deployed anywhere.
- gee_production_gatekeepers - A demonstration of production gatekeepers in Snowflake and BigQuery.
- mdsfest-opensource-mds - Demo project for open source MDS.
- f1-data-pipeline - F1 Data Pipeline.
- transfermarkt-datasets - E2E dbt project for scraping and transforming football data from Transfermarkt.
- dbt_github_archive_bigquery - A dbt project for GitHub Archive data on BigQuery.
- dbt_workspace - A workspace template for dbt demos.
- Cloud Cost Monitoring - A dbt project to monitor cloud costs.
- dbt on AWS - A series on running dbt across AWS data services.
- Analytics Engineer Survey 2023 - Repo containing data and dbt template of the survey.
- Tracking the Fake GitHub Star Black Market with Dagster, dbt and BigQuery - Explore the topic of fake GitHub stars.
- Data-aware orchestration - Dagster's ability to create a global dependency graph between different dbt projects.
- AWS Athena x dbt - How to build a small and modern data infrastructure.
- GitLab Data Team - GitLab's open source dbt project.
- attribution-playbook - A worked example to demonstrate how to model customer attribution.
- mrr-playbook - A worked example to demonstrate how to model subscription revenue.
- Use dbt inside Visual Studio Code development containers - Set up your dbt environment with pre-installed extensions.
- dag-stack - Demo stack combining dbt, Airflow and Great Expectations.
- Jaffle Shop - Sandbox project from dbt Labs, built around a fictional sandwich shop, for learning and testing.
- airflow-dbt-demo - Demonstration of Airflow integration.
- dbt-github-workflow - Deploy BigQuery + Airflow.
- Spotify User Analytics - Sample dbt project with Spotify user data.
Community
Where analytics engineers meet, read and listen.
Events & Talks
Conferences, meetups and recorded talks.
- dbt Summit - Annual dbt Labs conference (formerly Coalesce), with keynotes and sessions on demand.
- Data Council Austin 2023 - A conference for data teams.
- Data Council Austin 2022 - Worldwide community driven analytics conference with a handful of talks fitting to the dbt stack.
- Coalesce 2021 - Second edition of the analytics engineering conference.
- dbt meetups - List of community led dbt meetups.
- Coalesce 2020 - Annual dbt conference full of fascinating use-cases.
Newsletters & Reports
Newsletters, blogs and industry reports.
- #dbtips - Newsletter about dbt, with tips and tutorials on various topics.
- State of Analytics Engineering 2023 - A survey of pains, gains, and areas of investment for global data teams.
- Metadata Weekly - Weekly substack about metadata, the metrics layer and MDS.
- Analytics Engineer Roundup - Official dbt Labs newsletter on topics of the MDS.
- Benn Stancil's Newsletter - Thought-provoking reads from the founder of Mode.
- Data Engineering Weekly - Weekly newsletter of recent trends in Data Engineering.
Podcasts
Conversations about dbt and the data stack.
- Data Engineering Podcast - One of the most popular data engineering podcasts covering great concepts and new products.
- The Analytics Engineering Podcast - Official podcast of dbt Labs.
- Drill to Detail Podcast - Special guests discussing big data, business intelligence, modern data stack.
Forums & Social
Places to ask questions and follow along.
- dbt Labs TikTok - Official TikTok channel of dbt Labs.
- Locally Optimistic - A Slack community of aspiring analytics leaders discussing and sharing lessons learned and challenges from their experiences in using data.
- DataTalks.Club - Global online community of data enthusiasts. Podcasts and blogs, etc. are distributed with high frequency.
- dbt Community Discussions - GitHub Discussions on the dbt docs repo, the successor of the dbt Discourse forum.
- dbt Slack - Energy-filled hub of analytics engineers (Highly recommended).
- r/dataengineering - Subreddit of data engineering topics.
Contributors
Thanks for all the great resources! Can't see your avatar? Check the contribution guide on how you can submit your resources to the community!
Explore related projects
Asabeneh/30-Days-Of-Python
The 30 Days of Python programming challenge is a step-by-step guide to learn the Python programming language in 30 days. This challenge may take more than 100 days. Follow your own pace. These videos may help too: https://www.youtube.com/channel/UC7PNRuno1rzYPb1xLa4yktw
78,486 starsgrafana/grafana
The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.
77,790 starsredis/redis
For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.
77,332 starsapache/superset
Apache Superset is a Data Visualization and Data Exploration Platform
75,455 stars