Combining Data Build Tool (dbt) with CI\/CD is a great way to automate tests during deployments from development environments to production.<\/p>\n\n\n\n
This approach ensures higher data quality and provides early feedback about potential issues \ud835\udc1b\ud835\udc1e\ud835\udc1f\ud835\udc28\ud835\udc2b\ud835\udc1e end users see the data. There\u2019s nothing more embarrassing than having an end user point out a data mistake that could have been caught earlier.<\/p>\n\n\n\n
By using dbt together with CI\/CD, you can automate tests such as checking whether a column:<\/p>\n\n\n\n
– Contains unique values<\/p>\n\n\n\n
– Only includes specific values (e.g., “yes” or “no”)<\/p>\n\n\n\n
– Maintains referential integrity between columns in different tables<\/p>\n\n\n\n
– Contains data from the previous day<\/p>\n\n\n\n
– And more<\/p>\n\n\n\n
How about you? Do you tackle potential data quality issues proactively, or do your end users serve as your data quality control? (No judgment, we\u2019ve all been there!)<\/p>\n","protected":false},"excerpt":{"rendered":"
Combining Data Build Tool (dbt) with CI\/CD is a great way to automate tests during deployments from development environments to production. This approach ensures higher data quality and provides early feedback about potential issues \ud835\udc1b\ud835\udc1e\ud835\udc1f\ud835\udc28\ud835\udc2b\ud835\udc1e end users see the data. There\u2019s nothing more embarrassing than having an end user point out a data mistake that could have been caught earlier. By…<\/p>\n