TODO¶

• CICD:

• Build back the hooks for notification

  • Create notification into email with verify check. Sample at: https://www.michaelwhitaker.com/posts/2020-09-25-dbt-github-action/

  • Create class to handle artifact https://docs.getdbt.com/reference/artifacts/catalog-json

• Using https://cloud.google.com/bigquery/docs/reference/standard-sql/query-syntax#recursive_keyword

• Speed up the developers process with instructions and examples.

• Using Composer for the oscheschation tool.

• Build docs with GCS and expose to domain innotech.vn only. Can this intergrate with internal docs?

• Returned the schema manifest into system

• Enforce pre-commit

• Enforce SQL style by SQL stuff to check rules https://docs.sqlfluff.com/en/stable/realworld.html

• https://docs.getdbt.com/blog/enforcing-rules-pre-commit-dbt

• Using: https://github.com/dbt-checkpoint/dbt-checkpoint

• Lock down the maximum bytes for selected rules

• Added the freshness validate

• Build testing component

• Using Slim CI models on testing and production check levels

• Runtime Error maybe crash the process. Required test case on the target output

• Slim CI docs following this document at https://www.vantage-ai.com/blog/how-to-use-slim-ci-with-dbt-core