SCD¶

Concepts¶

• Worker Server User Account

c) SCD2

• SCD2 attribute + schema

• sqlalchemy

a) DataType of MySQL: https://dev.mysql.com/doc/refman/8.0/en/data-types.html

b) Datatype mapping when streeaming: https://cloud.google.com/datastream/docs/destination-bigquery#map_data_types

• Create table (Python)

Read: https://docs.sqlalchemy.org/en/20/core/metadata.html#sqlalchemy.schema.Table.create

The overall

• Build Local

• Push to Artifacts

• Deploy New revision of Cloud Run