Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Satellite v0 isn't updating with new ldts via SYSDATE in Redshift #173

Open
tankim opened this issue May 5, 2024 · 2 comments
Open

Satellite v0 isn't updating with new ldts via SYSDATE in Redshift #173

tankim opened this issue May 5, 2024 · 2 comments
Assignees
Labels

Comments

@tankim
Copy link
Contributor

tankim commented May 5, 2024

Hey all.
I'm realized that satellite v0 isn't updating with new ldts via SYSDATE in Redshift, so while appending rows to satellite v1, it doesn't add new ldts(current system timestamp) as a new row.

Let's say I'm trying to execute dbt run twice at 2024-05-05 00:00:00.000000, 2024-05-05 00:10:00.000000
The result of table that I'm expected at first execution is as below.

# Redshift Table: sat_wallet_v0
hk_wallet hd_wallet ldts ...
1 1 2024-05-05 00:00:00.000000
# Redshift Table: sat_wallet_v1
1 1 2024-05-05 00:00:00.000000

This is the result that I'm expected but it doesn't.
Please check real and expected as below.

# Redshift Table: sat_wallet_v0
hk_wallet hd_wallet ldts ...
1 1 2024-05-05 00:00:00.000000
# Redshift Table: sat_wallet_v1
1 1 2024-05-05 00:00:00.000000
1 1 2024-05-05 00:00:00.000000 << real
1 1 2024-05-05 00:10:00.000000 << expected
@tkirschke
Copy link
Member

Hi @tankim ,

Sorry for the late reply!

In your described scenario, there was no change in the second row, the hashdiff is the same.
Therefore, no new row is loaded into the Satellite v0.

This is the expected Data Vault 2.0 behavior, let me know if I understood something wrong.

Best regards
Tim

Copy link

This issue is stale because it has been open for 90 days with no activity. If you would like the issue to remain open, please remove the stale label or comment on the issue. Otherwise it will be closed in 14 days

@github-actions github-actions bot added the stale label Feb 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants