Skip to content

clean nhsn data #2154

@aysim319

Description

@aysim319

related to #2152

The pipeline has an unexpected behavior where the update timestamp was changed and the sad path was to log the data as stale, but continue to process and update the data.

The run from 2025-06-25 had more unexpected behavior where the preliminary dataset that was recently updated still used the old key rowsUpdatedAt while the regular dataset did switch over to using viewLastModified which logged the data as stale, but ended up still processing the data

Metadata

Metadata

Assignees

Labels

data qualityMissing data, weird data, broken data

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions