Skip to content

Commit 98561e9

Browse files
authored
Merge pull request #732 from cmu-delphi/chng_backfill_estimates
Description of CHNG as-of estimation problems
2 parents 97a618c + 1270f12 commit 98561e9

File tree

1 file changed

+22
-0
lines changed

1 file changed

+22
-0
lines changed

docs/api/covidcast-signals/chng.md

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -17,6 +17,8 @@ grand_parent: COVIDcast Epidata API
1717

1818
## Overview
1919

20+
**Notice: This data source was paused on 2021-10-04 so that we can resolve some problems with the data pipeline. [Additional details on this pause are available below](#pipeline-pause).**
21+
2022
This data source is based on Change Healthcare claims data that has been
2123
de-identified in accordance with HIPAA privacy regulations. Change Healthcare is
2224
a healthcare technology company that aggregates data from many healthcare providers.
@@ -185,6 +187,26 @@ Note that due to local differences in health record-keeping practices, estimates
185187
are not always comparable across locations. We are currently working on
186188
adjustments to correct this spatial bias.
187189

190+
Indicator values for issue dates before 2021-02-21 are merely estimates, as
191+
these indicators were not yet available in real time. Backfill behavior of
192+
these estimates is erratic and not indicative of current backfill behavior. For more
193+
information on this effect and to track updates as we develop a fix, please see
194+
[covidcast-indicators issue #1289: CHNG historical issues are wrong before 2021-02-21](https://github.com/cmu-delphi/covidcast-indicators/issues/1289).
195+
196+
### Pipeline Pause
197+
198+
Starting on October 4, 2021, a problem with the `chng` pipeline began causing it
199+
to mark some days of data as deleted in their most recent version. These
200+
spurious deletions affected all regions and `chng` signals from July 31 to
201+
August 3, 2021, and the affected date range would continue to grow by one day
202+
each day if we allowed the pipeline to continue running.
203+
204+
On October 8, 2021, we paused the `chng` pipeline, and it will remain inactive
205+
until we can identify and implement a fix. In the meantime, the versions with
206+
the deletion markings have been removed, so that default (latest) queries and
207+
queries with as-of set to 2021-10-04 or later will return the
208+
next-most-recently-updated value for these dates.
209+
188210
## Qualifying Conditions
189211

190212
We receive data on the following six categories of counts:

0 commit comments

Comments
 (0)