You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Update CTIS documentation to point to ICPSR (#1615)
Now that the CTIS data is archived with ICPSR, we can point there and
deprecate pages describing access to microdata via CMU. ICPSR also
archives the contingency tables, including a user guide, so we can
remove the redundant contingency table documentation and point to ICPSR
instead.
These tables are more detailed than the [coarse aggregates reported in the COVIDcast Epidata API](../api/covidcast-signals/fb-survey.md), which are grouped
32
+
These tables are more detailed than the [coarse aggregates reported in the
33
+
COVIDcast Epidata API](../api/covidcast-signals/fb-survey.md), which are grouped
24
34
only by geographic region. [Individual response data](survey-files.md) for the
25
-
survey is available, but only to academic or nonprofit researchers who sign a
26
-
Data Use Agreement, whereas these contingency tables are available to the
27
-
general public.
35
+
survey is available, but only to researchers who request restricted data access
36
+
via ICPSR, whereas these contingency tables are available to the general public.
28
37
29
38
Please see our survey [credits](index.md#credits) and [citation information](index.md#citing-the-survey)
30
39
for information on how to cite this data if you use it in a publication.
31
40
32
41
Our [Data and Sampling Errors](problems.md) documentation lists important
33
42
updates for data users, including corrections to data or updates on data
34
43
processing delays.
35
-
36
-
## Table of contents
37
-
{: .no_toc .text-delta}
38
-
39
-
1. TOC
40
-
{:toc}
41
-
42
-
## Available Data
43
-
44
-
We currently provide data files at several levels of geographic and temporal
45
-
aggregation. The reason for this is that each file is filtered to only include
46
-
estimates for a particular group if that group includes 100 or more responses.
47
-
Providing several levels of granularity allows us to provide coverage for a
48
-
variety of use cases. For example, users who need the most up-to-date data or
49
-
are interested in time series analysis should use the weekly files, while
50
-
those who want to study groups with smaller sample sizes should use the
51
-
monthly files. Because monthly aggregates include more responses, they have
52
-
lower missingness when grouping by several features at a time.
Files contain all time periods for a given period type-aggregation
58
-
type combination.
59
-
60
-
Individual CSVs containing a single [week](https://www.cmu.edu/delphi-web/surveys/weekly/) or [month](https://www.cmu.edu/delphi-web/surveys/monthly/) for a given aggregation type are also available.
61
-
62
-
### Dates
63
-
64
-
The included files provide estimates for various metrics of interest over a
65
-
period of either a full epiweek (or [MMWR
66
-
week](https://wwwn.cdc.gov/nndss/document/MMWR_week_overview.pdf), a
67
-
standardized numbering of weeks throughout the year) or a full calendar month.
68
-
69
-
Note: If a survey item was introduced in the middle of an aggregation period,
70
-
derived indicators will be included in aggregations for that period but will
71
-
only use a partial week or month of data.
72
-
73
-
### Regions
74
-
75
-
At the moment, only nation-wide and state groupings are available.
76
-
77
-
Facebook only invites users to take the survey if they appear, based on
78
-
attributes in their Facebook profiles, to reside in the 50 states or
79
-
Washington, DC. Puerto Rico is sampled separately as part of the
80
-
[international version of the survey](https://covidmap.umd.edu/). If Facebook
81
-
believes a user qualifies for the survey, but the user then replies that they
82
-
live in Puerto Rico or another US territory, we do not include their response
83
-
in the aggregations.
84
-
85
-
### Privacy
86
-
87
-
The aggregates are filtered to only include estimates for a particular group
88
-
if that group includes 100 or more responses. Especially in the weekly
89
-
aggregates, many of the state-level groups have been filtered out due to low
90
-
sample size. In such cases, files that group by a single demographic of
91
-
interest will likely provide more coverage.
92
-
93
-
## File Format
94
-
95
-
### Naming
96
-
97
-
"Rollup" files containing all time periods for a given period type-aggregation
Copy file name to clipboardExpand all lines: docs/symptom-survey/data-access.md
+17-27
Original file line number
Diff line number
Diff line change
@@ -20,13 +20,20 @@ characteristics are available for download.
20
20
## Getting Microdata Access
21
21
22
22
De-identified individual survey responses can be made available to researchers
23
-
associated with universities or non-profit organizations who sign a Data Use
24
-
Agreement (DUA). To request access to the data please submit the information
25
-
requested in [Facebook's page on obtaining data access](https://dataforgood.facebook.com/dfg/docs/covid-19-trends-and-impact-survey-request-for-data-access),
26
-
which sets out the basic conditions and provides a form to request access. An
27
-
[international version of CTIS](https://covidmap.umd.edu/) is conducted by the
28
-
University of Maryland (UMD) and access can be requested through the same
29
-
form.
23
+
associated with universities or non-profit organizations who agree to a Data Use
24
+
Agreement (DUA). The microdata is archived by the Inter-university Consortium
25
+
for Political and Social Research (ICPSR) at the University of Michigan:
26
+
27
+
* Reinhart, Alex, Mejia, Robin, and Tibshirani, Ryan J. COVID-19 Trends and
28
+
Impact Survey (CTIS), United States, 2020-2022. Inter-university Consortium
29
+
for Political and Social Research [distributor], 2025-02-28.
30
+
<https://doi.org/10.3886/ICPSR39207.v1>
31
+
32
+
Follow the link to view the data description and documentation, and to request
33
+
access to the restricted microdata. The survey documentation, including full
34
+
codebooks and user guides, is available for public download. Microdata access is
35
+
no longer available through direct agreements with Carnegie Mellon University,
36
+
so all access must be requested through ICPSR.
30
37
31
38
The United States survey protocol has been reviewed by the Carnegie Mellon
32
39
University Institutional Review Board with IRB ID STUDY2020_00000162.
@@ -44,26 +51,9 @@ Some important notes about obtaining access to the individual survey responses:
44
51
* Part- or full-time employees of Facebook are **not** eligible to receive data
45
52
access, since Delphi's agreement with Facebook to protect the privacy of
46
53
respondents prohibits Facebook employees from receiving any microdata.
47
-
* Because this survey is large and many groups have access, the Data Use
48
-
Agreements are not negotiable.
49
-
50
-
After you complete the request form, staff from Facebook and CMU will be in
51
-
contact to guide you through the rest of the process. They will provide data use
52
-
agreements for your institution to sign, and will also request a copy of your
53
-
Institutional Review Board approval to verify you have ethical approval to
54
-
conduct the research.
55
-
56
-
After the DUAs are executed, we will ask you to fill out [this
57
-
form](http://cmu.ca1.qualtrics.com/jfe/form/SV_89aVsYl29Oay4qq) to set up your
58
-
microdata access. This form can be used for new research projects or adding new
59
-
researchers to existing projects.
60
-
61
-
After completing these forms, credentials for SFTP will be emailed to each
62
-
individual on the team. Please **do not share your credentials** with other
63
-
users. Only one person per research team needs to fill out this survey. You can
64
-
list all relevant team members in one submission. For teams with more than 5
65
-
members, please fill out an additional form(s) to cover your whole team.
66
54
67
55
If you have questions about the process, or your IRB needs information
0 commit comments