-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathsurvey-questionnaire.tex
More file actions
executable file
·378 lines (289 loc) · 19.5 KB
/
Copy pathsurvey-questionnaire.tex
File metadata and controls
executable file
·378 lines (289 loc) · 19.5 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
% appendices/survey-questionnaire.tex
% Expert Survey Questionnaire — shared between dissertation and standalone print version
\noindent\textbf{\Large Expert Perceptions of Generative-AI--Driven Disinformation}
\medskip
\noindent\textit{Purpose:} This survey explores expert perceptions of generative-AI--driven disinformation for an academic research project. All responses will be treated as confidential and reported in an anonymised, aggregated format unless explicit consent is given for attribution.
%% ---------- Consent ----------
\section*{Consent \& Data Protection}
\noindent\textbf{Detailed Information \& Data Protection Notice (GDPR)}
\medskip
\noindent By participating in this survey, you agree to the following terms regarding the collection and use of your data.
\medskip
\noindent\textbf{Data Controller:} The person responsible for your data is Alexander Loth, conducting research at the Frankfurt University of Applied Sciences. Contact: \texttt{alexander.loth@stud.fra-uas.de}.
\medskip
\noindent\textbf{Purpose and Lawful Basis:} The data from this survey will be used exclusively for academic research purposes, including analysis, publication in academic journals, and conference presentations. The legal basis for processing your personal data is your explicit consent, which you provide by starting the survey.
\medskip
\noindent\textbf{Data Handling:} Your survey responses will be stored securely. By default, all published results will be fully anonymised. If you explicitly consent at the end of the survey, your name and affiliation may be included in the acknowledgements or used for direct attribution of quotes. Open-ended responses may be analyzed using third-party AI services (e.g., OpenAI); only de-identified text is transmitted and it is not used to train the providers' models.
\medskip
\noindent\textbf{Data Retention:} Anonymised research data will be archived indefinitely as part of the scientific record. Any personal data linking you to your responses (such as your name or email if provided for attribution) will be securely deleted one year after the final publication of this research, or immediately upon your request.
\medskip
\noindent\textbf{Your Rights as a Participant:} In accordance with GDPR, you have the right to:
\begin{itemize}
\item \textbf{Withdraw Consent:} You can withdraw your consent at any time without penalty by closing the survey or by contacting the researcher via email to have your data deleted.
\item \textbf{Access, Rectify, and Erase Data:} You have the right to request access to, correction of, or deletion of your personal data.
\item \textbf{Lodge a Complaint:} You have the right to lodge a complaint with a supervisory authority. The responsible authority for the Frankfurt University of Applied Sciences is the Hessian Commissioner for Data Protection and Freedom of Information (\textit{Hessischer Beauftragter für Datenschutz und Informationsfreiheit}).
\end{itemize}
\noindent By proceeding, you confirm that you have read and understood these terms.
\begin{enumerate}[label=\textbf{Q1.}, leftmargin=3em, resume]
\item[*] \textit{I confirm I am 18 years or older and I have read, understood, and agree to the consent terms outlined above.}
\begin{itemize}
\item[$\bigcirc$] Yes, I consent to participate
\item[$\bigcirc$] No, I do not consent
\end{itemize}
\end{enumerate}
%% ---------- Section 1 ----------
\section*{Section 1/9: Screening \& Expert Group}
\begin{enumerate}[label=\textbf{Q\arabic*.}, leftmargin=3em]
\setcounter{enumi}{1}
\item[*] \textit{Which best describes your primary professional role?}
\begin{itemize}
\item[$\bigcirc$] AI researcher / ML engineer (development of generative models)
\item[$\bigcirc$] Disinformation / fact-checking professional
\item[$\bigcirc$] Journalist covering tech or politics
\item[$\bigcirc$] Policymaker / regulator involved with AI, media or digital-services policy
\item[$\bigcirc$] Ethicist / legal scholar working on AI or deepfakes
\item[$\bigcirc$] Other: \rule{5cm}{0.4pt}
\end{itemize}
\item[*] \textit{Please provide a link to a recent activity of yours that might be interesting for our research (e.g., recent paper title, organisational role, or link).}\\[2pt]
\framebox[\linewidth]{\rule{0pt}{1em}}
\end{enumerate}
%% ---------- Section 2 ----------
\section*{Section 2/9: Demographics \& Baseline Knowledge}
\begin{enumerate}[label=\textbf{Q\arabic*.}, leftmargin=3em]
\setcounter{enumi}{4}
\item[*] \textit{Years of professional experience in your field.}\\[2pt]
\framebox[4cm]{\rule{0pt}{1em}}
\item[*] \textit{Region of primary professional activity.}
\begin{itemize}
\item[$\bigcirc$] European Union (EU)
\item[$\bigcirc$] Europe (non-EU, including UK)
\item[$\bigcirc$] North America (USA \& Canada)
\item[$\bigcirc$] East \& Southeast Asia
\item[$\bigcirc$] South \& Central Asia
\item[$\bigcirc$] Latin America and the Caribbean
\item[$\bigcirc$] Middle East \& North Africa (MENA)
\item[$\bigcirc$] Sub-Saharan Africa
\item[$\bigcirc$] Oceania (Australia, New Zealand, etc.)
\item[$\bigcirc$] Other: \rule{5cm}{0.4pt}
\end{itemize}
\item[*] \textit{Self-rated technical understanding of Large Language Models.}\\[2pt]
\noindent Likert scale: 1 (Novice) -- 7 (Expert)\\
\begin{tabular}{ccccccc}
1 & 2 & 3 & 4 & 5 & 6 & 7 \\
$\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$
\end{tabular}
\item[*] \textit{Self-rated familiarity with deepfake video technology.}\\[2pt]
\noindent Likert scale: 1 (Novice) -- 7 (Expert)\\
\begin{tabular}{ccccccc}
1 & 2 & 3 & 4 & 5 & 6 & 7 \\
$\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$
\end{tabular}
\end{enumerate}
%% ---------- Section 3 ----------
\section*{Section 3/9: Perceived Threats (Modality Only)}
\begin{enumerate}[label=\textbf{Q\arabic*.}, leftmargin=3em]
\setcounter{enumi}{8}
\item \textit{On a 1--7 scale (1\,=\,Not a threat, 7\,=\,Severe threat), how threatening is each modality for spreading disinformation in general?}
\medskip
\noindent\begin{tabular}{l ccccccc}
\toprule
\textbf{Modality} & \textbf{1} & \textbf{2} & \textbf{3} & \textbf{4} & \textbf{5} & \textbf{6} & \textbf{7} \\
\midrule
AI-generated Text & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
AI-generated Images & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
AI-generated Audio (voice cloning) & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
AI-generated Video (deepfakes) & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
\bottomrule
\end{tabular}
\end{enumerate}
%% ---------- Section 4 ----------
\section*{Section 4/9: Perceived Threats (Modality $\times$ Domain Matrix)}
\noindent\textit{Now consider specific domains. How threatening is each modality in the given domain?}
\begin{enumerate}[label=\textbf{Q\arabic*.}, leftmargin=3em]
\setcounter{enumi}{9}
\item \textit{Threats in the \textbf{Political} Domain (1\,=\,Not a threat, 7\,=\,Severe threat).}
\medskip
\noindent\begin{tabular}{l ccccccc}
\toprule
\textbf{Modality} & \textbf{1} & \textbf{2} & \textbf{3} & \textbf{4} & \textbf{5} & \textbf{6} & \textbf{7} \\
\midrule
AI-generated Text & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
AI-generated Images & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
AI-generated Audio & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
AI-generated Video & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
\bottomrule
\end{tabular}
\item \textit{[Optional] Which specific points concerning the Political Domain would you like to share with us?}\\[2pt]
\framebox[\linewidth]{\rule{0pt}{2em}}
\item \textit{Threats in the \textbf{Health} Domain (1\,=\,Not a threat, 7\,=\,Severe threat).}
\medskip
\noindent\begin{tabular}{l ccccccc}
\toprule
\textbf{Modality} & \textbf{1} & \textbf{2} & \textbf{3} & \textbf{4} & \textbf{5} & \textbf{6} & \textbf{7} \\
\midrule
AI-generated Text & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
AI-generated Images & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
AI-generated Audio & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
AI-generated Video & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
\bottomrule
\end{tabular}
\item \textit{[Optional] Which specific points concerning the Health Domain would you like to share with us?}\\[2pt]
\framebox[\linewidth]{\rule{0pt}{2em}}
\item \textit{Threats in the \textbf{Financial} Domain (1\,=\,Not a threat, 7\,=\,Severe threat).}
\medskip
\noindent\begin{tabular}{l ccccccc}
\toprule
\textbf{Modality} & \textbf{1} & \textbf{2} & \textbf{3} & \textbf{4} & \textbf{5} & \textbf{6} & \textbf{7} \\
\midrule
AI-generated Text & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
AI-generated Images & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
AI-generated Audio & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
AI-generated Video & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
\bottomrule
\end{tabular}
\item \textit{[Optional] Which specific points concerning the Financial Domain would you like to share with us?}\\[2pt]
\framebox[\linewidth]{\rule{0pt}{2em}}
\item \textit{Threats in the \textbf{Social} Domain (1\,=\,Not a threat, 7\,=\,Severe threat).}
\medskip
\noindent\begin{tabular}{l ccccccc}
\toprule
\textbf{Modality} & \textbf{1} & \textbf{2} & \textbf{3} & \textbf{4} & \textbf{5} & \textbf{6} & \textbf{7} \\
\midrule
AI-generated Text & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
AI-generated Images & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
AI-generated Audio & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
AI-generated Video & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
\bottomrule
\end{tabular}
\item \textit{[Optional] Which specific points concerning the Social Domain would you like to share with us?}\\[2pt]
\framebox[\linewidth]{\rule{0pt}{2em}}
\end{enumerate}
%% ---------- Section 5 ----------
\section*{Section 5/9: Key Risks (Top-3)}
\begin{enumerate}[label=\textbf{Q\arabic*.}, leftmargin=3em]
\setcounter{enumi}{17}
\item[*] \textit{Select up to three risks you judge most urgent.}
\begin{itemize}
\item[$\square$] Election interference via deepfake video
\item[$\square$] Large-scale text spambots (astroturfing)
\item[$\square$] Audio-clone financial fraud / scams
\item[$\square$] Synthetic medical misinformation
\item[$\square$] Harassment / non-consensual deepfake porn
\item[$\square$] Cyberattacks (e.g.\ phishing)
\item[$\square$] Other: \rule{5cm}{0.4pt}
\end{itemize}
\item \textit{[Optional] In 1--2 sentences, tell us why the risks you selected worry you most. Feel free to cite a real incident or scenario.}\\[2pt]
\framebox[\linewidth]{\rule{0pt}{2em}}
\end{enumerate}
%% ---------- Section 6 ----------
\section*{Section 6/9: Mitigation Strategies -- Ratings}
\begin{enumerate}[label=\textbf{Q\arabic*.}, leftmargin=3em]
\setcounter{enumi}{19}
\item \textit{On a scale of 1 (Not effective) to 7 (Very effective), rate the effectiveness of the following mitigation strategies.}
\medskip
\noindent\begin{tabular}{l ccccccc}
\toprule
\textbf{Strategy} & \textbf{1} & \textbf{2} & \textbf{3} & \textbf{4} & \textbf{5} & \textbf{6} & \textbf{7} \\
\midrule
Technical detection tools & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
Digital watermarking / provenance standards & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
Government regulation (e.g., AI Act, DSA) & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
Media / public literacy programmes & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
Platform enforcement policies & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
\bottomrule
\end{tabular}
\item \textit{[Optional] Which additional information concerning mitigation strategies would you like to share with us?}\\[2pt]
\framebox[\linewidth]{\rule{0pt}{2em}}
\end{enumerate}
%% ---------- Section 7 ----------
\section*{Section 7/9: Mitigation Strategies -- Forced Ranking}
\begin{enumerate}[label=\textbf{Q\arabic*.}, leftmargin=3em]
\setcounter{enumi}{21}
\item \textit{Please rank the following strategies from 1 (most effective) to 5 (least effective).}
\medskip
\noindent\begin{tabular}{l ccccc}
\toprule
\textbf{Strategy} & \textbf{1} & \textbf{2} & \textbf{3} & \textbf{4} & \textbf{5} \\
\midrule
Technical detection tools & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
Digital watermarking / provenance standards & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
Government regulation (e.g., AI Act, DSA) & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
Media / public literacy programmes & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
Platform enforcement policies & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ \\
\bottomrule
\end{tabular}
\end{enumerate}
%% ---------- Section 8 ----------
\section*{Section 8/9: Best--Worst Scaling (Preference Weights)}
\begin{enumerate}[label=\textbf{Q\arabic*.}, leftmargin=3em]
\setcounter{enumi}{22}
\item[*] \textit{Which strategy is \textbf{most} effective?}
\begin{itemize}
\item[$\bigcirc$] Digital watermarking / provenance standards
\item[$\bigcirc$] Media / public literacy programmes
\item[$\bigcirc$] Government regulation (e.g., AI Act, DSA)
\item[$\bigcirc$] Technical detection tools
\item[$\bigcirc$] Platform enforcement policies
\end{itemize}
\item[*] \textit{Which strategy is \textbf{least} effective?}
\begin{itemize}
\item[$\bigcirc$] Digital watermarking / provenance standards
\item[$\bigcirc$] Media / public literacy programmes
\item[$\bigcirc$] Government regulation (e.g., AI Act, DSA)
\item[$\bigcirc$] Technical detection tools
\item[$\bigcirc$] Platform enforcement policies
\end{itemize}
\item \textit{[Optional] What is the single biggest obstacle (technical, political or economic) that could block successful adoption of your top-ranked mitigation strategy?}\\[2pt]
\framebox[\linewidth]{\rule{0pt}{2em}}
\end{enumerate}
%% ---------- Section 9 ----------
\section*{Section 9/9: Evaluating Mitigation Strategies -- Public Literacy Tools}
\noindent\textit{The next set of questions concerns a specific category of mitigation strategy: public-facing awareness tools designed to improve media literacy. For the following questions, please consider a specific, real-world example called JudgeGPT (\url{https://judgegpt.streamlit.app/}).}
\medskip
\noindent\textbf{Methodology of Public Literacy Tools.}
Tools for public disinformation literacy typically have the following characteristics: Users are shown a series of short text-based news fragments. For each fragment, the user must make two separate judgments using rating sliders: (1)~\textit{Origin Detection:} Is the text written by a human or generated by an AI? (2)~\textit{Veracity Judgment:} Is the information in the news fragment legitimate or fake? After completing a set of five fragments, the application shows the user their performance statistics, including their accuracy scores for both tasks and awards badges for high performance.
\begin{enumerate}[label=\textbf{Q\arabic*.}, leftmargin=3em]
\setcounter{enumi}{25}
\item \textit{On a 1--7 scale, how effective do you believe such public-awareness tools are for mitigating AI-generated fake news?}\\[2pt]
\noindent Likert scale: 1 (Not Effective) -- 7 (Very Effective)\\
\begin{tabular}{ccccccc}
1 & 2 & 3 & 4 & 5 & 6 & 7 \\
$\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$ & $\bigcirc$
\end{tabular}
\item[*] \textit{Select the single greatest limitation you see in such tools.}
\begin{itemize}
\item[$\bigcirc$] Easily bypassed by adversarial content
\item[$\bigcirc$] Reaches only tech-savvy audiences
\item[$\bigcirc$] Impact fades once novelty wears off
\item[$\bigcirc$] Resource-intensive to maintain
\item[$\bigcirc$] Other: \rule{5cm}{0.4pt}
\end{itemize}
\item \textit{[Optional] What do you see as the main strength of public-awareness tools like JudgeGPT?}\\[2pt]
\framebox[\linewidth]{\rule{0pt}{2em}}
\item \textit{[Optional] Suggest one concrete feature or programme that would make public-resilience tools more effective.}\\[2pt]
\framebox[\linewidth]{\rule{0pt}{2em}}
\end{enumerate}
%% ---------- Future Outlook ----------
\section*{Future Outlook \& Final Comments}
\begin{enumerate}[label=\textbf{Q\arabic*.}, leftmargin=3em]
\setcounter{enumi}{29}
\item \textit{[Optional] Looking ahead five years, name one emerging or currently underestimated risk at the AI--disinformation frontier.}\\[2pt]
\framebox[\linewidth]{\rule{0pt}{2em}}
\item \textit{[Optional] Any final thoughts we haven't covered, or feedback on the survey?}\\[2pt]
\framebox[\linewidth]{\rule{0pt}{2em}}
\end{enumerate}
%% ---------- Attribution ----------
\section*{Attribution \& Final Submission}
\noindent\textit{As mentioned in the consent form, we would like to offer you the option to be acknowledged for your contribution. Please select one of the options below. The default is full anonymity.}
\begin{enumerate}[label=\textbf{Q\arabic*.}, leftmargin=3em]
\setcounter{enumi}{31}
\item[*] \textit{How would you like your contribution to be handled in the final publication?}
\begin{itemize}
\item[$\bigcirc$] Please keep my responses and participation completely anonymous.
\item[$\bigcirc$] You may list my name and affiliation in the paper's ``Acknowledgements'' section.
\item[$\bigcirc$] In addition to acknowledging me, you may attribute specific quotes or ideas from my open-ended responses directly to me by name.
\end{itemize}
\item[*] \textit{Full Name} \quad \rule{8cm}{0.4pt}
\item[*] \textit{Affiliation} \quad \rule{8cm}{0.4pt}
\item \textit{[Optional] Link to your preferred professional/academic profile.} \quad \rule{6cm}{0.4pt}
\end{enumerate}