Measurement and Questionnaires

In the field of questionnaires, our research is centered on determining the most effective means of measuring the intended constructs. In this context, data quality encompasses factors such as reliability, validity, and – in cross-cultural settings – the equivalence of collected data. Our research efforts are directed towards improving the development process of individual items/questions and survey instruments, as well as evaluating the quality of the resulting data.

We currently focus on the following areas:

Development of instruments: We develop tailored measurement instruments, in particular short scales, for various characteristics relevant to survey research, such as growth mindset or non-binary gender. We also adapt and validate established measurement instruments according to state-of-the-art procedures, primarily catering to a German-speaking audience.

• Questionnaire design and response behavior: We explore the extent to which different question formats or individual and situational factors influence the quality of response behavior. We compare, for instance, matrix vs. single items or different types of rating scales. We also investigate response styles like acquiescence bias (yea-saying), non-response, or respondent attentiveness, employing for the latter attention checks as a diagnostic tool.
• Pretesting procedures: We continuously enhance cognitive pretesting methods and evaluate their effectiveness. In the context of web probing, we investigate the use of voice input, the efficacy of closed-ended versus open-ended probing questions, and the design and wording of probes.
• Harmonization and comparability: We conduct research on the comparability of survey instruments across different surveys and survey modes (measurement invariance). When confronted with items or questions assessing similar constructs but phrased differently across surveys, we devise harmonization strategies such as “equating”. Furthermore, we scrutinize how variations in question formulations affect response behavior.
• Questionnaire translation: We investigate different translation methods, including the integration of machine translation into the translation process, or assess and compare different translation procedures. Additionally, we delve into techniques for evaluating the translatability of source questionnaires.