Questionnaire design decisions when transitioning from an interviewer-administered to a self-administered online mode
Large-scale surveys are increasingly moving from (face-to-face or telephone-based) interviewer-administered to self-administered online modes. To ensure high measurement quality and maximum comparability and equivalence between the source questionnaire and its adaptation⸺across modes as well as across survey waves⸺various aspects of question design must be considered and several decisions need to be made concerning question presentation and wording. This survey guideline summarizes good practices on how to transition questionnaires from interviewer- to self-administered web surveys and gives recommendations and examples for major adaptation issues as well as general questionnaire design elements relevant to web surveys. In this context, we focus on the switch from an interviewer-based to an online mode (although mixed-mode designs are also conceivable).
Nießen, D., Hadler, P., & Neuert, C. (2023). Questionnaire design decisions when transitioning from an interviewer-administered to a self-administered online mode. Mannheim, GESIS – Leibniz Institute for the Social Sciences (GESIS – Survey Guidelines). DOI: 10.15465/gesis-sg_en_046
Related Survey Guidelines:
- Hadler, P. (2021). Question order effects in cross-cultural web probing: Pretesting behavior and attitude questions. Social Science Computer Review, 39(6), 1292–1312. https://doi.org/10.1177/0894439321992779
- Hadler, P., Lenzner, T., Schick, L., Neuert, C. (2022). European Working Conditions Survey 2024: Preparation and cognitive testing of the online questionnaire (Working Paper WPEF22035). Eurofound. https://www.eurofound.europa.eu/sites/default/files/wpef22035.pdf
- Hadler, P., Lenzner, T., Schick, L., Neuert, C., Steins, P., & Behnert, J. (2022). European Working Conditions Survey 2024. Cognitive pretest (GESIS Project Report 2022/08). GESIS-Pretestlabor. https://doi.org/10.17173/pretest116
- Neuert, C. E. (2017). Processing forced-choice versus check-all-that-apply question formats: Evidence from eye tracking. Field Methods, 29(4), 383–394. https://doi.org/10.1177/1525822X17703943
- Neuert, C. E. (2020). Do forced-choice (FC) questions trigger deeper cognition than check-all-that-apply (CATA) questions? Journal of Survey Statistics and Methodology, 8(4), 617–635. https://doi.org/10.1093/jssam/smz015
- Neuert, C. E., Roßmann, J., & Silber, H. (2023). Using eye-tracking methodology to study grid question designs in web surveys. Journal of Official Statistics, 39(1), 1–24. http://doi.org/10.2478/JOS-2023-0004
- Nießen, D., Hadler, P., Lenzner, T., & Neuert, C. (2022). Working conditions and sustainable work. Good practices in transitioning to an online mode in 3MC questionnaire design (Working Paper WPEF22034). Eurofound. https://www.eurofound.europa.eu/sites/default/files/wpef22034.pdf