Age and sex effects in anchoring vignette studies: methodological and empirical contributions
Titelübersetzung:Alters- und Geschlechtseffekte bei "anchoring vignette"-Studien: methodologische und empirische Beiträge
Autor/in:
Grol-Prokopczyk, Hanna
Quelle: Survey Research Methods, 8 (2014) 1, S 1-17
Inhalt: "Anchoring vignettes are an increasingly popular tool for identifying and correcting for group differences in use of subjective ordered response categories. However, existing techniques to maximize response consistency (use of the same standards for self-ratings as for vignette-ratings), which center on matching vignette characters' demographic characteristics to respondents' own characteristics, appear at times to be ineffective or to pose interpretive difficulties. Specifically, respondents often appear to neglect instructions to treat vignette characters as age peers. Furthermore, when vignette characters' sex is matched to respondents' sex, interpretation of sex differences in rating style is rendered problematic. This study applies two experimental manipulations to a national American sample (n=1,765) to clarify best practices for enhancing response consistency. First, an analysis of two methods of highlighting vignette characters' age suggests that both yield better response consistency than previous, less prominent means. Second, a comparison of ratings of same- and opposite-sex vignette characters suggests that, with avoidable exceptions, the sex of the respondent rather than of the vignette character drives observed sex differences in rating style. Implications for interpretation and design of anchoring vignette studies are discussed. Findings also show significant sex, educational, and racial/ethnic differences in styles of rating health, and racial/ethnic differences in styles of rating political efficacy. These findings underscore the incomparability of unadjusted subjective self-ratings across demographic groups." (publisher's description)
Testing the Validity of Gender Ideology Items by Implementing Probing Questions in Web Surveys
Autor/in:
Behr, Dorothée; Braun, Michael; Kaczmirek, Lars; Bandilla, Wolfgang
Quelle: Field Methods, 25 (2013) 2, S 124-141
Inhalt: This article examines the use of probing techniques in web surveys to identify validity problems of items. Conventional cognitive interviewing is usually based on small sample sizes and thus precludes quantifying the findings in a meaningful way or testing small or special subpopulations characterized by their response behavior. This article investigates probing in web surveys as a supplementary way to look at item validity. Data come from a web survey in which respondents were asked to give reasons for selecting a response category for a closed question. The web study was conducted in Germany, with respondents drawn from online panels (n = 1,023). The usefulness of the proposed approach is shown by revealing validity problems with a gender ideology item.
Schlagwörter:Befragung; survey; Online-Befragung; online survey; Gender; gender; Ideologie; ideology; Validität; validity; Panel; panel; Antwortverhalten; response behavior; Fehler; error; Deutungsmuster; pattern of interpretation; Interpretation; interpretation; Analyse; analysis; Indikator; indicator; Egalitarismus; egalitarianism; Rollenverteilung; role distribution; Rollenverständnis; role conception; ISSP; ISSP; Federal Republic of Germany; probing; web survey; gender ideology; ZA3880: International Social Survey Programme: Family and Changing Gender Roles III - ISSP 2002
SSOAR Kategorie:Erhebungstechniken und Analysetechniken der Sozialwissenschaften
Personalisation in advance letters does not always increase response rates: demographic correlates in a large scale experiment
Titelübersetzung:Personalisierung in Voraus-Briefen erhöhen nicht immer die Antwortraten: demographische Korrelationen in einem Großversuch
Autor/in:
Luiten, Annemieke
Quelle: Survey Research Methods, 5 (2011) 1, S 11-20
Inhalt: "This study was set up to examine whether personalizing advance letters by adding names and appropriate salutation, affects the survey cooperation of subgroups in the general population differently, in analogy to findings that subgroups react differently to advance letters. Differential reactions could be an explanation for the mixed findings in the literature on personalization of advance or cover letters. In a large scale study (N=39,518), information in communal registries was used to study (non)response patterns in subgroups, as a result of personalization. Advance letters of the Dutch CAPI Labor Force Survey were randomly assigned to addresses. In the non-personalized version (N=30,899), letters were addressed to 'the inhabitants of '. In the personalized version (N=8,619), the name or names of the household core were derived from municipal registries and used for addressing the letter. A re-interview addressed the issue whether the advance letter was read by more households when the household was addressed by name. By linking the sample to registries, it was possible to study response behavior of subgroups. The study focused on groups the literature indicates as differentially reacting to advance letters, i.e., different age, ethnic, gender, household composition and income groups, and groups with or without a listed telephone number. Hardly any difference in the overall level of cooperation was found if either a personalized or non-personalized letter was used. However, differential reactions were found for listed versus unlisted telephone owners, where only listed households reacted positively to personalization. In the other subgroups studied, no firm evidence of differential reactions were found. The paper discusses what these results signify for sample composition and the risk of bias." (author's abstract)
Sozial erwünschtes Antwortverhalten bezüglich der Teilung häuslicher Arbeit: die Interaktion von Interviewergeschlecht und Befragtenmerkmalen in Telefoninterviews
Titelübersetzung:Social desirability and response bias in case of the division of household labour: the interaction between gender of the interviewer and respondent characteristics in telephone interviews
Autor/in:
Klein, Markus; Kühhirt, Michael
Quelle: Methoden, Daten, Analysen (mda), 4 (2010) 2, S 79-104
Inhalt: "Der Beitrag untersucht den Einfluss des Interviewergeschlechts auf das Antwortverhalten von Befragten bezüglich der Teilung häuslicher Arbeit in telefonischen Interviews. Aufgrund einer Diskrepanz zwischen öffentlich vertretenen egalitären Geschlechterrollen und der noch immer geringen männlichen Beteiligung an der Hausarbeit wird auf Basis von Rational-Choice Argumenten erwartet, dass männliche Befragte bei weiblichen Interviewern sozial erwünscht antworten und ihre Beteiligung an der Hausarbeit überschätzen. Dagegen ist anzunehmen, dass Frauen ihren relativen Anteil an der partnerschaftlichen Hausarbeit eher unterschätzen. Interviewereffekte des Geschlechts sollten bei weiblichen Befragten jedoch geringer ausfallen als bei Männern. Da sich vor allem junge bzw. gebildete Befragte egalitärer Rollenvorstellungen bewusst sind, sollten vor allem diese Gruppen anfällig für derartige Interviewereffekte sein. Für männliche Befragte entsprechen die Ergebnisse weitestgehend den Erwartungen, wobei das Interviewergeschlecht in Abhängigkeit vom Alter des Befragten die stärkeren Effekte zeigt. Für weibliche Befragte zeigen sich über alle Altersgruppen und Bildungsabschlüsse dagegen keine signifikanten Effekte. Die Ergebnisse verdeutlichen, dass sozial erwünschtes Antwortverhalten auch bei Auskünften über konkretes Alltagshandeln auftreten kann. Hinzu kommt eine beträchtliche Heterogenität der Effekte über unterschiedliche Bevölkerungsgruppen." (Autorenreferat)
Inhalt: "In this paper the authors examine the impact of the interviewer's gender on respondents' self-reported share of housework in telephone interviews. Due to a discrepancy between modern, egalitarian gender roles dominating public discussion and men's marginal participation in housework they expect male respondents to answer in a socially desirable way and exaggerate their share of housework vis à vis female interviewers. At the same time, they assume that female respondents underreport their contribution to the couple's housework to female interviewers. The effects of the interviewer's gender should be less strong in case of female respondents than in case of male respondents, though. Additionally, theory suggests that young and educated respondents are particularly susceptible to effects of the interviewer's gender as they are most aware of egalitarian gender roles due to their socialization and environment. For male respondents the results are largely consistent with the expectations. However, the effect of the interviewer's gender varies stronger by age than by education. Regarding female respondents the results do not indicate any significant effects across age groups and educational degrees. Overall, the results show that social desirability may also bias self-reports of everyday behaviour. Moreover, interviewer effects vary considerably between different social groups." (author's abstract)
Autor/in:
Bollinger, Christopher R.; Hirsch, Barry T.
Quelle: Rat für Sozial- und Wirtschaftsdaten (RatSWD); Berlin (RatSWD Working Paper Series, 165), 2010. 22 S
Inhalt: "Earnings nonresponse in the Current Population Survey is roughly 30% in the monthly surveys and 20% in the annual March survey. Even if nonresponse is random, severe bias attaches to wage equation coefficient estimates on attributes not matched in the earnings imputation hot deck. If nonresponse is ignorable, unbiased estimates can be achieved by omitting imputed earners, yet little is known about whether or not CPS nonresponse is ignorable. Using sample frame measures to identify selection, we find clear-cut evidence among men but limited evidence among women for negative selection into response. Wage equation slope coefficients are affected little by
selection but because of intercept shifts, wages for men and to a lesser extent women are understated, as are gender wage gaps. Selection is less severe among household heads/co-heads than among other household members." [author's abstract]
Das standardisierte Interview als soziale Interaktion: Interviewereffekte in der Umfrageforschung
Titelübersetzung:The standardized interview as social interaction: interviewer effects in survey research
Autor/in:
Haunberger, Sigrid
Quelle: ZA-Information / Zentralarchiv für Empirische Sozialforschung, (2006) 58, S 23-46
Inhalt: 'Dieser Artikel beschäftigt sich mit methodischen Problemen, die beim standardisierten face-to-face Interview durch die Interaktion zwischen Interviewern und Befragten entstehen. Auf der Datengrundlage einer Mehrthemenumfrage (Sozialwissenschaftenbus 2/96) werden zu drei Fragetypen (Antwort auf offene Fragen, Antwortverweigerung bei der Einkommensabfrage und Antworten zu Meinungsfragen) mögliche Interviewereffekte analysiert. Für alle drei Fragetypen lassen sich bedenkenswerte Zusammenhänge von Interviewermerkmalen und der Situation des Interviews feststellen: Intervieweralter und Interviewerbildung beeinflussen die Antworten auf offene Abfragen. Bei der Verweigerung der Einkommensabfrage bestehen ebenfalls deutliche Zusammenhänge mit dem Interviewergeschlecht und der Interviewerbildung sowie mit der Anwesenheit Dritter. Analysiert wurde auch ein Interaktionseffekt von Interviewer- und Befragtenmerkmalen. In 'homogenen' Bildungskonstellationen wird weniger verweigert. Zustimmungs- und Ablehnungstendenzen bei Meinungsfragen zeigen einen deutlichen Geschlechtseffekt.' (Autorenreferat)
Inhalt: 'This article focusses on methodological problems in standardized oral interviews which arise from the interaction between interviewer and respondent. With the data from Sozialwissenschaften-Bus 2/96, three possible interviewer effects are analyzed (responses to open questions, nonresponse to the income question and opinion questions). For all three topics, considerable influences of interviewer characteristics and the interview situation could be found: The responses to open questions vary with the interviewer's age and education. In nonresponse to the income question, there is a clear relation between interviewer's sex and education as well as influence of present others. There was also an interaction effect of interviewer and respondent-characteristics. Homogeneous education-groups show less nonresponse. Tendencies of acceptance or refusal to questions of opinion are related to the sex of the interviewer.' (author's abstract)|