Quelle: Methods, data, analyses : a journal for quantitative methods and survey methodology (mda), 13 (2019) 1, S 59-90
Inhalt: Questions on earnings are counted among sensitive topics that often produce high rates of item nonresponse or measurement error. Both types of bias are well documented in the literature and are found to concentrate in the tails of the earnings distribution. In this paper, we explore whether measurement error on earnings could be explained by socially desirable
reporting and whether the error is impacted by interviewer characteristics. Using the linked dataset NEPS-SC6-ADIAB, which contains survey data from the German National Educational Panel Study, Starting Cohort "Adults", linked to administrative earnings records from the German Federal Employment Agency, we analyze the extents of over- and underreporting and the influence of respondent and interviewer characteristics on these behaviors for different quartiles of the earnings distribution. Our results show that the average level of misreporting is relatively low (approximately 6% of median earnings). Our main logistic model reveals that female and more highly educated respondents report significantly more accurately while those with higher earnings misreport to a significantly greater extent. Regarding the impact of personality traits on reporting accuracy, we find significant positive effects for more agreeable respondents and significant negative effects for extraverted respondents. When differentiating by the direction of misreporting, we find, for instance, that women are less likely to overreport across all earnings quartiles. However, the influence of interviewer characteristics is negligible.
Non-Randomized Response Models: An Experimental Application of the Triangular Model as an Indirect Questioning Method for Sensitive Topics
Autor/in:
Erdmann, Anke
Quelle: Methods, data, analyses : a journal for quantitative methods and survey methodology (mda), 13 (2019) 1, S 139-167
Inhalt: When it comes to sensitive questions, data is often affected by bias due to non-response or effects of social desirability. Several methods have been introduced to eliminate answer bias by using randomization processes and probabilistic theory to obscure the respondent’s answer and create anonymity, thus facilitating honest answers. The probably most traditional method is the Randomized Response Technique by Warner (1965). However, this method is loaded with certain disadvantages. Therefore, in the last decade, newer methods were introduced that aim at balancing the disadvantages and weaknesses of previous methods, for instance, the non-randomized models Crosswise Model and Triangular Model (Yu et al. 2008) as well as the Parallel Model (Tian 2014). Although especially the Triangular Model is easy to implement in a study, there is only little empirical evidence on its application in different survey modes and populations. Further, it is to assume that certain questions are not equally sensitive for everybody due to specific personal characteristics. Thus, indirect questioning might not be effective in general but only for certain populations. The present study extends prior work on the Triangular Model by evaluating it for different subgroups. The conducted experiment asks for sensitive characteristics in the context of mental stress among students. The Triangular Model achieves significantly higher percentages than conventional direct questioning for illegal drug use among persons that answer socially desirable according to the characteristic of Self-Deception. For the other analyzed subgroups (Impression Management, gender, and depressiveness), the Triangular Model could not achieve higher prevalence rates compared to direct questioning on a sufficient probability level. But still, hard evidence on the effectiveness of indirect questioning models is thin and further critical discussion is needed.
Schlagwörter:Umfrageforschung; survey research; Datengewinnung; data capture; Datenqualität; data quality; Antwortverhalten; response behavior; soziale Erwünschtheit; social desirability; Anonymität; anonymity; psychische Gesundheit; mental health; Drogenkonsum; drug use; Triangular Model; Indirect Questioning; Survey Methodology; Non-Randomized Response
SSOAR Kategorie:Erhebungstechniken und Analysetechniken der Sozialwissenschaften
Using cultural and structural indicators to explain measurement noninvariance in gender role attitudes with multilevel structural equation modeling
Autor/in:
Seddig, Daniel; Lomazzi, Vera
Quelle: Social Science Research, (2019) 84
Inhalt: The current study explores the reasons for noninvariance of the measurements of gender role attitudes across countries. While previous studies have shown that noninvariance is a problem for comparative research and pointed out methods to alleviate the risks of drawing invalid conclusions, none has so far tried to explain why measurements of gender role attitudes are nonequivalent. Therefore, we use multilevel structural equation modeling to exploring measurement invariance and explain its absence. We use data assessing peoples' views on the specialization of roles by gender and the consequences of female employment on family's well-being from the International Social Survey Programme. We can replicate the findings from prior research indicating that scalar measurement invariance across countries is absent. Furthermore, we use two country-level variables to explain the noninvariance of particular items. The cultural value embeddedness explains noninvariance to a considerable degree while the Gender Inequality Index from the United Nations Development Programme does not. Therefore, we conclude that issues of comparability of gender role attitudes are related mainly to cultural rather than structural differences between countries.
Schlagwörter:Geschlechtsrolle; gender role; Einstellung; attitude; Messung; measurement; vergleichende Forschung; comparative research; Umfrageforschung; survey research; Datengewinnung; data capture; Datenqualität; data quality; Wertorientierung; value-orientation; kulturelle Faktoren; cultural factors; soziale Ungleichheit; social inequality; gender-specific factors; measurement noninvariance; multilevel structural equation modeling; cultural values; gender inequality; ISSP
SSOAR Kategorie:Erhebungstechniken und Analysetechniken der Sozialwissenschaften, Frauen- und Geschlechterforschung
Using Alignment Optimization to Test the Measurement Invariance of Gender Role Attitudes in 59 Countries
Autor/in:
Lomazzi, Vera
Quelle: Methods, data, analyses : a journal for quantitative methods and survey methodology (mda), 12 (2018) 1, S 77-103
Inhalt: Several repeated cross-national surveys include measurements of attitudes toward gender roles to investigate individuals’ beliefs regarding the appropriateness of men and women’s roles in a particular context. When used to compare attitudes across countries, these measurements reveal critical factors that could cause a lack of equivalence between different cultural contexts, and that could therefore produce misleading results. Nevertheless, the use of such measures to compare country means without assessing measurement equivalence is common. It should also be considered that the assessment of equivalence within a large-scale sample from cross-sectional surveys through multigroup confirmatory factor analysis (MGCFA) often fails because of the strict requirements necessary. The current article is used to assess the measurement equivalence of the gender role attitudes scale included in the last wave of the World Values Survey in 59 countries, with the main goal of identifying the most invariant model for the largest number of groups. The study involved comparing two methods belonging to the frequentist approach: MGCFA and the frequentist alignment procedure, a highly novel and promising method that is still rarely used. Using the first technique, partial scalar invariance was achieved for 27 countries. By employing the frequentist alignment optimization, an acceptable degree of noninvariance was achieved for 35 countries. Thus, the study confirmed the frequentist alignment procedure as a viable alternative to the MGCFA.
Dealing with Space and Place in Standard Survey Data
Autor/in:
Hillmert, Steffen; Hartung, Andreas; Weßling, Katarina
Quelle: Survey Research Methods, 11 (2017) 3, S 267-287
Inhalt: Heterogeneity of local conditions and spatial dependencies are typical aspects of sociological phenomena. However, large-scale empirical data is often rather limited with regard to the spatial references that are (publicly) available to researchers. We describe several aspects of the problem and assess possibilities and potential errors associated with limited information. Our examples are returns to education and gender-based and migration-related wage gaps as popular research topics. We base our analyses upon widely used survey data from Germany, the GSOEP, which contains geographical information on various levels of aggregation. Our particular interest is in the decisions that have to be made with regard to problems of space and place in standard surveys, available options and consequences. We conclude with a number of practical suggestions for data users.
Testing the Goodness of the EVS Gender Role Attitudes Scale
Titelübersetzung:Test de la qualité de l'échelle EVS d'attitude du rôle de genre
Autor/in:
Lomazzi, Vera
Quelle: Bulletin de Méthodologie Sociologique, (2017) 135, S 90-100
Inhalt: This study provides a critical evaluation of the gender role attitude scale included in the fourth wave of the European Values Study. The goodness of this scale is tested considering first of all its reliability and the stability of the factorial structure. The results suggest caution in the use of this instrument: the scale presents a deep variation in reliability across countries and its configuration is not stable, displaying several different factor structures from one country to another. In considering the source of this instability, this study addresses a priming effect due to questions introduced in 2008 immediately prior to the use of the gender role attitudes scale that modified the context of response.
Testing the Goodness of the EVS Gender Role Attitudes Scale
Titelübersetzung:Test de la qualité de l'échelle EVS d'attitude du rôle de genre
Autor/in:
Lomazzi, Vera
Quelle: Bulletin de Méthodologie Sociologique, (2017) 135, S 90-100
Inhalt: This study provides a critical evaluation of the gender role attitude scale included in the fourth wave of the European Values Study. The goodness of this scale is tested considering first of all its reliability and the stability of the factorial structure. The results suggest caution in the use of this instrument: the scale presents a deep variation in reliability across countries and its configuration is not stable, displaying several different factor structures from one country to another. In considering the source of this instability, this study addresses a priming effect due to questions introduced in 2008 immediately prior to the use of the gender role attitudes scale that modified the context of response.
How to weight survey data with a dyadic multi-actor design?
Autor/in:
Pasteels, Inge
Quelle: Survey Methods: Insights from the Field, (2015) , 11 S
Inhalt: This paper deals with adjustment for nonresponse in dyadic multi-actor survey designs. It presents a multi-dimensional approach to
weighting that addresses the various analytical units represented in such data, so that sampling design weights are correctly accounted
for and so that consistency between weights is achieved. This approach is demonstrated by using the primary respondents in the Divorce
in Flanders study, which is a typical example of a dyadic multi-actor design. Five sets of weighting coefficients are made available
whereby different subsets of data, according to different analytical units, are selected: the subset of the dyads, the subset of men and
women respectively, and two subsets of marriages. Post-stratification – with the year of marriage, status of the reference marriage at the
sampling date and five-year divorce cohort as auxiliary variables – was chosen as the weighting adjustment technique.
Schlagwörter:Gewichtung; weighting; Antwortverhalten; response behavior; Stichprobe; sample; soziale Schichtung; social stratification; Analyseverfahren; analysis procedure; Zufallsauswahl; random sample; Umfrageforschung; survey research
SSOAR Kategorie:Erhebungstechniken und Analysetechniken der Sozialwissenschaften
The impact of method bias on the cross-cultural comparability in face-to-face surveys among ethnic minorities
Autor/in:
Kappelhof, Joost W. S.
Quelle: Methods, data, analyses : a journal for quantitative methods and survey methodology (mda), 8 (2014) 1, S 79-118
Inhalt: "This article investigates the impact of several sources of method bias on the cross-cultural comparison of attitudes towards gender roles and family ties among non-Western minority ethnic groups. In particular, it investigates how interviewer effects, the use of an interviewer with a shared ethnic background, interview language, interviewer gender, gender matching, the presence of others during the interview and differences in socio-demographic sample composition of non-Western minority ethnic groups affect the cross-cultural comparison of attitudes towards gender roles and family ties between these groups. The data used in this study come from a large scale face-to face survey conducted among the four largest non-Western minority ethnic groups in The Netherlands for which Statistics Netherlands drew a random sample of named individuals from each of the four largest non-Western minority populations living in The Netherlands. Furthermore, methods are introduced to estimate the potential impact of method bias on cross cultural comparisons. The results show that measurement of both gender roles and family ties constructs are full scalar invariant across the different ethnic groups, but that observed differences in attitudes between ethnic groups especially towards gender roles are influenced by method bias. This in turn leads to biased comparisons between ethnic groups because of differences in the size of the various sources of method bias, the differential impact of the same method bias between ethnic groups and the combination thereof." (author's abstract)
Schlagwörter:ethnische Gruppe; ethnic group; Minderheit; minority; Befragung; survey; Interview; interview; Geschlechtsrolle; gender role; Familie; family; Niederlande; Netherlands; soziale Integration; social integration; kulturelle Integration; cultural integration; interkultureller Vergleich; intercultural comparison; Forschungsreaktivität; reactivity effect; Antwortverhalten; response behavior; Umfrageforschung; survey research; methods bias; non-Western ethnic minorities; incomparability of samples; multi group Mimic
SSOAR Kategorie:Erhebungstechniken und Analysetechniken der Sozialwissenschaften
Quelle: Politics and Governance, 1 (2013) 2, S 132-137
Inhalt: In this brief analysis, we use a new dataset of two million voter registration records to demonstrate that gender, race, and age do not correlate with political participation in the ways that previous research has shown. Among Blacks and Latinos, women participate at vastly higher rates than men; many Blacks participate at higher rates than Whites; and the relationship between age and participation is both not linear and varies by race and gender. Survey research is unable to capture the true relationship between demographics and participation on account of survey bias and, more importantly, the non-linearity of effects. As a result, theories of participation, like the dominant resources-based models, have been built on faulty premises and tested with inadequate data. Our evidence calls for a renewed effort to understand election participation by utilizing large datasets, by being attentive to linearity assumptions, and by returning to theory.
Schlagwörter:Daten; data; USA; United States of America; Wahl; election; gender; Wähler; voter; Umfrageforschung; survey research; Rasse; race; Alter; old age; Wahlbeteiligung; voter turnout; Demographie; demography
SSOAR Kategorie:Erhebungstechniken und Analysetechniken der Sozialwissenschaften, politische Willensbildung, politische Soziologie, politische Kultur