Programme for the International
Assessment of Adult Competencies

Chair:  Anouk Zabal (GESIS - Leibniz-Institute for the Social Sciences, Germany)

Abstract:  PIAAC collects internationally comparable data on key foundation skills as well as a wide range of background information, and it offers rich opportunities for both academic and policy-relevant research. The second cycle of PIAAC continues a tradition of international adult literacy surveys and pursues the dual aims of monitoring change over time as well as introducing necessary adjustments and innovations to reflect societal and technological change. This symposium addresses the challenge of striking the right balance between consistency and change.  The first contribution looks at how the theoretical frameworks for literacy and numeracy have been updated and enhanced for the second cycle of PIAAC, and how the cognitive instruments reflect the enriched constructs while maintaining the link to the first cycle. It will consider the reading components and the newly developed numeracy components, both designed to obtain more differentiated information at the lower end of the proficiency scale. Adaptive problem solving (APS) is a key skill in a rapidly changing world, and the assessment of this cognitive domain is an important innovation. The second contribution explores similarities and differences between the domain problem solving in technology-rich environments assessed in the first cycle of PIAAC and APS. It elaborates on the theoretical underpinnings of APS and discusses the challenges of operationalizing this construct for a large-scale assessment.  The information collected through the background questionnaire lends PIAAC its analytical power. The third contribution discusses how constructs and measurements from the cycle one background questionnaire have been adapted or transformed to account for societal change while considering the need to maintain trend measurement. It also reviews new constructs that have been included to broaden the scope and strengthen the analytical possibilities. A valid, reliable, and comparable measurement of educational attainment is key for PIAAC. At the same time, the measurement of formal education is one of the most challenging in the context of achieving comparability across cultures and time. The approach followed in the second cycle of PIAAC to tackle these complex issues is presented and reflected upon in the fourth contribution.

Contributions:

Measuring Literacy and Numeracy Skills in Adults – Trends and Innovations

Laura Halderman (Educational Testing Service/ETS, USA)

From Problem Solving in Technology-Rich Environments to Adaptive Problem Solving – Concept and Measurement

Samuel Greiff^* & Juliana Gottschling (University of Luxemburg, Luxemburg)

The Background Questionnaire: Maintaining Trend, Accounting for Societal Change, and Adding Innovative Elements

Tim Huijts (ROA, Maastricht University, The Netherlands)

Formal Education in PIAAC Cycle 2: Challenges and Opportunities

Silke Schneider (GESIS - Leibniz-Institute for the Social Sciences, Germany)

*Presenting Author

Chair:  Simon Wiederhold (Catholic University Eichstaett-Ingolstadt, Germany)

Abstract:  Analysis of the PIAAC data has shown the crucial importance of cognitive skills for individual success. Thus, there is a profound interest in the determinants of cognitive skills. The literature consistently argues that family background plays a key role in the formation of skills, leading to a strong persistence in educational achievement across generations. However, surprisingly little is known about which family characteristics actually matter for skill formation. The four studies combined in this symposium try to dig deeper into the determinants of cognitive skills. Some of the questions addressed in the symposium are: How strong is the correlation of cognitive skills of parents and their children, and what are the mechanisms that give rise to the intergenerational persistence of skills? How important is the transmission of cultural values from parents to children as a determinant of cognitive skills? Finally, can policies substituting for lacking family support be successful in helping disadvantaged children to improve their skills?

Contributions:

The Intergenerational Transmission of Skills

Eric A. Hanushek¹, Babs Jacobs², Guido Schwerdt^3*, Rolf van der Velden² & Simon Wiederhold⁴

(¹Hoover Institution, Stanford University, USA; ²ROA, Maastricht University, The Netherlands; ³University of Konstanz, Germany; ⁴Catholic University Eichstaett-Ingolstadt, Germany)

Can Mentoring Alleviate Family Disadvantage in Adolescence? A Field Experiment to Improve Labor-Market Prospects

Sven Resnjanskij¹, Jens Ruhose², Simon Wiederhold³ & Ludger Woessmann^1*

(¹ifo Institute, Germany; ²University of Kiel, Germany; ³Catholic University Eichstaett-Ingolstadt, Germany)

Culture and Student Achievement: The Intertwined Roles of Patience and Risk-Taking

Eric A. Hanushek¹*, Lavinia Kinne², Philipp Lergetporer² & Ludger Woessmann²

(¹Hoover Institution, Stanford University, USA; ²ifo Institute, Germany)

Individualism, Human Capital Formation, and Labor Market Outcomes

Katharina Hartinger¹, Sven Resnjanskij², Jens Ruhose³ &  Simon Wiederhold¹*

(¹Catholic University Eichstaett-Ingolstadt, Germany; ²ifo Institute, Germany; ³University of Kiel, Germany)

*Presenting Author

Chair:  Julia Gorges (Philipps-University Marburg, Germany)

Abstract:  The OECD PIAAC study provides in-depth information regarding adult   competencies in a wide range of countries. Hence, some refer to PIAAC as “PISA for adults”. However, PIAAC is more than that. Thanks to its references to research from different disciplines and to different data sources, PIAAC has stimulated much research beyond adult competencies. Using data from the PIAAC background questionnaire, researchers have tested established assumptions on adult learning, investigated participation in education, and used national longitudinal extensions of the PIAAC study and other related data sources. This symposium brings together research beyond competencies from different disciplinary perspectives using a wide range of datasets. Using cross-sectional data from the first PIAAC data collection in 2012, MASSING explores the importance of participation in non-formal training in order to upgrade or to maintain skills among migrants in selected countries. In particular, this contribution will focus on how different policies in different countries might affect training participation and barriers to training. Drawing on data from the 1994–1998 International Adult Literacy Survey, the 2003-2008 Adult Literacy and Life Skills and the 2011-2012 OECD Survey of Adult Skills, MERONI focuses on overeducation and skill   mismatch in different age cohorts and different countries. To identify skill mismatch and overeducation, this contribution looks at both skills and educational credentials. The contribution by HESSE uses the German longitudinal extension of PIAAC to investigate the role of motivation to learn and parenthood for participation in non-job-related training. The study provides insights into the neglected concept of adult motivation to learn. Using another longitudinal extension of PIAAC, ROESSGEN’s contribution investigated the benefits of earning a bachelor’s degree for adults based on U.S. PIAAC 2012 and 2017 data. To overcome bias introduced to previous studies by comparing students and non-students, these analyses   will focus on adults who have been to college but left with versus without earning a degree.  Each contribution takes a specific disciplinary perspective: sociology (MASSING), economics (MERONI), psychology (HESSE), and educational research (ROESSGEN). In this interdisciplinary symposium, disciplinary priorities and major topics building on PIAAC data will be highlighted and discussed.

Contributions:

Training Participation of Migrants and Barriers to Training – A Cross-Country Comparison

Natascha Massing (GESIS - Leibniz-Institute for the Social Sciences, Germany)

An Age-Period-Cohort Approach to the Incidence and Evolution of Overeducation and Skills Mismatch

Elena Meroni (European Commission, DG Joint Research Centre)

How Compatible are Parenthood and Participation in Further Education and Training? Findings from the German PIAAC Longitudinal Study

Franzisca Hesse^* & Julia Gorges (Philipps-University Marburg, Germany)

The Power of Retaining Late Bloomers: Comparing Five-Year – Outcomes of Bachelor’s Degree Completers and Non-Completers in U.S. Colleges and Universities

Kevin M. Roessgen (University of Arkansas, USA)

*Presenting Author

Chair:  Débora B. Maehler (GESIS - Leibniz-Institute for the Social Sciences, Germany)

Abstract:  The symposium addresses content and methodological issues and aims to present research based on PIAAC data linked to administrative data or other large-scale country surveys. Thereby projects and studies of four countries will be presented. Initially research based on PIAAC 2011/2012 linked to register data in Norway will be presented (N = 901). The relationship between skills acquired before the age of 16 years versus those acquired later to formation of skills and subsequent NEET status, were addressed in the study. The second contribution is based on the PISA Young Adult Follow-Up Study (PISA YAFS) conducted in the US. Study design and results comparing for instance literacy from students in PISA 2012 and in the follow up 2016 using PIAAC instruments, assessed as repeated measure, will be presented (N = 2.320). The third contribution integrates PIAAC data linking to PISA data as well as to administrative data. Study design and research based on linking PISA 2000, PIAAC 2011/2012 and register data in Denmark will be presented (N =1.210). In this case the PIAAC sample is a sub-sample of the PISA 2000 sample. The contribution focuses on the relationship of cognitive and non-cognitive skills to earnings and employment rate across time.  Finally, the fourth contribution covers the linkage of administrative data with four large-scale assessments in Germany. Following surveys were linked to administrative data of the Institute for Employment Research (IAB): the PIAAC-L (PIAAC Longitudinal; N = 2086), the NEPS (The German National Educational Panel Study, Starting Cohort 6 (SC6); N = 12.621), the SOEP (Socio-Economic Panel; N = 11.500) and the PASS (Panel Study Labour Market and Social Security; N = 30.212). This methodological contribution aims to compare measurement errors for employment related indicators across these surveys.

Contributions:

NEET Status and Early versus Later Skills Among Young Adults: Evidence from Linked Register-PIAAC Data (using Nordic PIAAC Data)

Erling Barth¹, Anna-Lena Keute²*, Pål Schøne¹, Kristine von Simson¹ & Kjartan Steffensen²

(¹Institute for Social Research, Norway; ²Statistics Norway, Norway)

Administering Education and Skills Online (ESO) to PISA 2012 Cohort in the United States: Findings from the 2012-2016 PISA Young Adult Follow-up Study (using PISA YAFS)

Saida Mamedova¹*, Maria Stephens¹, Yuqi Liao¹, Josh Sennett¹, Paul Sirma¹ & Samantha Burg²

(¹American Institutes for Research/AIR, USA; ²National Center for Education Statistics, USA)

Childhood and Adulthood Skill Acquisition - Importance for Labor Market Outcomes (Danish PISA PIAAC Data)

Karl Fritjof Krassel¹* & Kenneth Lykke Sørensen²

(¹VIVE/The Danish Center for Social Science Research, Denmark; ²The National Board of Social Services, Denmark)

Validating Measures of Employment Related Information in Surveys Using Linked Administrative Data in Germany (using PIAAC-L/ NEPS/ PASS/ SOEP/ IAB Data)

Manfred Antoni¹*, Nadine Bachbauer¹, Corina Frodermann¹, Knut Wenzig² & Débora B. Maehler³

(¹Institute for Employment Research/ IAB, Germany; ²German Institute for Economic Research/ DIW, Germany; ³GESIS - Leibniz-Institute for the Social Sciences, Germany)

*Presenting Author

Chair:  Martin Ehlert (WZB Berlin Social Science Center, Germany)

Abstract:  Learning during adulthood after initial education and training is a widespread and growing phenomenon in many countries. Especially the increasing pace of technological change and digitalization is likely to further fuel this trend. New technology has the potential to change the labor market as well as many other aspects of life. The result is that skills acquired during initial training no longer suffice to remain employable and to participate in social life. Therefore, skill acquisition later in life becomes more important to ensure that nobody is left behind. Therefore, many politicians and pundits advocate lifelong learning to ensure inclusive growth despite the challenges of digitalization. Yet, it is not clear whether current adult education and training programs and systems are capable to counteract the negative repercussions of digitalization. It is well known that access to adult training and education is unequally distributed. Less-educated and less-skilled people participate less often in training courses and other learning activities. Also, workers that are more likely to lose their jobs because of technological change are less likely to take part in learning opportunities. Thus, adult education and training programs often do not reach those most in need of skill acquisition later in life. At the same time, the benefits of existing learning arrangements for adults are often unclear. Many studies show that participation in further training courses does not lead to higher skills or better jobs. Against this background, this symposium aims to advance the knowledge on lifelong learning and cognitive skills. Based on new empirical results, we will discuss both the determinants of participation in lifelong learning and its effect on the development of cognitive skills. Also, we will discuss the acquisition and development of skills over the life course more generally. A special focus will be on cross-national comparative studies. Using results on participation and skill acquisition from different countries, we aim to assess the influence of institutions such as adult education and training policies. Furthermore, we will especially discuss lifelong learning among the most vulnerable groups such as less-skilled workers.

Contributions:

Does Learning Help Workers to Keep up with Technological Change? Cross-National Variance in the Effect of Further Training on Problem-Solving Skills.

Martin Ehlert^1*, Marie-Christine Fregin², Didier Fouarge², Mark Levels², Liisa Martma³ & Rolf van der Velden²

(¹WZB Berlin Social Science Center, Germany; ²ROA, Maastricht University, The Netherlands; ³ Tallinn University, Estonia)

Skills and Education as Factors of Participation in Non-Formal Learning

Liisa Martma* & Ellu Saar (Tallinn University, Estonia)

Cross-National Variation in the Training Disadvantage of Less-Educated Employees: The Role of Job Allocation versus Akills

Carla Hornberg*, Heike Solga & Jan Paul Heisig (WZB Berlin Social Science Center, Germany)

*Presenting Author

Chair:  Frank Goldhammer, Ulf Kröhne & Carolin Hahnel 

(DIPF | Leibniz Institute for Research and Information in Education, Germany)

Abstract:  The first round of the PIAAC study 2011–2012 was innovative in many ways. It was not only the first international large-scale assessment to be mainly computer-based, but it was also the first large-scale assessment that systematically collected log data, that is, events, event-related attributes, and timestamps reflecting the test taker’s interactions with the PIAAC assessment system. Log data found their way into the public use file in the form of generic process indicators such as time on task or number of interactions by item. Moreover, the majority of countries participating in PIAAC round one provided their log data that was recorded during the computer-based assessment to make it publicly available to the research community. Together with the result data and the data from the background questionnaire, the PIAAC log data already has inspired intensive research activities (for an overview see Goldhammer et al., 2020).  In this invited symposium, we have brought together four recent contributions dealing with PIAAC process data from different – both substantive and methodological – perspectives. The first presentation by Pokropek and colleagues addresses the question of how process data can be used to explore gender differences in literacy as assessed in PIAAC and PISA. The following contribution by Hahnel and colleagues investigates strategies of information processing in simulated web search environments included in the PIAAC assessment of problem solving in technology-rich environments. The third presentation by He and colleagues focuses on evaluating consistency of adult behavioral patterns across multiple problem solving tasks using PIAAC process data from the US. The final presentation by Maddox and Care expands the perspective in that it takes into account not only PIAAC log data, but other sources of (multimodal) process data such as verbal interaction, facial expressions and gesture.

Contributions:

Utilizing Process Data to Examine Gender Differences in Literacy in PISA and PIAAC.

Artur Pokropek^1*, Francesca Borgonovi², & Lale Khorramdel³

(¹Institute of Philosophy and Sociology of the Polish Academy of Sciences, Poland; ²University College London, UK, and OECD, France; ³ Boston College, USA)

Identifying Strategies of Information Processing in PIAAC Web Search Environments

Carolin Hahnel^*, Frank Goldhammer, & Ulf Kroehne (DIPF | Leibniz Institute for Research and Information in Education, Germany,)

Evaluating Consistency of Adult Problem-Solving Behaviors across Multiple Tasks Using PIAAC Process Data

Qiwei He^1*, Dandan Liao², Hok Kan Ling³, & Hong Jiao⁴

(¹Educational Testing Service, USA; ²Cambium Assessment, Inc, USA; ³ Queen’s University, Canada; ⁴ University of Maryland, USA)

Multimodal Process Data in PIAAC

Bryan Maddox^1* & Naomi Care²

(¹University of East Anglia & CEMO, University of Oslo, Norway; ²Assessment Micro-Analytics Ltd, UK)

*Presenting Author