Presentations from the PIAAC Conference 2025
Special Adress
Andreas Schleicher: Skills vs. Qualifications – Insights from the Survey of Adult Skill
The new PIAAC data shows that skills are central to employment, income, social participation and individual well-being. Yet many countries face stagnating or declining skill levels and rising inequalities. To meet the digital and green transitions and demographic change, we must improve how skills are developed, recognised and aligned with labour-market needs. The challenge for governments and social partners is to design education, training systems and workplaces that are fit for this task.
Invited Symposium I: A Closer Look at the PIAAC 2023 Skills
Laura Halderman: PIAAC Skills: Beyond Percentages and League Tables
By now, people all over the world have heard PIAAC results reported in terms of the percentage of adults at Level 1 or below or the countries with the highest or lowest scores. But what are the PIAAC skills that are reported in such broad strokes and how were they developed? This presentation will focus on the development process starting with the frameworks, how the frameworks informed item development and how they eventually supported the descriptions of proficiency at each level. It will also touch on the history of how Literacy and Numeracy skills have been measured in the adult population and speculate about how these foundational skills might be measured in the future. It will conclude with a general discussion on how PIAAC data and the proficiency descriptions can move us beyond “X% of adults score at Level 1 and below” to turn this into interventions aimed at improving adults’ skills. Following this presentation, chairs from each of the subject matter expert groups for PIAAC Cycle 2 will present information on their respective domains. They will provide deeper insights into how the PIAAC skills of Literacy, Numeracy and Adaptive Problem Solving can be better understood and translated into action.
Jean-François Rouet: What It Takes for an Adult to Be a Skilled Reader: Interpreting Literacy Proficiency Levels in PIAAC Cycle 2
The second cycle of the PIAAC has evidenced a wide distribution of literacy skills in the adult population. Among the OECD countries, 26% of adults were found to be at or below Level 1, whereas 11.7% were at level 4 or above level 4 (OECD, 2024). Literacy skills play a fundamental role in people’s personal, social and professional lives. Low literate adults are more likely to experience issues ranging from poorer health to unemployment to vulnerability to misinformation. Beyond the quantitative scale, the PIAAC study provides a wealth of qualitative data regarding what people can and can’t do at various levels. A close examination of that data is helpful in understanding why some literacy tasks are harder than others. Such an understanding may serve as a basis for a range of interventions, from the simplification of public administration documents to interventions aimed at improving adult’s skills. Members of the PIAAC literacy expert group conducted an exhaustive analysis of the 80 items that made up the assessment materials of the literacy domain (Kirsch et al., 2025). We iteratively developed a 9-criterion scoring rubric that characterizes features of the items that may drive difficulty. We found that some of the criteria had to do with the texts (e.g., length, intrinsic difficulty), with the questions (e.g., complexity of the question stem or difficult response mode) or, importantly, with the interaction between questions and texts. We characterized progress across levels of the scale as the ability for readers to handle increased difficulty with each of these features. A linear combination of the analytic criteria provided an accurate prediction of the items’ actual difficulty level. Difficulties and the ability to overcome them may be interpreted in reference to cognitive and language skills, some of which are amenable to education. In addition, the analytic description of literacy skills may support a range of applications, from test development to instructional interventions as part of initial or adult education programs.
Dave Tout: Don’t Ignore Numeracy. Why Research and Policies Focused on Numeracy Are Critical for Life and Work in the Digital Age
Based on the numeracy framework, its assessment and the data from the OECD’s Program for the International Assessment of Adult Competencies (PIAAC) Cycle 2, this presentation will share and pose a range of different issues and questions that need to be addressed and researched explicitly about numeracy. The presentation will show how the new numeracy assessment framework and content for Cycle 2 elaborates an innovative and comprehensive view of numeracy relevant to life and work in the digital age, with its big data, technologies, automation and AI. Numeracy in PIAAC Cycle 2 provides new information about adult’s maths and numeracy skills across the full spectrum of the PIAAC proficiency scale, especially at the bottom end from the new Numeracy Components. The issues are relevant to youth and adult education and training, workplaces and to the development of appropriate government policies and programs.
Samuel Greiff: Numeracy, Literacy, and What Else? Adaptive Problem Solving in the 2nd Cycle of PIAAC
In today’s rapidly changing world, the ability to deal with dynamic problem situations has become increasingly important. The second cycle of PIAAC introduces the assessment of Adaptive Problem Solving (APS), which builds on and extends the concept of problem solving in technology-rich environments (PS-TRE) from the first cycle of PIAAC. APS focuses on individuals’ ability to monitor and adapt their strategies in response to changing demands and new information, drawing on both cognitive and metacognitive processes. This presentation outlines the theoretical framework underlying APS, illustrates key item types, and discusses methodological challenges in assessing complex skills such as APS. We will present national and international results from the second cycle of PIAAC, highlighting variations across countries with a focus on the German context. Furthermore, we will reflect on the political and practical implications of the findings and explore what APS can reveal beyond measures of literacy and numeracy, particularly in terms of adult adaptability, resilience, and preparedness for future learning and work.
Invited Symposium II: Exploring Adult Competencies in a Digital World: Insights from PIAAC
Raija Hämäläinen: Understanding Adult Problem-Solving Skills through PIAAC: Insights from VET, HE, and Lifelong Learning
In this first presentation of the symposium, we illustrate findings from a series of studies based on the first cycle of the PIAAC, focusing on adults’ problem-solving skills in technology rich environments (TRE). Our presentation begins with an examination of vocational education and training (VET) adults, where European-level analyses revealed considerable variation in digital problem-solving performance across countries (Hämäläinen et al., 2014). We illustrate how these differences are shaped by national systems and learning contexts. A more detailed analysis conducted in Finland helps explain this variation by identifying key factors such as educational background, exposure to workplace technologies, and integration of digital tools into learning (Hämäläinen et al., 2015). Building on these results, our presentation explores the characteristics of high-performing adults in PIAAC, highlighting the role of cognitive strategies, self-regulation, and motivation (Hämäläinen et al., 2017). We then extend our focus to higher education (HE) adults in Europe, examining how formal education, learning pathways, and access to digital environments contribute to problem solving competence (Hämäläinen et al., 2019). Our findings emphasize the importance of both formal and informal learning settings in supporting these skills (Nygren et al., 2019). In the next phase, we broaden the perspective to include lifelong learning, illustrating how formal, non-formal, and informal learning experiences throughout adulthood are linked to adults’ ability to solve problems in TRE contexts. Most recently, we turn our attention to teachers using both PIAAC and TALIS data to investigate educators’ problem-solving skills as well as their technology-related knowledge, attitudes, and professional development needs. These findings underline the importance of continuous support for teachers, who act as both users and facilitators of digital competence (De Wever et. al., 2023; Hämäläinen et al., 2021).
Astrid Parmentier: Unequal Participation in Lifelong Learning: Patterns, Barriers, and Opportunities
In an era of rapid digitalisation and automation, strong cognitive skills are essential for individuals to adapt to technological changes. Lifelong learning plays a crucial role in maintaining and enhancing these skills. While initial education lays the foundation for essential skills, lifelong learning is crucial for equipping individuals with the skills needed to keep pace with evolving technologies. However, not all adults have equal opportunities to participate. Using data from the Programme for the International Assessment of Adult Competencies (PIAAC), this study examines the socio-demographic patterns of participation in lifelong learning in Flanders. Our analysis distinguishes between formal, non-formal, and informal learning (Boeren, 2016). Results confirm that participation in all three forms is positively associated with literacy skill scores (Van Nieuwenhove et al., 2025). The relationship between participation in lifelong learning and adult literacy suggests that engaging in training activities can be a key factor in keeping adults’ skills up to date in a changing society. We explore which socio-demographic groups are more or less likely to engage in lifelong learning and identify barriers influencing participation. Findings indicate that older adults, less educated adults, adults with a migrant background and adults out of labour force participate less frequently in non-formal training activities (Van Nieuwenhove et al., 2025). The most frequently mentioned barriers to (further) participation in non-formal learning were work obligations, followed by family responsibilities and constraints related to the time and location of the course. Identifying these participation gaps and barriers is essential for designing targeted policies that enhance access to lifelong learning and ensure equitable skill development. Without such efforts, digital transformations risk reinforcing existing inequalities. This study contributes to the discussion on lifelong learning by providing empirical evidence on its accessibility across different socio-demographic groups, emphasising the importance of policies that support skill development for all.
Invited Symposium III: Cognitive Skills & Economic Outcomes
Guido Schwerdt & Simon Wiederhold: The Returns of Returns to Skills
Understanding how the labour market rewards cognitive skills over time is central to evaluating the economic role of human capital. While previous research has shown that cognitive skills are strongly associated with earnings, much less is known about how these returns have evolved across countries during a period of profound technological, demographic, and institutional change. This paper combines data from the first two cycles of the Programme for the International Assessment of Adult Competencies (PIAAC) to provide a systematic cross-country analysis of changes in the returns to cognitive skills between approximately 2012 and 2023. Using harmonized measures of literacy and numeracy skills, we estimate skill returns in a comparable framework across countries and over time, accounting for potential shifts in workforce composition and earnings structures. Preliminary results indicate that, on average, returns to cognitive skills have declined across countries. However, we find striking heterogeneity: in some countries, returns have fallen sharply, while in others they have remained stable or even increased. We explore potential explanations for this variation, including differences in labour market institutions, educational expansion, and patterns of technological adoption. By providing the first internationally comparable evidence on changes in the economic value of cognitive skills over time, this paper contributes to a deeper understanding of the evolving role of human capital in modern labour markets.
Eric A. Hanushek: Age and Cognitive Skills: Use It or Lose It
Cross-sectional age-skill profiles suggest that workers’ cognitive skills start declining by their thirties if not earlier. If accurate, such age-driven skill losses pose a major threat to the human capital of societies with rapidly aging populations. We estimate actual age-skill profiles from individual changes in skills at different ages. We use the unique German longitudinal component of the Programme of the International Assessment of Adult Competencies (PIAAC-L) that retested a large representative sample of adults after 3.5 years. Two main results emerge. First, correcting for measurement error, average skills increase into the forties before decreasing slightly in literacy and more strongly in numeracy. Second, skills decline at older ages only for those with below-average skill usage. White-collar and higher-educated workers with above-average usage show increasing skills even beyond their forties. Women have larger skill losses at older age, particularly in numeracy.
Lennart Goldemann: Class Gaps Around the World
While modern industrial societies emphasize meritocratic ideals, recent evidence points to a decline in social mobility, with parental social class increasingly shaping individual outcomes. Using data from the Programme for the International Assessment of Adult Competencies (PIAAC), we examine social class disparities in earnings, educational attainment, and cognitive skills across 39 countries within a unified and comparable framework. We document substantial class penalties in all countries, with particularly large gaps in Latin America and Southern Europe, and smaller gaps in Northern Europe. Even after controlling for cognitive skills, significant earnings gaps by social class remain, suggesting that labour market mechanisms beyond human capital contribute to persistent inequalities. Moreover, class penalties are evident even among tertiary-educated individuals. Ongoing analyses explore how country-specific factors correlate with the magnitude of these penalties and decompose the disparities into components related to education, skills, and their returns.
Lavinia Kinne: Child Penalties in Labour Market Skills
Child penalties in labour market outcomes are well-documented: after childbirth, mothers’ employment and earnings drop persistently compared to fathers. In addition to gender norms, a potential driver could be the loss in labour market skills due to mothers’ longer employment interruptions. This paper estimates child penalties in adult cognitive skills by adapting the pseudo- panel approach to a single cross-section of 29 countries in the PIAAC dataset. We find a persistent drop in numeracy skills after childbirth for both parents between 0.13 (short-run) and 0.16 standard deviations (long-run), but no statistically significant difference between mothers and fathers. Estimates of child penalties in skills strongly depend on controlling for pre-determined characteristics, especially education. Additionally, there is no evidence for worse occupational skill matches for mothers after childbirth. Our findings suggest that changes in general labour market skills cannot explain child penalties in labour market outcomes, and that a cross-sectional estimation of child penalties can be sensitive to characteristics of the outcome variable.
Invited Symposium IV: Cognitive Skills & Personality
Matthias Roth: Revisiting Gender Differences in Personality: New Evidence on Big Five Domains and Facets with Large-Scale Samples from 27 Nations
Numerous studies have documented gender differences in self-reported personality, suggesting that women score higher than men, particularly on the Big Five domains of Agreeableness and Neuroticism. Previous studies also indicate that gender differences can vary across facets of the same personality domain. Findings regarding the cross-cultural generalizability of – or systematic cultural variations in – these gender differences are inconclusive. This has been attributed to methodological differences in the samples and the questionnaire adaptations. We therefore systematically investigated gender differences in scores on the Big Five domains in 27 countries based on comprehensive samples representative of the respective adult populations (total N = 143,313) and on questionnaires adapted using consistent translation methodology. Results revealed gender differences in all domains except Extraversion. The most pronounced differences emerged for Neuroticism and Agreeableness, with effects of .40 and .35, respectively. These differences varied in magnitude across countries and were more pronounced in more individualistic countries. Investigating gender differences in scores on 15 more-specific, facet-level traits in a subset of countries, we found that typically one facet per domain showed the most substantial gender differences. For example, women scored higher than men on all facets of Neuroticism and Agreeableness, but primarily on Anxiety and Compassion, respectively.
Beatrice Rammstedt: Cross-Cultural Variations in the Association of the Big Five and Cognitive Skills
The associations of cognitive abilities and personality have been studied intensively showing (a) that both constructs show only small correlations and (b) that these correlations are typically clearest for Openness and Emotional Stability. Even though the body of studies investigating these interrelations is vast, it faces two major limitations: (1) Most studies in this field were based on highly selective samples. (2) Nearly all studies are focused on one culture only. We address these two limitations by investigating the association between personality and cognitive ability based on comprehensive and population representative data sets from 27 countries worldwide (total N of approx. 150,000). Aggregated across these countries results widely support previous findings with regard to the amount of explained variance and the differential findings for the Big Five domains. Results however also clearly showed strong country variations in the amount of variance the Big Five explained in cognitive skills.
Brent W. Roberts: Perseverance, a Measure of Conscientiousness, is a Valid Predictor of Achievement and Truancy Across the Globe
Is Conscientiousness a useful construct across cultures? Using the 2012 Program for International Student Assessment data, we examined whether perseverance, a measure of Conscientiousness, was related to achievement and truancy across 62 countries/regions (N > 470,000). We investigated whether these relationships were linear or curvilinear in nature and assessed the utility of item-level information. After establishing partial metric invariance of the perseverance measure across various countries/regions and cultural regions, our findings unveiled that perseverance consistently predicted both math achievement and truancy, with predominantly linear associations. Notably, among the five items of the Perseverance scale, the item reflecting one’s tendency to give up easily in the face of challenges emerged as the strongest and most consistent predictor of math achievement. Further, country-level correlations between perseverance and both math achievement and truancy displayed contradictory patterns compared to individual-level correlations, suggesting the presence of biasing factors in how people respond to these measures. Nonetheless, it appears reasonable to conclude that measures of Conscientiousness are pan-cultural predictors of achievement and truancy.
Invited Symposium V: Adults with Low Literacy and Numeracy Skills? A 21st Century Approach
Saida Mamedova: Adults with Low Skills – Who Are They Now?
Understanding who low-literate adults are, using representative sources of information, is fundamental for unbiased and effective policy making and programs designed for adults with weak literacy skills (Grotlueschen et al., 2016). With the most recent data from the Program for the International Assessment of Adult Competencies (PIAAC), we can examine not only the current characteristics of these adults but also how the social, economic and demographic characteristics of adults with low literacy or numeracy have changed from 2012 to 2023. First, using PIAAC 2023 data, we will compare Austria, Canada, England (UK), France, Germany, Israel, and the USA on education and training, employment and other background characteristics. The characteristics will include highest education level completed, participation in formal education in the last year, participation in (non-formal) training activities, employment status, gender, immigrant background, and parental education for adults with low literacy in these countries. Next, we will examine how these characteristics of adults with low literacy skills have changed over time. For example, while the share of adults with low proficiency increased in Austria, France, Israel and the USA (OECD 2024), this group may have not changed in the composition of those that participate in employment or non-formal training activities. Although not connected directly to the policy and practices of adult skills formation, the changes (or lack of thereof) in characteristics of this group may serve as a clue to which segment of the population may need more attention and resources than they have been getting.
Francesca Borgonovi: Testing Gains or Testing Fatigue? Accuracy Trajectories Among Low-Educated Adults in the PIAAC Assessment
The probability of successfully answering a question in a cognitive assessment tends to depend on the position of the question within the assessment. Item position effects have often been found to be negative, meaning that response accuracy decreases over the course of the assessment. Recent research has interpreted item position effects in low-stakes international large-scale assessments as proxies of test engagement and motivation and of test takers’ endurance and persistence, whereby steeper declines in performance are considered as indicators of loss of motivation or depletion of perseverance and endurance. Much of the existing literature on item position effects is however based on analyses of school-aged children, and item position effects among adult test takers remain underexamined. Contrary to students, who regularly undergo testing in both low-stakes and high-stakes situations, most adults have had little or no exposure to protracted, computer-based assessments since leaving school. Low-educated adults may also hold negative attitudes towards tests from previous negative academic experiences These factors raise questions on how adults with low levels of educational attainment engage with low-stake assessments such as PIAAC. We use data from the second cycle of PIAAC to examine if adults with low levels of formal educational attainment learn to navigate digital tasks through real time practice – resulting in increasing accuracy over the course of the assessment – or if instead fatigue prevails, resulting in a decline in performance. Identification of item position effects relies on the random variation in item position induced by the design of the assessment. By focusing our analyses on the subset of items that have low levels of difficulty, we consider items that are within the scope of test-takers’ underlying ability potential. Incorporating timing information into the analysis allows us to track both overall accuracy and efficiency (performance per unit of time spent on the task).
Anke Grotlüschen: MEDIAAC – The Media Response to the Program for the International Assessment of Adult Competencies (PIAAC)
When the second wave of PIAAC was released in 2016, Hamilton started a media analysis about the ways ideas travel through data (Hamilton, 2018). Hamilton applied actor-network theory and showed the powerful influence of OECD’s country notes on national discourses. A similar approach was used by Caldéron et al. for Chile and Peru (2024). This time, we collected media responses of selected countries after the PIAAC launch. The data collection covers the initial press statements by OECD and the ministries, articles in major printed and online journals, media communication by key institutes, and a substantial part of social media entries on LinkedIn and Bluesky. The corpus is collected over six weeks and imported into the MaxQDA software. A discourse analysis was applied to identify key themes and “problems”. The leading questions for the discourse analysis stem from the WPR-Approach (Bacchi, 2012). The first findings of the data collection show that some countries point to their stability regarding skills. Regarding scientific statements, concerns about low literacy skills dominate the discussion, with numeracy and problem solving being understood as less concerning.
Invited Symposium VI: From PISA to PIAAC – Understanding Skill Development from Adolescence to Adulthood
Laura Halderman: Methodological Considerations for PISA and PIAAC Comparisons
The PIAAC Cycle 2 frameworks for Literacy and Numeracy were developed with the PISA 2018 Reading and PISA 2022 Mathematics frameworks in mind and made explicit connections where possible. With the recent release of PIAAC Cycle 2 data, the similarities between PISA and PIAAC within these two domains are greater now than they have ever been before. However, there are methodological differences between PISA and PIAAC that should be considered before making data-based comparisons. This presentation will describe some of the operational similarities and differences between PISA and PIAAC administrations ranging from the presentation of the stimuli and to the setting of the data collections. For example, the screen layout, item types, organization of stimulus materials and the general development process share many commonalities that create a comparable test-taker experience. By contrast, the one-on-one, interviewer-based data collection in PIAAC versus the group, school-based administration in PISA could result in motivational differences between the two samples. The order of the background questionnaire and the direct assessment differs across the two surveys which could also differentially affect test-takers. These kinds of methodological similarities and differences and their potential impacts on cross-survey comparisons will be discussed.
Nathanael Reinertsen: OECD Literacy Assessments Across the Lifetime: An Examination of the Coherence of the PIAAC Literacy, PISA Reading Literacy, and IELS Emergent Literacy Assessment Constructs
This paper explores the conceptual similarities and differences between the approaches to assessing literacy in the Survey of Adult Skills (PIAAC), reading literacy in PISA, and emergent literacy in the International Early Learning and Childhood Well-being Study (IELS). The paper aims to explore the extent to which the OECD has presented a cohesive approach to literacy assessment that spans from early childhood through adulthood, within the context of significant changes in reading practices driven by technological change. While a detailed comparison has been conducted for PIAAC adult numeracy and PISA mathematical literacy (Gal and Tout, 2014), no such comparison has been published for adult literacy and reading literacy. However, several OECD publications provide summary tables illustrating similarities and differences in the definitions and structures of the PISA and PIAAC assessment domains. Synthesising these summaries and other OECD material, this paper traces the developments and changes in the Reading/Literacy assessment frameworks of PISA and PIAAC across their multiple cycles. It posits and then compares and contrasts the directions in which these programmes appear to be moving in their assessment of these domains and examines whether there is convergence or divergence in their developmental trajectories. Additionally, the paper includes a summary of how Emergent Literacy is conceptualised in IELS (across its two cycles) and considers the extent to which there is conceptual continuity across the three programmes. The paper ends with a discussion of whether it is possible to understand these frameworks in a more unified way, as presenting an approach to understanding literacy across the lifespan, while noting several important limitations around what can be validly and practically compared. It also considers whether the developmental trajectories of the assessment frameworks are likely to continue in the same direction in the face of further anticipated technological changes.
Invited Symposium VII: Basic Skills for Life: Exploring Literacy, Digital Proficiency, and Well-Being
Takashi Yamashita: Digital Life Management Skills Among Middle-Aged Adults in the United States
In modern technology-rich societies, digital life management digital skills, such as paying bills, checking health information, and navigating appointments online, are essential across adult life stages. In particular, considering age-related physical decline and functional limitations in later adult life, individuals must acquire and maintain sufficient digital life management skills before entering older age, often seen as 65 years and older. However, on average, middle-aged and older adults tend to have lower digital skills and be more digitally divided than their younger counterparts. Indeed, practice engagement theory emphasizes the importance of continuous skill use to maintain and enhance one’s foundational skills over time. Ensuring sufficient digital life management skills in middle age is crucial in terms of the needs of subsequent older age and independence in later life. Therefore, the current study examined the associations between the PIAAC digital problem solving (ADPS) skills and their use in mid-life life management. Dates are obtained from a nationally representative sample (50 years and older; n = 1,203) drawn from the 2023 U.S. Program for the International Assessment of Adult Competencies (PIAAC. PIAAC provides ADPS skill assessment data based on the simulation of common life situations (e.g., planning a grocery shopping and business meeting using the digital map). The ADPS skill proficiency score (0-500 points) was regressed on the use for life management tasks and individual characteristics (e.g., age, sex, education, employment). Results showed that middle-aged adults with higher ADPS skills are more likely to use their ADPS skills for a variety of life management tasks than their counterparts. Differing proficiency and utilization rates of ADPS in the everyday life domains in middle age may result in greater digital divide or unequal access to useful digital technology and services in later life, and in turn, deteriorate health and well-being disparities in older age. More detailed theoretical explanations and policy implications are evaluated.
Elizabeth L. Tighe: Demographic and Skills-Use Predictors of Literacy Performance Among U.S. Adults with Lower Skills
U.S. adults who struggle with reading are heterogeneous with respect to many different demographic characteristics, such as age, native speaker status, general health status, and educational attainment (Comings & Soricone, 2007; Lesgold & Welch-Ross, 2012). Previous research with Cycle 1 U.S. PIAAC data revealed that being a non-native speaker of English, self- reporting fair/poor health (compared to good or excellent/very good), and having lower educational attainment was predictive of lower literacy performance (Tighe et al., 2022). In addition, Practice Engagement Theory (PET) postulates that higher engagement in literacy skills and practices (such as reading, writing, numeracy, and ICT skills-use) in daily life and work relates to better literacy performance (Reder, 1994; 2020; Tighe et al., 2024). Thus, the purpose of this project is to get a better picture of the demographic and skills-use characteristics of U.S. adults with lower literacy performance (Level 2 and below). Using the Cycle 2 U.S. sample (N = 2,114 at or below Level 2 in Literacy), we will examine several demographic characteristics (age, native speaker status, health status, educational attainment) and skills-use indices (reading, writing, numeracy, and ICT at home and at work) to predict literacy performance. We will consider separate regression models for adults with low literacy skills who are employed as compared to unemployed for the skills-use variables at work. The results will provide a snapshot of the demographic and skills-use profiles of U.S. adults with low literacy skills. Engagement in skills-use is a potentially malleable and encouraging low-skilled adults to engage in these practices may benefit actual literacy performance. We will also be able to comment on trends in how these variables are or are not predictive between Cycle 1 and Cycle 2 data.
Invited Symposium VIII: From a Bird’s Eye View: PIAAC-Based Research Reviews
Daniel Hernández Torrano: PIAAC Survey of Adult Skills: A Review of the Research Landscape
The OECD Programme for the International Assessment of Adult Competencies (PIAAC) has transformed international research and policy debates on the assessment of adult skills. Although research using PIAAC data is accumulating, little is known about how these data are used and what contributes to developing the various disciplines interested in adult skills. In this study we use a data-driven approach to examine PIAAC-based international research to date. Drawing on a comprehensive analysis of PIAAC-related publications from 2008-2024, the review finds that the field of PIAAC research is young and geographically diverse, with dominant contributions from the United States and Germany. While PIAAC research relies on a diverse pool of researchers with high collaboration rates, only a quarter of publications involve international collaboration. Our analyses also revealed that the field has developed grounded on four interrelated disciplines (education, sociology, psychology, economics) and three differentiated historical paths: theoretical and methodological approaches to the measurement of adult skills (e.g. response processes in computer-based assessments), cognitive skills and problem solving in technology-rich environments at the workplace, and the role of adult literacy skills for societal and economic development. Moreover, the PIAAC literature addresses a broad range of topics, including cognitive, non-cognitive and basic skills (e.g. literacy and numeracy), human capital, occupational mismatch, migration, returns to skills, informal learning and large-scale assessment methodologies. Implications for the further development of PIAAC research for users of PIAAC data, data-providing institutions and policymakers are discussed.
Jan Kalenda: Between Metrics and Meaning: Critical Gaps in the Measurement of Non-Formal Adult Education and Training in Second Cycle of PIAA
This paper addresses key methodological challenges in the latest cycle of the PIAAC survey, with a particular focus on the measurement of adult education and learning activities – specifically, Module B: Education and Training. It draws upon both longstanding critiques within the field of adult education and learning, as well as an analysis of the updated survey, including its questionnaire and accompanying background report. While the new generation of PIAAC provides valuable insights into adult skills in contemporary societies, significant methodological concerns persist regarding its capacity to accurately capture adult education and learning. First, the second cycle of PIAAC has modified the wording and operationalisation of key items used to measure non-formal education (NFE). While Cycle 1 employed a sequence of questions regarding various types of NFE (e.g., courses, workshops, private lessons), Cycle 2 utilised only the one master category – “training activities”. This conceptual simplification restricts our understanding of NFE. Moreover, it limits the possibility of meaningful longitudinal comparisons with data from the first cycle and the earlier IALS survey. This constraint is particularly apparent in differences in reported participation rates between Cycle 1 and 2 in countries such as South Korea, which appears to see a significant decline in participation rates according to PIAAC. Second, although the PIAAC Cycle 2 included a validated scale to measure personality traits, it notably omits established and validated scales for assessing motivation and barriers to participation – despite the availability of such instruments. This omission is especially striking given that these constructs are central to current theoretical understandings and are regularly employed in empirical studies examining participation and non-participation in adult education and training. Furthermore, the sequencing of questionnaire modules addressing motivation and barriers is limited to two specific groups: (a) those who participated in training for job-related reasons in the case of motivation and (b) only for those who wanted to participate in but did not in the case of barriers. This design choice may significantly impede our capacity to grasp the broader dynamics that drive or constrain participation in activities that leads to acquisition and development of skills across life.
Iddo Gal: A Critical Look at PIAAC-Based Academic Studies: Between Assumptions, Analytics and Usefulness of Conclusions
This talk aims to critically examine selected aspects of academic studies that use PIAAC data and that involve numeracy (and literacy) proficiency scores (i.e., based on the direct assessment) or numeracy practices (based on BQ scales). The talk is based in part on results of a scoping review of recent research on adult numeracy and mathematics, in part on observations developed through my long-standing activities as part of the PIAAC community (e.g., Chair of a national PIAAC steering committee, Chair of the Numeracy Expert Group for PIAAC Cycle 1). The talk will reflect on uses of the PIAAC data from Cycle 1, using examples from academic studies that: use complex multivariate analyses or seek to create profiles involving numeracy and literacy proficiency scores (but in ways that do not enable their results to necessarily connect with policy goals), studies that pool results across all levels of proficiency (and ignore the qualitative differences between different proficiency levels, or literacy-numeracy dependencies), studies that analyse numeracy and literacy scales regarding practices (but do not necessarily recognize the nature and limitations of BQ items examining practices), and more. The goal of the talk is not to be critical of specific studies, which will not be individually referenced, nor focus on statistical methodologies or technical nuances. Rather, the discussion and conclusions will aim to sketch in broad strokes areas of concern that focus on the nature of the underlying analytical assumptions or the interpretations of the results, and how these may affect the conclusions from certain studies. Overall, the talk intends to contribute to improving the future use of PIAAC datasets (both the new Cycle 2 datasets and analyses pertaining to changes from Cycle 1 to Cycle 2), so that they can better inform policy formation and future multidisciplinary research regarding adult skills and their determinants and correlates.
Thematic Paper Session I: Work, Learning, and Literacy: How Skill Use Shapes Adult Competencies Across Contexts
Eduard Stöger: Shifting Reading Skill Use in Germany and Austria: Potential Implications for Overall Proficiency Levels and Low Performers in Particular
Since the first PIAAC cycle, Austria has surpassed Germany in the share of adults with low literacy. Therefore, an initial investigation will be conducted into the reading skill usage behaviour and additional labour market characteristics of people with low literacy skills. Initial data analyses show that the use of reading skills in everyday life has remained stable in Germany, while it has slightly declined in Austria. Meanwhile, the use of reading skills at work has risen modestly in Germany but decreased in Austria. In detail, reading short texts at home and at work has increased more in Germany than in Austria, whereas reading longer, continuous texts has declined more sharply in Austria than in Germany. We examine how these opposing trends in skill use may be contributing to the widening literacy gap between Austria and Germany by exploring the interaction between skill use in everyday life and at work over time. In Austria, reading skill use at work serves as the primary safeguard against literacy decline: adults with low skill use at work encounter a decline in proficiency over time, regardless of their skill use in everyday life. In Germany, however, only those with low reading habits both in everyday life and at work face significant declines, highlighting stronger home reading habits and greater independence from skill use at work. Our findings emphasize the potential of integrating regular, context-rich literacy tasks into the workplace – particularly where home practice is insufficient – to prevent further erosion of adult literacy.
Bao Zhen Tan: Redefining Good Jobs: A Framework Linking Skills Use, Work Conditions, and Cognitive Skills Using PIAAC Cycle 2 Data
This paper introduces a new analytical framework for understanding “good jobs” using data from the second cycle of the Programme for the International Assessment of Adult Competencies (PIAAC) study. Good jobs are conceptualized through two key dimensions: skill use reflecting job content, and the presence of beneficial work resources and organizational conditions (which includes but not limited to job quality dimensions) that support effective skills utilization and employee engagement. We examine how these dimensions are associated with cognitive skills measured in PIAAC. Through comparative analyses across PIAAC participating countries, we identify consistent patterns and national differences in how job characteristics relate to cognitive skills. In addition to providing new insights into the interplay between cognitive skills, job design, and workplace context, this study also contributes to the further development of PIAAC. Drawing on findings from the Skills and Learning Study, a national study conducted in Singapore, we identify key gaps in the current PIAAC background questionnaire and propose the inclusion of a set of additional job-related indicators and economic outcomes in future PIAAC cycles. These refinements aim to improve how PIAAC captures what constitutes a good job in the modern labour market and its impact on economic and social outcomes, thereby better informing policies on skills use, work quality, and inclusive labour market development.
Yong Liang Ong: Beyond Education and Cognitive Skills: How Skills Use at Work Drives Training and Workplace Learning
The Matthew Effect describes a well-documented phenomenon where individuals with higher cognitive skills and educational attainment are more likely to engage in continued adult learning, while those with lower levels fall further behind. However, this study presents evidence that challenges this pattern in several economies. Using data from the Programme for the International Assessment of Adult Competencies (PIAAC) Cycle 2, we conducted a comparative analysis across six countries – Singapore, Finland, the United Kingdom, the United States, Korea, and Japan. Contrary to expectations, the results do not support the presence of the Matthew Effect in job-related non-formal learning. Instead, the analysis shows that skills use at work – rather than education level – is more strongly associated with participation in such learning. Reading is the only skill use consistently linked to job-related non-formal learning across all countries. Other types of workplace skills – such as writing, ICT use, influence, and task discretion – show varied significance depending on the national context. The role of workplace skills use is even more prominent in informal learning. Influence and complex problem solving consistently correlate with informal learning across countries, while reading and simple problem solving are significant in specific contexts. These findings highlight the critical role of job design in enabling adult learning. By creating opportunities for meaningful skills use at work, especially for individuals with lower formal education, organizations can foster sustained learning participation and help offset early educational disadvantages.
Thematic Paper Session II: Literacy at the Margins: Risk Factors, Everyday Practices, and the Digital Divide
Aoife Crawford: Whose Literacy Needs Are Not Being Met? An Analysis of PIAAC Cycle 2 Data on Adults who Score at or Below Level 1 in Literacy, and Aren’t in Education or Training, in Ireland and Across the OECD
The results of the OECD Survey of Adult Skills 2023 provide a once-in-a-decade opportunity to understand adults who have low literacy but are not currently being reached by literacy services. Charitable organizations, state education providers and other groups working in adult literacy can use this up-to-date information to effectively target outreach and communications. There are also significant implications for policymakers. This presentation will examine the risk factors for both having low literacy and not engaging in lifelong learning. The statistical analysis will include age, gender, family status, immigration status, socio-economic status, labour force status, early school leaving and educational attainment to date. We will analyse Ireland as a specific country example, as we have expert knowledge of the Irish social and policy context, and we will compare findings for Ireland with findings for the 31 countries who participated in PIAAC as a whole. We will identify typical characteristics and circumstances of adults with low literacy who are not in education or training and reflect on self-reported barriers to participation in education and training in the light of these findings. We will examine if there any differences between adults with low literacy who are participating in education or training, and those who are not. All of this information together should provide a clear picture of those whose literacy needs are not being met.
Klaus Buddeberg: Financial Practices of Vulnerable Subgroups
International institutions call for installing financial education strategies (OECD, 2024; Ansar et al., 2023). The German Federal Ministries of Finance and of Education and Research launched an initiative for Financial Literacy in 2023. This initiative was criticized for not paying sufficient attention to vulnerable groups (Höhne, 2024) and for attributing the financial difficulties of groups of people to a lack of financial skills and supposedly inadequate financial behaviour, like a low commitment to financial matters. We use data from the 2nd PIAAC cycle to examine questions of adult financial practices focusing on economically vulnerable groups. From this perspective, financial practices serve as a proxy for financial behaviour, which is one component of financial literacy (OECD & INFE, 2020; Beckker, 2020). Secondary analysis of the PIAAC data (1st cycle) showed that adults in strained financial situations deal with everyday financial issues (e.g. calculating costs, prices, budgets; variable G2_Q03a) more frequently than economically better-off groups (Grotlüschen et al., 2019). This relativized the stereotypical assumption that groups with very low incomes adults cause their economic situation through passivity in financial matters (blaming the victim). Current PIAAC data now allows for expanding the analysis. With the variable G2_Q03b (“How often do you use information to make financial decisions?”) the dataset offers information on the way adults deal with economic issues from a more strategic perspective. Research questions for the contribution are whether the (a) frequency of practices differs depending on whether they are more every day, or more strategic, and (b) whether there are differences between countries. Analyses of the frequency of financial practices are carried out in multivariate form in relation to economically vulnerable groups (low income, unemployment), controlling for socio-demographic factors and numeracy skills in a country comparison.
Kristin Skowranek: The Usage of Digital Devices by Adults with Low Literacy in the Age of Generative AI
The proliferation of digital devices and the advent of generative artificial intelligence (AI) have transformed communication and information access in contemporary society. Adults with low literacy could be excluded from social practices that require a certain reading proficiency. A more nuanced picture emerges from available research. Data from a national assessment (LEO 2018) shows that for the German-speaking population aged 18 to 64, adults with low literacy use digital devices regularly (Buddeberg & Grotlüschen, 2020). Audio-visual practices, like voice messages or video tutorials, are used more frequently by people with low literacy than by people with higher literacy (Buddeberg & Grell, 2023). Furthermore, Adults with low literacy can prompt in generative AI and even use strategies for prompting intuitively (Skowranek, in review). In Germany, there are 6.2 million adults with low literacy (Grotlüschen et al., 2020), 47.4 per cent of whom grew up speaking a language other than German (Heilmann & Grotlüschen, 2020). Consequently, the role of migration background should be considered when assessing the utilization of digital devices by adults with low literacy. Previous data on the usage of digital devices by adults with low literacy (PIAAC level one and below) could not account for the effects of the COVID-19 pandemic on digital transformation due to the timing of the survey. The data from LEO 2018 was collected in 2017/2018 and should be updated. As they relate to Germany, an international comparison has yet to be made. Especially since the digitalization in Germany can be improved compared to other countries (European Commission, 2022). This contribution shows how digital devices are used by adults with low literacy based on data from PIAAC 2023. For the descriptive analysis, the migration background is taken into account, and a comparison is made between different countries within the EU with more and less developed digitalization.
Thematic Paper Session III: Who Learns, Who Doesn't? Exploring Adult Learning Participation Across Contexts
Michał Sitek: Participation in Adult Learning in Poland: Structural, Motivational and Cultural Drivers
Poland has relatively low participation rates in non-formal and work-based learning and low literacy levels, which makes it an interesting case for in-depth analysis. Building on the 2023 PIAAC cycle and two nationally representative surveys (The Learning of Adult Poles 2022, 2025), we examine how cognitive skills, social and cultural capital, and workplace characteristics shape adults’ engagement in non-formal and informal learning. Specifically, we answer the following questions: (1) What motivates adults to learn? (2) Which individual and workplace factors predict participation? (3) Do cultural resources – reading habits and prior educational experiences – have direct and indirect effects? Our initial analyses suggest distinct drivers of participation. Practical and mandatory training dominate in Poland, in contrast to personal development goals, which are more prominent in other countries. The structure of the determinants is a complex interplay of personal, social, cultural, and work-related characteristics. While skills are important, educational attainment is a more important predictor of participation. Cultural factors, notably reading habits and the number of books at the age of 14 (PIAAC) or educational experiences, motivational factors (attitudes towards learning, self-concept), and perceived social norms measured in national surveys have direct and indirect effects on participation. Moreover, subjective mismatch and job characteristics such as technology use, ICT use, and autonomy are important predictors of learning-by-doing. In our analyses, we will combine PIAAC and national survey data. Using structural equation modelling, we address selection bias and mediation effects in adult learning analyses. Combining data sources enables us to extend the framework, improve statistical identification and validity, and identify limitations in PIAAC’s measurement of adult learning.
Julia Gorges: Motivation to Learn in Adult Learning: A Nomological Network Analysis and a Four-Year Longitudinal Study
This study investigated motivation to learn (MtL), conceptualized at a global level of abstraction (i.e., independent of specific educational settings such as high school or university, and independent of learning content such as school subjects) in adult learning. In Study 1 (N = 747, 65.1% female; age: M[SD] = 43.21[12.09] years), the analysis of the nomological network of the PIAAC MtL scale used in this study to assess global MtL revealed strong associations with mastery goal orientation, an adapted measure of intrinsic task value, need for cognition, and self-concept of ability and moderate correlations with openness and conscientiousness. Cross-sectional associations with (past and planned) participation in education were in the expected range. Based on the representative German PIAAC longitudinal study covering four years (N = 1101–4189), the role of MtL as a predictor of participation in non-formal and informal adult education and training was tested using structural equation modelling in Study 2, controlling for level of education, literacy, employment, age, and gender. Results supported the hypothesis that global MtL predicts participation in adult education and training while controlling for typical sociodemographic determinants (e.g., level of education, employment). Openness was tested as a competitor of global MtL but did not show significant effects on participation in education. The results are discussed with respect to theoretical implications for the development of motivation theory and practical implications for the promotion of lifelong learning.
Thematic Paper Session IV: From Classroom to Career: Measuring and Addressing Educational Expansion, Skill Development, and Inequality
Silke Schneider: The Hydra of Comparative Surveys: Lessons Learnt from the Measurement and Harmonization of Education in PIAAC Cycle 2
The production and certification of skills is a primary task of educational systems. One aim of the OECD’s Programme for the International Assessment of Adult Competencies (PIAAC) is to evaluate how effectively and equitably educational systems produce cognitive skills. Educational attainment is, as the most important predictor of adult skills, a crucial background variable in PIAAC. However, due to the varying organization of education across countries, it is also the most challenging variable to measure comparatively. This paper presents how PIAAC Cycle 2 measured and harmonized educational attainment across countries, and related opportunities and challenges. While national adaptation and international ex-post harmonization were already in place in PIAAC Cycle 1, the international PIAAC consortium refined these procedures as well as the target education variable for Cycle 2. Regarding procedures, these included a formal education consultation between countries and the consortium, enhancing the practice established for the European Social Survey. In contrast to experience from the ESS, national adaptations in PIAAC were very complex in some countries, requiring disproportionate time and effort for consultation, data processing, and quality control. Furthermore, countries’ implementation of ISCED does not always lead to highly comparable measures. Then, the paper introduces the target international coding scheme, which extends the International Standard Classification of Education 2011, and the various derived variables made available for analysis. These will be illustrated empirically. However, data protection requirements, together with a lack of provisions such as data usage contracts, led to the suppression of many education variables in the public use files for different countries, limiting the potential of the data for scientific research. The paper will conclude with some reflections on how the measurement of education can be improved and facilitated.
Nena Rončević: Transforming Teaching and Learning, Developing Solvers: Predictors of Problem-Solving Skills Among Croatian Students in PIAAC and PISA Studies
Dialogue between educational institutions and the business sector has centred on how to most effectively prepare young people for the modern labour market. This has led educators to continuously revise curricular content, with an emphasis on narrowly defined, subject specific knowledge and skills. However, such a focus overlooks essential soft skills, including teamwork, communication, negotiation, critical thinking, and problem-solving. Among these, problem-solving is particularly valued by employers. The PIAAC 2023 survey in Croatia, shows below-average results in the domain of adaptive problem-solving (APS), while results in the problem-solving domain of the PISA 2012 study point to the same conclusions. Therefore, the focus of this paper is on pupils and students who participated in the PIAAC study, aiming to answer the question of which predictors contribute to explaining results in the APS domain. Although the constructs are not entirely aligned, the paper also reflects on Croatian students’ PISA results to identify broader trends in problem-solving skills over the last decade. These findings contribute to the ongoing debate about how the education system addresses problem-solving, especially in light of evidence that both individual characteristics and school-level factors significantly contribute to differences in problem solving skills. The paper is expected to yield several key recommendations for policymakers in the Republic of Croatia from both sociological and pedagogical perspectives. Sociological insights highlight the role of socio-economic and cultural family background in shaping (educational) outcomes, while pedagogical insights advocate for greater use of constructivist, self-regulated, andragogical, and transformative (or even transgressive) teaching and learning approaches. Emphasis is placed on the problem-solving method as a central in contextual and interactive teaching strategies for effectively developing this key 21st-century skill.
Omer Sahin: U-Shaped Relationship Between Age and Over-Education: Cross-Country Comparison of Divergent Objective and Subjective Measures
The literature documents a higher risk of over-education among younger workers with age believed to act as a linear corrective over time. However, two recent studies have challenged this assumption, finding a U-shaped relationship between age and over-education in the US and Israel. Here, I extend that insight to a cross-national level, using data from the 1st and 2nd cycles of PIAAC to examine over-education among 38,644 tertiary-educated workers across 39 country-years. Employing realized match measures – which compare workers’ education level to the modal level in their country and occupation – I find a U-shaped relationship between age and objective over-education. However, when I employ a subjective measure – where respondents evaluate the education level needed for their job – the relationship reverses, showing an inverted U-shape. This divergence shows that the perceived and structural aspects of over-education evolve differently across the life course. Results are derived from fixed-effect linear probability models, controlling for average skill level, gender, working time status, recent training, and sector (and job satisfaction in subjective models). These patterns remain robust across two distinct objective measures and suggest that older workers may become increasingly over-educated relative to peers, even as they report lower levels of perceived over-education. Moreover, I examine job change as a moderator. Findings suggest that late-career job changes are associated with increased objective over-education, while younger workers benefit from such transitions. However, this effect is not mirrored in subjective responses, hinting at a disconnect between occupational downgrades and worker perceptions. This paper provides the first cross-country documentation of U-shaped age patterns in over-education, demonstrating that both the direction and interpretation of results depend strongly on the choice of measurement strategy.
Thematic Paper Session V: Skills, Employment, and Inequality: Cross-Country Perspectives on Labour Market Attachment and Institutional Drivers
Chia Ying: Varieties of Capitalism and Skills Accumulation: A Cross-Country Analysis of Institutional Drivers of Skill Development
This paper examines how different institutional models shape skills accumulation over the life course, focusing beyond formal education, non-formal training, and on-the-job learning to highlight the critical role of job design and workplace contexts in shaping skills development and outcomes. Drawing on cross-country data from Cycle 2 of the OECD’s PIAAC – covering cognitive skills proficiency, training participation, job task requirements, and workplace practices – the paper applies the varieties of capitalism framework to compare how institutional arrangements, including education and training systems, industrial relations, and workplace organisation, influence the distribution, development, and returns to skills. A key contribution is the juxtaposition of Singapore’s developmental state model with coordinated market economies (Finland, Estonia, Switzerland) and liberal market economies (US, UK), offering a novel analysis of skills formation. Using multivariate regression and decomposition techniques, the paper identifies the relative influence of different pathways of skills accumulation. In Singapore, despite major investments in workforce training, formal credentials remain a dominant predictor of both skills proficiency and wages, with gaps persisting over the life course. In contrast, coordinated market economies more successfully integrate value-creating job tasks and workplace learning, contributing to higher skills proficiency, stronger skills-based progression, and more equitable outcomes. Liberal market economies show uneven patterns, with socio-economic background exerting greater influence on skills development and returns. The paper discusses these findings in relation to national institutional models and offers implications for workforce strategies to support more inclusive and value-creating skills ecosystems. It concludes by calling for a dynamic, life-course approach to skills research and outlines methodological priorities for advancing this agenda.
Mari Liis Räis: Who Is Falling Behind? Intersectional Insights into Low-skilled Adults in Estonia
Strong information processing skills are essential for managing everyday life, participating in society, ensuring well-being, and succeeding in the labour market. Estonia ranks at the top of the PIAAC 2023 results across all three information processing skills and should be well positioned to benefit from this. However, the share of adults in Estonia with low information processing skills has increased over the past 11 years – despite efforts to expand adult education. Preliminary analysis shows that the decline in these skills begins as early as age 35. While younger adults in Estonia rank among the world’s top performers compared to the OECD average, by age 55 their skills have dropped close to the OECD average. This decline is notably steeper than in many other countries, with the sharpest drop seen in the cohort aged 44–54 ten years ago, now aged 55–65. Over the decade, this group’s reading skills declined by 28 points and numeracy skills by 15 points. This trend underscores the urgent need to better understand the factors behind skill loss and to identify ways to support skill development and maintenance. Low skills are particularly prevalent among older adults with low education – 77% of those aged 55+ fall into the low-skilled category, compared to just 13% of low-educated 16–24-year-olds. Gender disparities are also significant: men account for 59% of adults with low reading proficiency, and their average reading scores are lower than those of women. Overall, 23% of men and 17% of women in Estonia have low reading skills. The data point to growing skill polarization in Estonia, where part of the population enjoys high skill levels while an increasing share – especially older, less-educated men – falls behind. This analysis focuses on identifying vulnerable groups in the labour market through an intersectional approach to support better policy development.
Thematic Paper Session VI: Beyond Answers: Process Data, Generative AI, and the Changing Landscape of Adult Skills
Qiwei He: Tracking Response Pattern Changes in PIAAC Literacy and Numeracy Domains: A Comparative Analysis of Process Data from Two Cycles (2012–2022)
The Programme for the International Assessment of Adult Competencies (PIAAC) serves as a critical indicator of adult knowledge and skills across countries, informing educational policy decisions. Over the past decade, substantial advancements in information and communication technology (ICT), particularly accelerated by the COVID-19 pandemic and AI-driven tools, have reshaped digital literacy and problem-solving abilities. Computer-based PIAAC domain assessments enable the tracking of adults’ responses, strategies, and time allocation patterns during the test, providing new evidence into adults’ cognitive processes. This study examines changes in response patterns between PIAAC Cycle 1 (2012) and Cycle 2 (2022), focusing on how U.S. adults solve literacy and numeracy items in digital environments. We will compare behavioural trends including response times and time to first actions across 28 literacy and 32 numeracy trend items, which were administered across both cycles. The aims of this study are twofold: (1) to track response pattern in adults’ problem-solving approaches, controlling for proficiency levels and demographic variables, and (2) to identify key factors influencing these shifts. The research occurs in two phases. The first phase analyses whether time allocation and reaction time patterns have significantly evolved, accounting for demographic factors such as gender, ICT proficiency, and education level. We examine age-cohort progression, which offers insights into the development of cognitive skills over time. The second phase applies machine learning techniques to uncover underlying drivers of response pattern variations between cycles. Preliminary results indicate an average decrease of 5 seconds in literacy item completion times, with distinct time allocation trends across proficiency groups. Findings from this study contribute to a deeper understanding of how technological and societal changes shape cognitive processing in educational assessments.
Ting Zhang: Gen AI Chatbots for Complexity: Supporting PIAAC Users and Rethinking Evaluation with LLM-as-a-Judge
While advances in Generative AI have made it increasingly accessible to build chatbots for complex domains like large-scale assessments, robust and cost-effective methods to evaluate these tools remain underdeveloped. This study addresses two core challenges for the PIAAC research community: improving chatbot performance for technical tasks and establishing scalable methods for evaluating these systems. This study presents a Retrieval Augmented Generation (RAG)-based chatbot specifically designed to support analysis of large-scale assessments. The chatbot assists users with complex methodological questions – such as the application of plausible values and sampling weights – and can provide step-by step guidance for analysing PIAAC data using R. To benchmark performance, we compared the customized chatbot against GPT-4o across dimensions of correctness, completeness, and communication. Preliminary results show the tailored chatbot significantly outperforms GPT-4o, with an overall pass rate of 86%. To address the lack of scalable evaluation frameworks, we compared an LLM-as-a-judge approach with human raters to assess chatbot responses. This LLM-as-a-judge method demonstrates high agreement with expert human raters, offering a practical and low-cost solution for chatbot evaluation. Importantly, this framework is model-agnostic and can be applied to other potential chatbot developed by PIAAC institutes or users, enabling continuous quality monitoring without the resource intensity of manual expert review. This study contributes to both the technical development of effective chatbots for PIAAC data use and the methodological advancement of chatbot evaluation. As AI tool development becomes more accessible, standardized and scalable evaluation methods – such as the LLM-as-a-judge approach as a complement to human evaluation – are essential for ensuring quality, usability, and trustworthiness across educational data systems.
Dave Tout: Working in the Era of Automation and AI: A New Target Group for Literacy and Numeracy Interventions?
In the current climate of rapid workplace changes mainly due to automation and AI, is there an emerging new cohort of adults who need targeted literacy and numeracy (L&N) support? Traditionally adult L&N policies and programs have targeted adults at the lower levels of performance, as there is so much evidence that demonstrates that investing in improving their L&N skills makes a positive difference to them as individuals, citizens and workers. Business, industry and the economy benefit as well from these improvements. But there are reasons to believe that current technological changes come with additional L&N requirements. For instance, citizens are now expected to deal with online information, repositories, forms and AI agents, as opposed to talking to a clerk at a counter. The extensive use of big data necessitates critical numeracy skills. Is there now a new cohort that should be targeted beyond basic L&N skills in relation to work, the economy, but also social and civic life? This presentation will report on the outcomes of a 2024 research investigation based on PIAAC Cycle 2, where a small group of members of the literacy and numeracy PIAAC Expert Groups, under the guidance of ETS colleagues, collaborated to research this issue. The research considered what levels of L&N skill performance are required for workers and citizens to be able to take better advantage of automation and AI. We asked what interventions would help someone progress from one level to another to achieve the required skills. Based on the proficiency descriptions and an analysis of the features of all the items, including performance data, the study yielded an analytic picture of the skills that support a transition from level 2 to 3 of the L&N proficiency scales. In addition, a comparison of the drivers of progress in the two domains revealed interesting commonalities. The analysis also provided several hints regarding the instructional strategies that could support this transition.
Thematic Paper Session VII: Mapping Cognitive and Socio-Emotional Skills Across Occupations and Countries
Matteo Luppi: Human Capital Profile of Youth: Insights from PIAAC Data
In recent years, social and emotional skills, also known as ‘non-cognitive skills,’ have become increasingly important for studying human capital and its associated labour market returns, just as much as cognitive skills and formal educational attainment. Formal education, cognitive skills, and non-cognitive skills can be considered the three foundational areas of human capital development. This paper, based on PIAAC Cycle 2 data, aims to identify profiles of young people (aged 16 to 34) according to the interaction of these three areas and to examine how individual socio-demographic characteristics and institutional features relate to the identified profiles in a selected number of countries. In PIAAC Cycle 2 data, these three foundational areas are defined based on i) information processing skills (literacy, numeracy, and adaptive problem solving), ii) social and emotional skills, (Big Five personality module) and iii) the level of education (ISCED). Utilising appropriate statistical techniques on a pooled countries dataset, the adopted approach enables accurate identification of human capital development profiles for the young population. In a subset of countries selected for their differences in institutional features related to human capital – the welfare state, educational system, and economic structure– the obtained profiles are analysed using statistical techniques to understand how different combinations of individual and institutional features diverge in influencing the profiles across various institutional settings. The preliminary findings emphasise that, in line with cognitive skills analysis, countries vary in the composition of human capital development profiles among their young populations. The disparities in national institutional frameworks, the interplay between individual socio-demographic characteristics and welfare state, economic structures, and education systems partly account for this variation, offering clear indications for policymakers.
Samo Varsik: Skills, Personality, and Occupational Sorting: Evidence from PIAAC
Individuals spend a considerable proportion of their lives working. Occupational sorting, the process of individuals actively selecting into and being selected into different occupations, has significant implications for social stratification and inequality. Studies based on PIAAC illustrate how different socio-demographic groups are sorted across occupations and highlight the individual and societal costs of mismatches between workers’ education and skills and their job requirements (OECD, 2024). PIAAC has been extensively used to identify variations in the information-processing skills of different occupations. By contrast, few studies to date have examined variations in personality across occupations (see Anni et al., 2025 for a review of exceptions) and no study has been conducted using evidence from multiple countries. Yet, occupational choices are often influenced by alignment between individuals’ personalities and work styles. Similarly, career guidance and candidate selection consider factors beyond technical or information-processing skills. Due to limited survey data simultaneously capturing occupational information, personality traits, and information processing skills, only one study has addressed occupational variations in personality and skills in the United Kingdom (Wolfram, 2023). To fill this research gap, we use data from PIAAC to investigate occupational variations in information processing-skills and personality traits across 28 countries. Respondents’ occupations were coded into internationally comparable ISCO categories, enabling consistent cross-national analysis. Our empirical analyses include data from over 100,000 workers across around 400 occupations. Results reveal substantial occupational differentiation: occupations explain between 26% and 29% of individual variation in information-processing skills, 11% of the variation in willingness to delay gratification, and between 3% and 8% of the variation in personality traits.
Olga Zelmanova & Zuzana Wirtz: Teachers in Slovakia – Personality, Competencies and Status from OECD Surveys – PIAAC, TALIS
Our intention was to find out associations between cognitive and noncognitive skills that can influence and contribute to the quality of teachers’ work (lower & upper secondary teachers). We compared teachers (cognitive and non-cognitive – socioemotional skills) with tertiary educated adults. We used PIAAC 2023 data of tertiary educated adults and SVK PIAAC oversample of tertiary educated teachers. We focused on analysis of cognitive skills (literacy, numeracy), socioemotional skills (BIG Five), Training and teacher’s status, salary (TALIS). We found out: teachers´ cognitive skills were comparable to tertiary educated adults. Among teachers, the highest score was achieved by 35-45 years old while among tertiary educated adults it was 45-55 years old. This is alarming because we have expected the youngest group (25-35) to achieve the best score. The lowest score was in the age group of 55-65 years. In all skills men teachers scored significantly higher than women and higher than tertiary educated adults. Analyses of Social and Emotional skills showed that in both groups the most preferred dimensions were Open-mindedness and Agreeableness but significantly more dominant by teachers. The least dominant was Extraversion and Emotional stability. Interestingly Agreeableness was the least preferred by tertiary educated adults. Among teachers Curiosity, Respectfulness and Trust substantially positively correlated with cognitive skills, on the other hand Sociability correlated negatively. Training activity positively correlated with Literacy and Numeracy. Comparison of teachers´ salaries with tertiary educated adults indicated weak position of teachers in Slovak society as the ratio of salaries of teachers to tertiary educated workers is very low. Although teachers showed high level of skills, their social status is not at adequate level. With our paper, we would like to provide insight for policy makers to improve the status and quality of teachers in Slovakia.
Thematic Paper Session VIII: Work in Transition: Automation, Generative Job Design, and Skill Trajectories Across Countries
Lianyi Hu: Automation and Task Differences Across Countries
Why are there substantial cross-country differences in the nature of work, even within the same occupations? In this paper, we investigate how exposure to automation technologies shapes the task content of occupations across countries. Using PIAAC data between 2011 and 2023, we construct internationally comparable measures of task content for 37 occupations across 32 countries from 2011 to 2023. We measure occupational exposure to automation by identifying automation patents and linking them to occupational descriptions from O*NET using NLP tools. Our empirical analysis links automation exposure to task content at the country–occupation–year level, controlling for occupation-by-year fixed effects. We find that countries with greater exposure to automation innovation tend to exhibit higher levels of non-routine analytical (NRA) and non-routine interactive (NRI) tasks, and lower levels of routine cognitive (RC) and manual (MAN) tasks. These effects vary across sectors, occupations, and demographic groups. For instance, task adjustments are larger in manufacturing than in services, and male, low-educated, and older workers experience more significant task changes. Decomposing variation reveals that over 60% of the cross-country differences in task content arise from within-industry changes, rather than shifts across industries. To explore underlying mechanisms, we identify two channels: task-based sorting and task-oriented training. Countries with higher automation exposure exhibit larger wage premiums for NRA tasks and penalties for manual tasks, encouraging workers to shift toward higher-return tasks. Additionally, automation exposure increases training focused on non-routine tasks, reinforcing the shift in occupational task content. Together, these findings suggest that automation reshapes the nature of work by altering the composition of tasks within jobs, primarily through within-industry adjustments and changes in worker behaviour and training priorities.
Jamie Lee & Ying Chia: From Determinism to Constructivism: How Generative Job Design Shapes the Skill Impact of Technological Change
Challenging technological determinism, this paper introduces the concept of ‘generative jobs’–characterised by high learning requirements, active problem solving, and creativity-oriented work design–as a novel lens to examine how the interaction between technological change and job design enhances workplace performance and supports the augmentation of workers’ skills. This analysis draws on cross-country data from OECD’s PIAAC Cycle 2, which uniquely includes direct assessments of workers’ cognitive skills proficiency. This enables a robust investigation of the skill-enhancing effects of technology in different work environments. Focusing on Singapore, a country with high levels of technology adoption, the paper also draws comparative insights from selected digital frontrunners like the US, Switzerland, and Finland, each representing distinct work organisation models. Multivariate stepwise regression analysis is used to test the interaction effect between exposure to technological change and generative job design on job outcomes across skill levels. Interestingly, once worker and firm characteristics are controlled for, cognitive skills proficiency does not differ significantly across different technological and job environments. However, workers exposed to technological change in generative environments report better outcomes, including higher wages, greater job satisfaction, and higher likelihood of receiving training in response to technological changes. These findings highlight that the impact of technology is not determined solely by its deployment, but by how it is integrated into job design to support human skill development. The paper acknowledges two dataset limitations: first, it predates recent developments in generative AI; second, it lacks detail on types and uses of technologies. Drawing on the authors’ experience designing similar instruments, the paper proposes enhancements to future PIAAC cycles to better capture evolving technology-skill dynamics.
Gözde Demir Ertuğrul: Investigating the Differential Factors Predicting Adaptive Problem Solving in the Second Cycle of PIAAC
Due to the dynamic nature of modern life, enhancing adaptive problem solving (APS) skills has become essential. APS involves using cognitive and metacognitive strategies to define problems, gather relevant information, and apply solutions effectively by engaging digital, social, and physical tools in evolving contexts (Greiff et al., 2021). Since one of the most crucial skills for successful integration into society is APS, researchers are interested in the factors predicting APS. Scholars indicate that socio-emotional skills (SES) are related to individuals’ problem-solving processes (Sullivan et al., 2010). In addition to individual-level factors, country-level factors such as Human Development Index (HDI), Gross Domestic Product (GDP) and Government expenditure on education (GEE) could play a role in predicting the APS (Greiff et al., 2017). Furthermore, the predictors of APS might differ across various education attainment and gender groups. Thus, the current study aims to examine how the individual- and country-level predictors of APS vary across different educational attainment and whether gender moderates the strength of this relationship in PIAAC. Method The study will use 2nd Cycle of PIAAC dataset that has participants from 31 countries. SES and APS were measured via BQ and cognitive module of the Survey of Adult Skills, respectively. Using multi-level regression, the study analyses the individual- and country-level predictors of APS skills. Individual-level variables are dimensions of SES and country-level variables are HDI, GDP and GEE. Whether the relationships differ according to different levels of educational attainment and gender groups will be examined. Sample weights and plausible values will be handled by Mplus. Expected Outcomes It is expected that the role of SES and country-level factors predicting APS differ between less educated and high educated adults as well as males and females. The findings will be discussed based on regions.
Thematic Paper Session IX: Skills, Origins, and Opportunity: What PIAAC Reveals About Adult Learning and Mobility
Franscesca Borgonovi & Marco Paccagnella: Like Parent, Like Child? Intergenerational Occupational Persistence in 31 Countries
This paper uses detailed information on the occupation of parent-child dyads to document intergenerational occupational persistence, which we define as the probability an adult working in the same occupation as either parent did when he or she was 14 years old. The availability of detailed information at the 3-digit ISCO level for both parents and children for around 150 occupations in the 31 countries participating in PIAAC allows us to conduct a richer comparative fine-grained analysis than in previous studies on the topic has been done in the previous literature. Intergenerational occupational persistence is a crucial indicator to understand social and labour market mobility. On top of decreasing fairness and equality of opportunity by increasing the importance of the accident of birth, intergenerational occupational persistence has negative welfare effect if it is driven by transmission and perpetuation of economic rents. However, it may increase aggregate welfare if transmission of job-relevant skills is more efficient within the family than outside. Such efficiency can increase innovation and productivity with positive repercussions for societies. By leveraging the richness of background information contained in PIAAC (such as educational trajectories, labour market outcomes, personality traits, and subjective wellbeing), we are able to document how adults who follow in their parents’ footsteps differ from adults who take different career paths. The availability of reliable information on cognitive skills further allows us to shed some light on the selection mechanism shaping the intergenerational transmission of occupations. Our initial analysis indicates occupational persistence averaging around 7% across participating countries. This persistence highlights meaningful constraints on occupational choice with implications for intergenerational equity.
Frank Fernandez: Understanding Predictors of Skill Loss and Identifying Prevention Opportunities and Strategies
Adult literacy skill is the foundation for economic growth in advanced economies. It explains more than half of the variation in long-term increases in gross domestic product across OECD countries (Coulombe et al., 2005). A one-percent increase in aggregate literacy skill is positively related to a three-percent increase in per-capita GDP (Schwerdt et al., 2020). However, as Willms and Murray (2007) note, “improvements in literacy skill flowing from the initial education system are being eroded by significant levels of literacy skill loss in adulthood” (p. 8). Descriptive analyses of Canadian data from the International Adult Literacy Study (IALS) and the Program for the International Assessment of Adult Competencies (PIAAC) suggest that skill loss occurs for each age cohort and that skill loss 80 | 92 Content Program Overview Invited Symposia Paper Sessions International PIAAC Research Conference 2025 is more pronounced among older cohorts. In other words, between 2003 and 2011, older cohorts lost more literacy skill than younger cohorts (Lane & Murray, 2019). The purpose of the study is to identify individual, educational, and occupational factors that predict skill loss among U.S. adults. Additionally, the study aims to identify experiences that reduce odds or magnitude of skill loss. To achieve these goals, this exploratory study will apply descriptive and multivariate regression to examine potential literacy, numeracy, and adaptive problem-solving skill across the life course using 2023 US second cycle data from PIAAC. Descriptive plots show that for each skill domain, average assessed skill peaks among the 25–34-year-old cohort and then declines for each ten-year age band that follows. This exploratory study will aim to identify potential interventions to combat skill loss. For instance, I seek to understand whether employer-sponsored training is more influential than on-the-job skill use at preventing skill loss. Additionally, this exploratory study will also help determine whether to focus on preventing skill loss for specific target populations.
Thematic Paper Session X: Balancing Learning, Work, and Life: Insights into Adult Skills, Literacy Practices, and Well-Being
Gregor Dutz: Are Literacy Practices Still on the Decline?
At the individual level, the Practice Engagement Theory postulates that individuals’ reading and writing competencies emerge as a result of their participation in everyday reading and writing activities. Simultaneously, these competencies influence the level of involvement in such practices. This relationship was shown based on German PIAAC data (Reder, Gauly & Lechner 2020). The first cycle of PIAAC showed a decline in literacy practices compared to the 1990s IALS survey. This finding has been used to explain the surprisingly declining or stagnating literacy proficiency in many countries despite technological progress and educational expansion at that time (Desjardins 2017). In PIAAC Cycle 2, a stagnation or decrease in literacy is also observed in many countries, raising questions about the underlying causes. Therefore, this presentation aims to investigate how literacy practices have developed over time, based on the data from PIAAC Cycle 1 and Cycle 2. It will include those countries that participated in both Cycle 1 and Cycle 2. The analysis will consider the indices “Read at Home” and “Read at Work” which are provided as trend variables. The descriptive analysis will pay special attention to the development of literacy practices according to PIAAC levels. Additionally, the analysis of literacy practices will be supplemented with considerations regarding migration, professional qualifications, and participation in adult education.
Carla Hornberg: The Impact of COVID-19 on the Education-Training Relationship: Evidence from PIAAC
The economic downturn due to the COVID-19 pandemic has prompted speculation about workers’ participation in job-related training, with both optimistic and pessimistic scenarios. The latest release of PIAAC data covering 29 countries for 2021/22 allows for an empirical examination of the pandemic’s impact on inequalities in job-related training. The study explores how inequalities in job-related non-formal training have changed during the pandemic and examines whether and how the determinants of training participation have shifted – in particular, whether labour market allocation remains the main factor explaining the relationship between education and training (as found for PIAAC 2012/14, see Hornberg 2024, Hornberg et al. 2024), or whether worker characteristics (such as learning disposition and socio-demographics) have gained in importance. Preliminary results show that training participation declined across all education groups in many countries during the pandemic. While differences in participation between education groups persist, the magnitude of these differences, particularly of the lower training gap, has decreased in several countries. However, these reductions should not be seen as a positive development, as they are mainly due to declines in participation among intermediate-educated workers. Despite shifts in participation rates of education groups, labour market allocation remains the key factor driving the education-training relationship in most countries.