OECD Programme for International Student Assessment

OECD Programme for International Student Assessment
Name	OECD Programme for International Student Assessment
Abbreviation	PISA
Established	1997
Administered by	Organisation for Economic Co-operation and Development
Frequency	Triennial
Participants	15-year-old students (approx.)
Countries	Member and partner economies

OECD Programme for International Student Assessment The Programme for International Student Assessment is a triennial international survey coordinated by the Organisation for Economic Co-operation and Development that evaluates 15-year-old students' competencies in reading, mathematics, and science. It informs policy debates among participants such as the European Commission, the World Bank, the United Nations Educational, Scientific and Cultural Organization, and national ministries like the United States Department of Education and the Ministry of Education of the People's Republic of China. Results are used by bodies including governments of Japan, Germany, France, Brazil, India, and Canada, and by research centers such as the Brookings Institution and the RAND Corporation.

Overview and History

PISA originated under the auspices of the OECD Secretariat and was launched following discussions involving the G7, the European Commission, and national authorities in the mid-1990s. Initial cycles engaged participants like Australia, Finland, Sweden, New Zealand, and the United Kingdom, while subsequent rounds expanded to include economies such as Singapore, South Korea, Hong Kong, Estonia, and Chile. Influential reports and analyses from institutions including the Institute of Education, the Harvard Graduate School of Education, the London School of Economics, and the National Center for Education Statistics shaped adoption and critique. Major milestones involved methodological revisions endorsed by experts from Harvard University, Stanford University, the University of Oxford, and the University of Toronto.

Assessment Design and Methodology

PISA employs a matrix sampling design and item response theory developed by psychometricians associated with the Educational Testing Service, the International Association for the Evaluation of Educational Achievement, and the National Institute for Educational Policy Research. Test development has drawn on contributions from specialists at the University of Cambridge, the University of Michigan, Columbia University, and the University of Melbourne. Scaling and equating use Rasch modeling and two-parameter logistic models from statistical groups at Princeton University and the University of Chicago. Quality assurance involves oversight by advisory panels featuring academics from Johns Hopkins University, the University of California, Berkeley, and the University of Helsinki.

Domains Assessed and Frameworks

PISA cycles center on major domains: reading literacy, mathematical literacy, and scientific literacy, with optional domains such as financial literacy and creative problem solving informed by frameworks developed at the Organisation for Economic Co-operation and Development, the European Bank for Reconstruction and Development, and the International Monetary Fund. Domain frameworks reference curricular and cognitive taxonomies used by the National Academy of Sciences, the Royal Society, and the American Educational Research Association. Assessment items have been reviewed by specialists from the Massachusetts Institute of Technology, the Swiss Federal Institute of Technology, and the University of Hong Kong to align tasks with real-world scenarios encountered in cities such as London, Paris, Beijing, Seoul, and Toronto.

Administration and Sampling

Administration protocols require nationally representative samples of 15-year-olds drawn using sampling frames maintained by agencies like Statistics Canada, the Instituto Nacional de Estadística y Geografía, the Office for National Statistics, and the Australian Bureau of Statistics. Field operations have been contracted with organizations such as Pearson, ACT, and local institutes in regions including Andalusia, Bavaria, Quebec, Catalonia, and Lombardy. Sampling strategies adhere to standards set by the United Nations Children's Fund, the World Health Organization, and the European Commission's Eurostat, with attention to stratification, clustering, and weighting procedures used in surveys run by the Pew Research Center and the Gallup Organization.

Results, Reporting, and Global Impact

PISA reports have influenced policy dialogues involving leaders from the Government of Finland, the Government of Singapore, the Government of Estonia, and the Government of Poland, and have been cited in analyses by the Organisation for Economic Co-operation and Development, the World Bank, the International Monetary Fund, and the Asian Development Bank. Comparative tables and country rankings have been covered by media outlets such as the BBC, The New York Times, The Guardian, Le Monde, Der Spiegel, and El País. Scholarly evaluations have been published in journals like Nature, Science, the Journal of Educational Psychology, and the British Journal of Educational Studies, and incorporated into reform initiatives in jurisdictions including Ontario, Shanghai, Hong Kong, and New Zealand.

Criticisms and Limitations

Scholars and policymakers from institutions such as the University of Cambridge, Columbia University Teachers College, the University of Sydney, and the University of Copenhagen have critiqued PISA on grounds raised by commentators at the Center on International Education Benchmarking and the National Academy of Education. Concerns involve construct validity debated in symposia at the American Educational Research Association, differential item functioning examined by researchers at the University of Oslo and the University of Warsaw, and policy overreach discussed in forums involving the European Commission and UNESCO. Methodological limitations noted by experts from the London School of Economics, the University of Groningen, and the University of Zurich include sampling coverage in regions like Sub-Saharan Africa, cultural bias in items referencing locations such as New York City and Tokyo, and the consequences of high-stakes interpretation for systems in countries including the United States, Mexico, and South Africa.

Category:International assessments