Third International Mathematics and Science Study

Third International Mathematics and Science Study

The Third International Mathematics and Science Study was a large-scale cross-national assessment conducted in 1999 that compared student achievement in mathematics and science across many nations, coordinated by the International Association for the Evaluation of Educational Achievement and involving national centers in countries such as the United States, Japan, Germany, Australia, and the Russian Federation. It followed earlier comparative studies like the Second International Mathematics Study and informed subsequent work such as the Programme for International Student Assessment and the Trends in International Mathematics and Science Study. The study produced extensive datasets, technical reports, and policy analyses used by organizations including the Organisation for Economic Co-operation and Development, the World Bank, and national ministries such as the United States Department of Education and the Ministry of Education, Culture, Sports, Science and Technology (Japan).

Background and objectives

TIMSS 1999 aimed to measure achievement and curricular exposure in mathematics and science among cohorts in grades tied to national systems, building on legacies from the First International Mathematics Study and the Second International Mathematics Study. Objectives included estimating cross-national achievement levels for student populations represented by national samples, investigating associations with classroom and school variables collected by instruments used by the International Association for the Evaluation of Educational Achievement and national research centers, and creating a public-use database for secondary analysis by scholars at institutions like Harvard University, Stanford University, University of Cambridge, and Columbia University. Participating entities ranged from national assessment agencies to supranational organizations such as the European Commission and development partners like the United Nations Educational, Scientific and Cultural Organization.

Methodology and sampling

TIMSS 1999 employed stratified multistage probability sampling under technical guidance from the International Association for the Evaluation of Educational Achievement and statistical consultants from institutions such as the University of Michigan and the National Center for Education Statistics. Target populations included cohorts in grade levels that approximate ages assessed in national systems, with national samples drawn in countries including Brazil, China, Egypt, France, Italy, South Africa, and South Korea. Sampling procedures used school lists supplied by national authorities such as the Ministry of Education (France), and field operations were coordinated by contractors with experience supporting projects for the United States Agency for International Development and the European Union. Weighting and variance estimation followed procedures recommended by the International Statistical Institute and were described in technical manuals prepared by research teams at Boston College and the University of Twente.

Assessment instruments and content

The assessment battery combined multiple-choice and constructed-response items developed by panels of experts from member countries, with frameworks influenced by national curricula such as those from England and Wales, Finland, Japan, and Germany (Federal Republic of Germany). Test design integrated cognitive frameworks and content domains to capture topics aligned with standards issued by bodies like the National Council of Teachers of Mathematics and national science curricula from ministries including the Ministry of Education, Culture, Sports, Science and Technology (Japan). Instruments included student background questionnaires, teacher questionnaires, and school questionnaires modeled after earlier instruments used by the National Center for Education Statistics and adapted by research centers at institutions such as the Australian Council for Educational Research and the Educational Testing Service. Field tests used translation and adaptation procedures consistent with guidelines from International Organization for Standardization and involved expert reviews from university faculties such as University of Toronto and University of Melbourne.

Key findings and international comparisons

TIMSS 1999 reported wide variation in performance across participating education systems, with high average scores observed in jurisdictions such as Singapore, Hong Kong, South Korea, Japan, and certain provinces of the People's Republic of China, while other systems including Mexico, Brazil, and parts of South Africa scored lower on average. The reports highlighted relationships between achievement and factors like instructional time, teacher qualifications, and access to resources—topics of interest to researchers at entities like RAND Corporation and OECD. Cross-domain analyses compared performance patterns against trends from earlier studies, and independent scholars at Teachers College, Columbia University, University of Chicago, and London School of Economics used the public database to examine equity, gender differences, and curricular alignment. Comparative tables in TIMSS publications were cited in policy reviews by the European Commission, the United Nations Development Programme, and national legislatures such as the United States Congress.

Impact, critiques, and policy implications

TIMSS 1999 influenced policymaking and scholarly debates in ministries including the United States Department of Education, the Department of Education (Philippines), and the Ministry of Education (Israel), and informed initiatives by international organizations like the World Bank and the Organisation for Economic Co-operation and Development. Critics from academic centers such as Massachusetts Institute of Technology, University of California, Berkeley, and King's College London raised concerns about construct validity, curriculum alignment, and cultural bias in translation procedures, while statisticians at the International Statistical Institute and the Royal Statistical Society critiqued sampling variance and standard error reporting. Subsequent policy responses included curriculum reviews in jurisdictions such as England and Wales, teacher professional development programs in Australia and New Zealand, and increased investment in assessment infrastructure by countries such as Turkey and Chile. TIMSS 1999's legacy persisted through adoption of longitudinal and cyclical assessment designs by organizations like the Trends in International Mathematics and Science Study and methodological reforms influenced by research at University College London and the Institute of Education Sciences (United States).

Category:International educational assessment