Evaluation Roundtable

Evaluation Roundtable
Name	Evaluation Roundtable
Type	Collaborative forum
Founded	20th century
Headquarters	Global

Evaluation Roundtable is a convening format used by practitioners to assess programs, policies, projects, and publications through structured critique and deliberation. It brings together evaluators, funders, authors, practitioners, and stakeholders in a moderated session to produce actionable findings and recommendations. The format has been adopted by academic institutions, philanthropic foundations, international organizations, and professional associations.

Overview

The Roundtable model synthesizes practices from American Evaluation Association, International Development Research Centre, United Nations Development Programme, Bill & Melinda Gates Foundation, Carnegie Corporation of New York, Ford Foundation, Rockefeller Foundation, Heinrich Böll Foundation, Wellcome Trust, Gates Cambridge Trust, MacArthur Foundation, European Commission, Organisation for Economic Co-operation and Development, World Bank, International Monetary Fund, UNICEF, UNESCO, World Health Organization, Centers for Disease Control and Prevention, National Institutes of Health, National Science Foundation, British Academy, Royal Society, Council of Europe, African Development Bank, Asian Development Bank, Inter-American Development Bank, OECD Development Assistance Committee, RAND Corporation, Brookings Institution, Chatham House, Carnegie Endowment for International Peace, Kaiser Family Foundation, Aspen Institute, Soros Foundation, Open Society Foundations, European Research Council, National Endowment for the Humanities, National Endowment for the Arts, Smithsonian Institution, British Museum, Metropolitan Museum of Art, Tate Modern, Museum of Modern Art, Yale University, Harvard University, Stanford University, University of Oxford, University of Cambridge, London School of Economics, Columbia University, Princeton University, Massachusetts Institute of Technology, Duke University, University of California, Berkeley, University of Chicago, Johns Hopkins University, Pennsylvania State University, University of Michigan, University of Pennsylvania, King's College London, Australian National University, University of Toronto, McGill University, University of British Columbia, Seoul National University, Peking University, Tsinghua University inform standards and convening practices.

History and Development

Origins trace to peer review and deliberative inquiry practices used by Royal Society, Académie des Sciences, German Research Foundation, Stiftelsen Riksbankens Jubileumsfond, Japan Society for the Promotion of Science, National Academy of Sciences (United States), National Academy of Engineering, American Philosophical Society, Royal Swedish Academy of Sciences, Russian Academy of Sciences, Indian Council of Social Science Research, Chinese Academy of Sciences, Brazilian Academy of Sciences, and legacy evaluation traditions within International Labour Organization, Food and Agriculture Organization, World Bank Inspection Panel, OECD Better Life Initiative. Influences include methods codified by Donald T. Campbell, Carol H. Weiss, Michael Quinn Patton, Egon Guba, Yvonna Lincoln, Peter Rossi, Lee Cronbach, Howard White, and standards from Joint Committee on Standards for Educational Evaluation and Program Evaluation and Review Technique. The model spread through workshops at UN Conference on Trade and Development, World Conference on Education for All, Global Partnership for Education, International Conference on Health Promotion, International AIDS Conference, and meetings hosted by European Evaluation Society and American Evaluation Association.

Format and Methodology

Typical sessions adapt facilitation frameworks used by Delphi method, Nominal Group Technique, SWOT analysis, Logic model, Theory of Change, Randomized controlled trial, Quasi-experimental design, Mixed methods research, Participatory Rural Appraisal, Rapid Rural Appraisal, Outcome Mapping, Most Significant Change technique, Kirkpatrick model, Balanced Scorecard, Six Sigma, Lean methodology, and standards from ISO 9001, ISO 31000, PRINCE2, PMBOK Guide. Documents under review draw on reporting templates from Consolidated Standards of Reporting Trials, Preferred Reporting Items for Systematic Reviews and Meta-Analyses, STROBE Statement, CARE guidelines, SQUIRE guidelines, CHEERS statement. Facilitation is often informed by Harvard Negotiation Project, Joseph Juran quality approaches, and deliberative models used at World Economic Forum, Davos Conference, Milken Institute Global Conference, Clinton Global Initiative, Skoll World Forum.

Participants and Roles

Core roles mirror practices at American Evaluation Association meetings: lead facilitator (often affiliated with Independent Evaluation Group (World Bank) or Office of Evaluation (UNICEF)), subject-matter experts from Centers for Disease Control and Prevention, National Institutes of Health, academics from Harvard School of Public Health, London School of Hygiene & Tropical Medicine, Johns Hopkins Bloomberg School of Public Health, methodologists from RAND Corporation, Abt Associates, KPMG, Deloitte, PricewaterhouseCoopers, representatives of funders such as Bill & Melinda Gates Foundation and Wellcome Trust, implementers from CARE International, Oxfam International, Médecins Sans Frontières, Save the Children, World Vision International, and stakeholders from European Commission, African Union Commission, Association of Southeast Asian Nations, G20, BRICS. Roles include rapporteur, devil's advocate, technical reviewer, ethics advisor (drawing on World Medical Association and Nuremberg Code precedents), and knowledge broker linked to Open Knowledge Foundation, Data.org, Creative Commons.

Notable Outcomes and Impact

Roundtables have influenced policy and practice through recommendations later adopted by World Bank, International Monetary Fund, UNICEF, UNESCO, World Health Organization, European Commission, Department for International Development (UK), United States Agency for International Development, Bill & Melinda Gates Foundation, Wellcome Trust, and institutional reforms at Harvard University, University of Oxford, University of Cambridge, Stanford University, Yale University. Outcomes include revised evaluation frameworks in Global Fund to Fight AIDS, Tuberculosis and Malaria, improved monitoring at Gavi, the Vaccine Alliance, adaptations in USAID program cycles, and uptake by OECD Development Assistance Committee guidance. Reports have shaped debates at World Economic Forum, UN General Assembly, and influenced awards such as the MacArthur Fellowship, Gates Cambridge Scholarship, Berkman Klein Center initiatives, and large-scale studies published in The Lancet, Nature, Science, BMJ, and Proceedings of the National Academy of Sciences.

Criticisms and Controversies

Critiques parallel disputes seen in panels convened by Peer Review Congress, Climategate-era debates, controversies involving Big Pharma, and methodological disputes highlighted in reviews by Cochrane Collaboration, PLOS, Retraction Watch, Freedom of Information Act inquiries, and parliamentary committees such as House Committee on Oversight and Accountability and UK Public Accounts Committee. Concerns include conflicts of interest tied to funders like Bill & Melinda Gates Foundation or corporations, tokenization of community voices observed in NGO audits (e.g., Oxfam International inquiries), reproducibility issues noted by Many Labs replication projects, and governance questions raised in reports by Transparency International and Open Government Partnership.

Related Concepts and Applications

Related convening formats and tools include peer review, policy dialogue, stakeholder consultation, technical advisory group, steering committee, advisory board, think tank models such as Brookings Institution, Chatham House, Carnegie Endowment for International Peace, and applied uses in sectors overseen by World Health Organization, UNICEF, UNESCO, World Bank, IMF, European Commission, African Union, ASEAN, G20 and in academic settings at Harvard University, Stanford University, University of Oxford, University of Cambridge, Yale University, Princeton University, Massachusetts Institute of Technology. Applications span program evaluation, manuscript review, grant assessment, policy reform, organizational learning, and cross-sectoral partnership formation.

Category:Evaluation