Independent Commission on Information Retrieval

Independent Commission on Information Retrieval
Name	Independent Commission on Information Retrieval
Formation	2019
Type	Commission
Headquarters	Geneva
Leader title	Chair

Independent Commission on Information Retrieval The Independent Commission on Information Retrieval was an ad hoc panel formed to evaluate algorithms, archives, and portals used for large-scale retrieval in public and private sectors. It convened experts from institutions such as Oxford University, Harvard University, Stanford University, Massachusetts Institute of Technology and European Commission partners to assess practices linked to platforms like Google, Facebook, Twitter and repositories managed by United Nations agencies.

Background and Establishment

The commission was established in response to concerns raised after events including the Cambridge Analytica scandal, the 2016 United States presidential election, the Brexit referendum, the Arab Spring uprisings and disputes around the Wikileaks disclosures, with founding signatories from Amnesty International, Human Rights Watch, Electronic Frontier Foundation, OpenAI research collaborators and representatives from Council of Europe. Formation discussions referenced prior bodies such as the Royal Society, the National Academy of Sciences (United States), the European Data Protection Supervisor and inquiries like the Leveson Inquiry, and drew expertise from scholars at Princeton University, Yale University, Columbia University, Cornell University and University of Cambridge.

Mandate and Objectives

The commission's mandate encompassed auditing retrieval systems used by entities such as Bloomberg L.P., Thomson Reuters, Walmart, Amazon (company), Apple Inc. and public institutions including European Parliament libraries and the World Health Organization. Objectives included evaluating compliance with instruments like the General Data Protection Regulation, the Charter of Fundamental Rights of the European Union, the International Covenant on Civil and Political Rights, and guidance from bodies such as the Organisation for Economic Co-operation and Development and the International Telecommunication Union.

Organizational Structure and Governance

Governance incorporated a chair drawn from academia, vice-chairs from United Nations Educational, Scientific and Cultural Organization and civil society, and panels modelled on advisory committees from NATO, World Bank, International Monetary Fund and the Bill & Melinda Gates Foundation. Subcommittees mirrored structures used by the Intergovernmental Panel on Climate Change, the Pew Research Center, the Berkman Klein Center and the Alan Turing Institute. Advisory roles included liaisons from European Court of Human Rights, Supreme Court of Canada jurists, and technologists from IBM, Microsoft, DeepMind and academic labs at University of California, Berkeley.

Methodologies and Information Retrieval Practices

Methodologies drew on techniques refined in projects at Sloan School of Management, MIT Media Lab, Stanford Artificial Intelligence Laboratory, and used benchmarks popularized by datasets from ImageNet, GLUE benchmark, CIFAR-10 and corpora held by Library of Congress, British Library, and Institut Pasteur. Practices evaluated included indexing strategies used by Elasticsearch, ranking systems influenced by PageRank, query expansion methods deployed at Yahoo!, relevance feedback models from Bell Labs, and stewardship frameworks advocated by Open Data Institute and Creative Commons.

Key Findings and Reports

The commission issued reports citing systemic biases comparable to analyses by ProPublica, case studies akin to those in The New York Times, and technical annexes using approaches from Nature (journal), Science (journal), Communications of the ACM and IEEE Spectrum. Findings highlighted issues similar to controversies at YouTube, Instagram, Reddit, and regulatory challenges mirrored in policy debates at European Commission and legislative hearings in the United States Congress and the Parliament of the United Kingdom.

Criticism and Controversies

Critics referenced precedents set in disputes involving Wikimedia Foundation, Snowden leaks, Edward Snowden, Chelsea Manning, and argued parallels with tensions seen in rulings by the European Court of Justice, disputes involving Apple Inc. and FBI, and debates documented by The Guardian, The Washington Post, Reuters and BBC News. Controversies included accusations from stakeholders such as Fox News, New York Post, National Rifle Association, and regulatory pushback involving officials from Ministry of Justice (United Kingdom), U.S. Department of Justice, and representatives at G7 meetings.

Impact and Legacy

The commission influenced policymaking at entities including the European Commission, the Council of the European Union, the United Nations Human Rights Council, and national legislatures in Germany, France, Canada, India and Australia, and informed guidance adopted by institutions like World Health Organization, International Committee of the Red Cross and UNESCO. Its frameworks were cited in academic work from University of Chicago, Johns Hopkins University, Duke University, National University of Singapore and in standards deliberations at International Organization for Standardization and the Institute of Electrical and Electronics Engineers.

Category:International commissions