SIGOPS Experimental Systems Workshop
Generated by GPT-5-miniExpansion Funnel Raw 162 → Dedup 0 → NER 0 → Enqueued 0
| SIGOPS Experimental Systems Workshop | |
|---|---|
| Name | SIGOPS Experimental Systems Workshop |
| Abbrev | ESW |
| Discipline | Computer science |
| Established | 2011 |
| Frequency | Annual |
| Venue | Various |
| Organizer | Association for Computing Machinery |
| Sponsor | ACM SIGOPS |
SIGOPS Experimental Systems Workshop The SIGOPS Experimental Systems Workshop is an annual technical meeting associated with the Association for Computing Machinery that gathers researchers from University of California, Berkeley, Massachusetts Institute of Technology, Stanford University, Carnegie Mellon University and industry labs such as Google, Microsoft Research, Facebook (Meta Platforms), Amazon (company) to discuss experimental systems research. The workshop emphasizes reproducibility, benchmarking, and empirical evaluation, attracting participants from Intel Corporation, NVIDIA, IBM, Oracle Corporation, and national labs including Lawrence Berkeley National Laboratory and Argonne National Laboratory. Presenters have included faculty and staff from Princeton University, University of Toronto, ETH Zurich, University of Cambridge, and Technische Universität München.
Overview
ESW focuses on experimental methods in systems research and operates within the ecosystem of events like the USENIX Symposium on Operating Systems Design and Implementation, ACM Symposium on Operating Systems Principles, International Conference on Architectural Support for Programming Languages and Operating Systems, Conference on File and Storage Technologies, and International Conference on High Performance Computing, Networking, Storage and Analysis. The workshop attracts participants working on topics found at Google Research, Microsoft Research Redmond, Facebook AI Research, Amazon Web Services, Apple Inc., Dropbox, and leading universities such as University of Illinois at Urbana–Champaign, Cornell University, Yale University. ESW sessions often feature collaborations with labs at Los Alamos National Laboratory, Sandia National Laboratories, Oak Ridge National Laboratory, and institutions like Tsinghua University, Peking University, Seoul National University, University of Melbourne, and University of Sydney.
History and Evolution
The workshop emerged in the 2010s amid debates spotlighted at conferences like SIGCOMM, INFOCOM, NeurIPS, ICML about reproducibility and experimental rigor. Early organizers included researchers affiliated with University of Washington, University of California, San Diego, University of Texas at Austin, Brown University, and University of Massachusetts Amherst. Over time ESW expanded to include contributors from Bell Labs, Hewlett-Packard Laboratories, Xerox PARC, Lenovo Research, Huawei, Samsung Research, Tencent, Baidu Research, and academic groups at ETH Zurich, École Polytechnique Fédérale de Lausanne, Imperial College London. The workshop adapted practices championed by groups at OpenStack Foundation, Apache Software Foundation, and initiatives like Reproducibility Project-style efforts and policy discussions at National Science Foundation and European Research Council.
Organizing Structure and Sponsorship
Organizers are volunteers drawn from ACM SIGOPS leadership and committees with ties to ACM SIGCOMM, IEEE Computer Society, USENIX Association, IEEE Communications Society, and institutes such as ACM, IEEE, National Institute of Standards and Technology, and Computing Research Association. Sponsors have included corporate partners like Google Cloud, Microsoft Azure, IBM Research AI, Intel Labs, NVIDIA Research, Red Hat, Canonical (company), and non-profits like CRA-W, ACM-W. Program committees have featured members from MIT CSAIL, Berkeley RISELab, Stanford PPL, CMU Parallel Data Lab, Princeton Center for Information Technology Policy.
Submission and Review Process
Submissions to ESW historically include short papers, artifact evaluations, and position statements. The review process is managed by a program committee with expertise from SIGPLAN, SIGMETRICS, SIGMOD, SOSP, and OSDI communities, drawing reviewers from USENIX FAST and EuroSys. Artifact evaluation leverages repositories and services provided by GitHub, Zenodo, Figshare, Software Heritage, Docker Hub, and continuous integration platforms such as Jenkins, Travis CI, GitLab CI. Authors often cite benchmarks and datasets originating from SPEC, TPC, MLPerf, ImageNet groups and infrastructures like XSEDE, PRACE, Google Cloud Platform, Amazon EC2, and Microsoft Azure.
Topics and Notable Research Contributions
ESW has featured work on cloud systems, distributed storage, virtualization, container orchestration, and performance measurement with presenters from Kubernetes, Docker, Ceph, Hadoop, Spark, Kubernetes SIG, OpenStack. Notable contributions include experimental methodologies influencing projects at Linux Foundation, CoreOS, Red Hat OpenShift, Mesos, and research prototypes from Silicon Graphics International, Intel Tangle Lake, and university labs at MIT Lincoln Laboratory and SRI International. Papers have advanced practices used in TensorFlow, PyTorch, Apache Flink, Apache Kafka, Druid, Presto, and influenced standards at IETF and W3C.
Workshops, Tutorials, and Community Activities
ESW programs include tutorials and hands-on sessions led by practitioners from Google Cloud Platform, AWS Lambda, Azure Functions, and educators from Harvard University, Stanford Online, edX, Coursera. Community-building activities have partnered with initiatives from Women in Machine Learning, Lesbians Who Tech, Grace Hopper Celebration, and mentorship programs hosted by CRA-WP and ACM-W. Satellite events have included panels with representatives from National Science Foundation Office of Advanced Cyberinfrastructure, European Commission Horizon 2020, DARPA, Defense Advanced Research Projects Agency program officers, and technology policy discussions involving Electronic Frontier Foundation.
Impact and Influence on Systems Research
The workshop has influenced reproducibility policies at venues like NeurIPS, ICLR, ACL, and contributed to benchmarking standards that informed guidelines at National Institutes of Health and funding programs at European Research Council. ESW alumni have taken roles at companies and institutions including Google DeepMind, OpenAI, DeepSigma, Meta Reality Labs, Apple Machine Learning Research, NVIDIA Research, and in faculty positions at University of California, Los Angeles, University of Michigan, Columbia University, Duke University, Johns Hopkins University. The workshop's emphasis on artifacts and empirical rigor continues to shape practices across the ACM and IEEE communities.
Category:Computer science workshops