Facial Action Coding System

Facial Action Coding System
CNX Anatomy 2013 · CC BY 4.0 · source
Name	Facial Action Coding System
Abbreviation	FACS
Developed	1970s
Creators	Paul Ekman, Wallace V. Friesen
Based on	Anatomical study of facial musculature
Application	Emotion research, behavioral science, computer vision

Facial Action Coding System

The Facial Action Coding System is a comprehensive framework for categorizing facial movements by underlying muscular actions. Originating from anatomy and behavioral science traditions, it has been applied across psychology, neuroscience, computer vision, and human factors research in contexts involving subjects ranging from clinical patients to performers. Its development intersected with work conducted at institutions and research centers that influenced emotion theory and expression studies.

History and development

FACS emerged from collaborations linking researchers at the University of California, Berkeley and laboratories influenced by figures such as Paul Ekman, Wallace V. Friesen, and laboratories associated with University of California, San Francisco, Stanford University, and clinics like Massachusetts General Hospital where facial nerve and muscle studies were conducted. Early precursors included anatomical mappings performed by scientists affiliated with Harvard University and comparative work from researchers connected to Smithsonian Institution collections. The system was shaped amid contemporaneous debates involving scholars at University of Oxford, University of Cambridge, and institutes where emotion research overlapped with projects by investigators tied to National Institutes of Health, National Institute of Mental Health, and research centers funded through grants from agencies like the National Science Foundation. Influences from practitioners associated with the American Psychological Association and conferences hosted by organizations such as the Society for Neuroscience helped disseminate methods that later fed into FACS training and adoption.

Structure and coding system

FACS organizes facial behavior into Action Units (AUs) that correspond to contractions of specific facial muscles identified in anatomical atlases used by departments at Johns Hopkins University, Mayo Clinic, and museums such as the Royal College of Surgeons that house anatomical models. Coders trained in protocols developed by teams connected to University of Pennsylvania and research groups that collaborated with laboratories at Columbia University learn to annotate onset, apex, and offset phases in video segments similar to methods used in clinical assessments at Cleveland Clinic and performance evaluations at institutions like the Royal Academy of Dramatic Art. The taxonomy aligns with measurement practices used in studies by scholars from Yale University, New York University, and international centers including University of Tokyo and University of Toronto, and it supports composite scoring routines comparable to those used in biometric projects at MIT and Carnegie Mellon University.

Application and uses

FACS has been applied in diverse applied settings involving participants drawn from cohorts studied at University College London, University of Melbourne, King's College London, and research hospitals such as Barnes-Jewish Hospital. Researchers affiliated with World Health Organization initiatives have used FACS-like protocols for cross-cultural emotion comparisons, complementing fieldwork by investigators working with teams at Princeton University, University of Chicago, and regional research hubs like Indian Institute of Science and Peking University. In computer vision and machine learning, groups at Google, Microsoft Research, Facebook AI Research, Amazon Web Services, and academic labs at ETH Zurich and Tsinghua University have implemented automated AU detection pipelines for applications spanning human–computer interaction, affective computing, and surveillance. Clinical researchers from Johns Hopkins Hospital and rehabilitation centers such as Walter Reed National Military Medical Center have used FACS for facial palsy assessment and intervention outcome studies, while performative arts researchers at institutions like the Juilliard School analyze expressions for training actors and studying nonverbal communication. Commercial applications have appeared in products developed by companies linked to accelerators and investors in Silicon Valley, and policy discussions have engaged stakeholders from organizations such as the American Civil Liberties Union and industry groups at International Organization for Standardization meetings.

Validity, reliability, and limitations

Validity and reliability evaluations have been undertaken by research teams associated with Brown University, Duke University, University of Michigan, and cross-institutional consortia that include contributors from Imperial College London and McGill University. Psychometric analyses often reference studies performed under ethical oversight from institutional review boards at Columbia University Irving Medical Center and testing conducted at national facilities like Lawrence Berkeley National Laboratory. Critiques raised by scholars from Princeton University and University of Edinburgh address issues of ecological validity, coder bias, and cultural generalizability, while methodological advancements developed by labs at University of California, Los Angeles and Seoul National University seek to quantify inter-rater agreement and algorithmic fairness. Limitations noted by clinical investigators at Mount Sinai Health System and forensic researchers in criminal justice departments touch on ambiguity in linking AUs to subjective states and risks when used in high-stakes decisions, prompting regulatory conversations involving entities such as the European Commission and national legislatures.

Training, certification, and software implementations

Certification programs and training workshops have been offered by institutes founded by figures connected to Paul Ekman and by continuing education providers affiliated with American Psychological Association divisions and professional bodies like the Association for Computational Linguistics. Accredited training modules and reliability testing are administered in venues ranging from university extension programs at University of Washington to workshops hosted at conferences such as the Conference on Computer Vision and Pattern Recognition and meetings organized by the Association for the Advancement of Artificial Intelligence. Software implementations of FACS annotation and automated AU detection are maintained by research groups at Carnegie Mellon University, Massachusetts Institute of Technology, University of Oxford, and companies such as Affectiva and startups spun out of incubators in Silicon Valley; open-source toolkits have been developed in collaborations involving contributors from GitHub repositories and labs at University of Illinois Urbana-Champaign. Training resources, textbooks, and certification exams are used by practitioners at hospitals like Brigham and Women's Hospital and in academic programs at University of Southern California.

Category:Nonverbal communication