LF AI & Data Foundation

LF AI & Data Foundation
Name	LF AI & Data Foundation
Founded	March 11, 2018
Headquarters	San Francisco, California, United States
Key people	Ibrahim Haddad (Executive Director)
Parent	The Linux Foundation
Website	https://lfaidata.foundation/

LF AI & Data Foundation is a sub-foundation of The Linux Foundation dedicated to fostering open source innovation in the fields of artificial intelligence (AI), machine learning (ML), and data science. It provides a neutral, collaborative home for projects, aiming to accelerate their development and adoption through shared resources and governance. The foundation supports a wide ecosystem, from established technology companies to academic institutions and individual developers, promoting interoperability and ethical practices.

History

The initiative was announced by The Linux Foundation in March 2018, building upon the earlier success of its Acumos AI project. Its creation was a response to the rapid fragmentation within the open source AI software landscape, seeking to provide a unified governance structure similar to those used for foundational projects like Kubernetes and Hyperledger. Key early supporters included technology leaders like AT&T, IBM, and Huawei, who recognized the need for vendor-neutral collaboration to avoid proprietary lock-in. The foundation has since grown significantly, launching numerous graduated projects and hosting major events such as the Open Source Summit.

Governance

Governance is structured to ensure project neutrality and strategic direction, overseen by a Governing Board composed of representatives from premier member organizations like Tencent, Baidu, and Capital One. Technical oversight is managed by a Technical Advisory Council (TAC), which includes maintainers from key projects such as ONNX and PyTorch, guiding technical consensus and project lifecycle decisions. Day-to-day operations and community development are led by an executive director and supported by dedicated staff from The Linux Foundation. This model ensures alignment with the principles of open governance that have underpinned successful foundations like the Cloud Native Computing Foundation.

Projects

The foundation hosts a diverse portfolio of projects under a maturity classification system, including Graduated, Incubating, and Sandbox stages. Notable graduated projects include ONNX (Open Neural Network Exchange), a format for representing deep learning models, and Adlik, a toolkit for deep learning model inference. Incubating projects feature initiatives like Milvus, a vector database for AI applications, and Feast, a feature store for machine learning. The sandbox tier serves as an entry point for early-stage innovation, hosting projects such as Egeria, focused on data governance, and Marquez, for data lineage tracking.

Member organizations

Membership is tiered, with Premier members including global technology firms such as Alibaba Cloud, Ericsson, Hewlett Packard Enterprise, and Nokia. General members encompass a wide range of entities from financial services companies like JPMorgan Chase to academic bodies such as University of Cambridge. Associate members include influential non-profits and open source alliances like the Open Source Initiative and RISC-V International. This diverse membership base ensures cross-industry collaboration and funding, supporting events, developer outreach, and shared infrastructure.

Objectives and focus areas

Primary objectives include promoting the adoption of open source AI technologies, establishing best practices for responsible AI, and ensuring technical interoperability among tools and frameworks. Key focus areas are the development of robust MLOps pipelines, advancements in natural language processing through projects like Delta Lake, and support for data privacy standards. The foundation also prioritizes education and training, offering resources and certifications in collaboration with entities like the Open Source Hardware Association to build a skilled global community.

Relationship with the Linux Foundation

It operates as a funded sub-foundation under the umbrella of The Linux Foundation, leveraging its parent's extensive administrative, legal, and marketing infrastructure. This relationship provides access to a global network and shared services used by other sister foundations such as the Cloud Native Computing Foundation and Hyperledger. While maintaining its own specialized technical focus and governance boards, it aligns its overall strategy and open source philosophy with the broader mission of The Linux Foundation, participating in joint events like KubeCon and Open Networking Summit.

Category:Open-source organizations Category:Artificial intelligence organizations Category:Linux Foundation projects