artificial intelligence
Linux Foundation launches new open source AI and data platform aimed at democratizing next-generation AI technology
As part of its efforts to “democratize” AI technology, the Linux Foundation is partnering with Intel, Anyscale, Cloudera, Datastax, Domino Data Lab, Hugging Face, and other industry players to launch a new open source AI/data platform. I launched it.
Open Platform for Enterprise AI (OPEA) is a “sandbox project” from the organization's LF AI & Data division that is a comprehensive foundation that supports open source innovation in AI and data. The goal is to accelerate and enable the development of flexible, scalable generative AI (Gen AI) systems that leverage the best open source innovations from across the ecosystem.
OPEA works with industry to standardize components such as frameworks, architecture blueprints, and reference solutions that demonstrate performance, interoperability, reliability, and enterprise-grade readiness to address the rapidly evolving Gen AI field. aims to address fragmentation.
Specifically, the OPEA platform includes:
- A detailed framework of composable building blocks for state-of-the-art generative AI systems, including LLMs, data stores, and prompting engines.
- Architectural blueprint for search-enhanced generative AI component stack structure and end-to-end workflows
- A four-level rating for evaluating generative AI systems for performance, functionality, reliability, and enterprise-grade readiness.
The democratization of AI was mentioned by several partners, including:
- Red Hat: “As artificial intelligence continues to evolve, open source is playing a critical role in standardizing and democratizing the models, frameworks, platforms, and tools that enterprises need to realize value from AI.”
- Faces hugging each other: “Hugging Face's mission is to democratize superior machine learning and maximize its positive impact across industry and society. Join OPEA's open source consortium to accelerate the value of Generative AI to enterprises. This allows us to continue to promote open models and simplify Gen AI adoption.”
The democratization of AI has been an ongoing theme since heavy industry investment pivoted many AI efforts away from research and development and toward commercial, money-making applications. (See “Democratizing the Future of AI Research and Development”).
“OPEA is at a critical juncture in Gen AI projects, especially those leveraging RAG. [Retrieval-Augmented Generation]are becoming increasingly popular due to their ability to extract significant value from existing data repositories,” the LF AI & Data Foundation said in an April 16 blog post.
“However, the rapid advancement of Gen AI technology has led to fragmentation of tools, technologies, and solutions. OPEA is working with industry to standardize components such as frameworks, architectural blueprints, and performance reference solutions. “We plan to address this issue by making it interoperable, reliable, and enterprise-grade responsive,” the foundation said.
About the author
David Ramel is an editor and writer at Converge360.