T/AI 126-2023 Data Lake, Part 1: Magneto-Optical Hybrid Media Distributed Storage System

Scope

Scope: This document applies to the data lake phase, providing standard specifications for the distributed storage system serving as the storage foundation in the data lake. This document presents the technical architecture of the magneto-optical-electrical hybrid media distributed storage system, stipulates functional requirements, performance requirements, information security requirements, and construction environment requirements, and provides technical references for data access and storage in the data lake. This document is applicable to the design, manufacturing, and application of magneto-optical-electrical hybrid media distributed storage systems. Main technical content: The data lake aggregates massive data from governments, enterprises, and individuals. In data governance and asset management, there are common problems such as inconsistent data standards, low data quality, and data security. At the same time, there are challenges of data access in a complex environment of heterogeneous systems, full storage media and full life cycle data management, multi-scene data analysis and mining, and secure and trustworthy data sharing and exchange. The data lake series of standards focuses on the three scenarios of data entry, storage, and exit in the data lake, and meets urgent needs in aspects such as hierarchical data storage, analysis and processing, AI requirement definition, application technology framework, and AI application business implementation, forming a standardized series of data lake application technologies.

Development Information

Related Standards