T/AI 126.3-2024 Data Lake Part 3: Data Resource Management System

Scope

Scope: This document outlines the functional architecture of the data resource management system and specifies requirements for system infrastructure support, data integration, data management, data exchange, data analysis and mining, data backup, data security, and SaaS software operation services. This document is applicable to applications deployed on data lakes, including data access, standardized cleaning, management, processing, development, and sharing, and can be used to guide the design and development of data governance tools and products. Main technical content: The system includes 11 functional modules, including visualized operation and maintenance, data assets, data governance, data processing, operation and maintenance management, data application, data services, deployment management, data exploration, standardized mapping, and labeling engines. Among them, the visualized operation and maintenance module can realize functions such as displaying and viewing the system operation visualization, data flow view, data overview view, data governance view, data processing view, and data sharing view; the data assets module can realize functions such as data asset management, asset view viewing, lineage management and lineage query, data set management, and directory cataloging; the data governance module can realize functions such as data governance configuration, data element management, code set management, data integration (various plug-ins, data access and standardization, monitoring), conversion task management, job management, job monitoring, quality rule management, quality evaluation, execution results, output quality report, and data reconciliation; the data processing module can realize functions such as IDE and console configuration; the operation and maintenance management module can realize functions such as task management, task instance monitoring, global instance DAG scheduling monitoring, variable built-in custom variables, execution contr

Development Information

Same series standard

Related Standards