T/SAITA 001-2023 Active Group standards

T/SAITA 001-2023 Natural language processing system evaluation specification

T/SAITA 001-2023 Natural language processing system evaluation specification

Publish Date: 2023-12-18 Implement Date: 2023-12-20 For services related to genuine standard inquiry, procurement, translation, and other related services in China, please Contact Us
Price: $ 20.00
Out of stock

Basic Information

Standard Code: T/SAITA 001-2023
Standard Type: Group standards
Standard Status: Active
is_force_gb: no
CCS Name: Software engineering
ICS Name: Software development and system files
Publish Date: 2023-12-18
Implement Date: 2023-12-20

Scope

Scope: It specifies the basic framework of natural language processing systems, the evaluation index system, the evaluation process, and the evaluation methods, and provides evaluation guidelines for natural language processing systems. Main technical content: It specifies the basic framework of natural language processing systems; proposes an evaluation index system for natural language processing systems that includes 10 first-level indicators and 36 second-level indicators, covering indicators such as functional effectiveness, performance, compatibility, maintainability, interpretability, and security; specifies the evaluation process and testing methods for natural language processing systems. The appendix specifies the calculation methods for the functional effectiveness of natural language understanding and natural language generation, and provides relevant reference datasets and evaluation guidelines for natural language processing systems.

Development Information

Related Standards

Contact Us