T/ZSA 15-2021 Active Group standards

T/ZSA 15-2021 The evaluation of the capabilities of a task-oriented intelligent dialogue system

T/ZSA 15-2021 The evaluation of the capabilities of a task-oriented intelligent dialogue system

Publish Date: 2021-06-11 Implement Date: 2021-06-12 For services related to genuine standard inquiry, procurement, translation, and other related services in China, please Contact Us
Price: $ 50.00
Out of stock

Basic Information

Standard Code: T/ZSA 15-2021
Standard Type: Group standards
Standard Status: Active
is_force_gb: no
CCS Name: Information processing technology
ICS Name: The application of information technology in office work
Publish Date: 2021-06-11
Implement Date: 2021-06-12

Scope

Scope: This document establishes an evaluation system for the intelligent capabilities of task-oriented dialogue systems, clarifies the classification of capabilities, and provides a grading evaluation table for each type of capability, specifying the performance requirements for each level of capability. This document is applicable to the classification, grading, and evaluation of the capabilities of intelligent dialogue systems. Main technical content: Since the rise of artificial intelligence theory and technology, a large number of theoretical perspectives and application analyses have emerged, leading to complex technical specifications, guidelines, and document provisions, as well as numerous terms. Among them, the field of dialogue robots, which is characterized by the application of artificial intelligence, has many sub-fields with inconsistent, incompatible, and non-interoperable evaluation standards, causing great confusion for researchers, developers, and users of these products. Therefore, establishing an intelligent capability evaluation standard for dialogue robots or artificial intelligence dialogue systems can help build an intelligent infrastructure that is compatible with social norms, safe, and highly scalable. This document establishes an evaluation system for intelligent dialogue systems aimed at completing tasks in the field of artificial intelligence. It divides intelligent capabilities into three types and five levels, clarifying their respective components and corresponding performance requirements. This document is compatible with existing national and group standards in China, such as intelligent voice interaction systems and artificial intelligence grading assessments. It is applicable to task-oriented intelligent dialogue systems, and other non-task-oriented intelligent dialogue systems can also refer to it for use. This document can be used as a reference by designers and developers of artificial intelligence systems, theoretical res

Development Information

Related Standards

Contact Us