T/CRSS 0012-2023 Active Group standards

T/CRSS 0012-2023 Performance evaluation method for Chinese voice interaction system in service robotics

Publish Date: 2023-12-29 Implement Date: 2023-12-29 For services related to genuine standard inquiry, procurement, translation, and other related services in China, please Contact Us

Price: $ 20.00

Out of stock

Basic Information

Standard Code: T/CRSS 0012-2023

Standard Type: Group standards

Standard Status: Active

is_force_gb: no

CCS Name: -

ICS Name: Comprehensive Application of Information Technology

Publish Date: 2023-12-29

Implement Date: 2023-12-29

Scope

Scope: This document specifies the terminology definitions, technical requirements, test conditions, test methods, and evaluation indicators for the performance evaluation of Chinese voice interaction systems in service robots. This document is applicable to Chinese voice interaction systems in service robots. Main technical content: 1. Scope 2. Normative reference documents 3. Terms and definitions 4. Creating a database of evaluation voice materials 4.1 Design of evaluation corpus 4.2 Requirements for voice recording 5. Creating a database of background noise 5.1 Types of noise 5.2 Noise acquisition environment 6. Setting up the test environment 6.1 Living scenarios 6.2 Silenced indoor scenarios 7. Test methods 7.1 Overview 7.2 Description of test methods based on the database of evaluation voice materials 7.3 Description of test methods based on on-site oral utterances 7.4 General requirements 7.5 Test items 8. Evaluation standards 8.1 Multi-round dialogue driven by tasks 8.2 Open-domain chat 8.3 Speech recognition accuracy 8.4 Speech synthesis Appendix A (Normative) Semantic analysis scoring standard table Appendix B (Informative) Sampling rates of five common audio formats