T/CAQ 20203-2023 Machine translation service quality evaluation specification for both Chinese and English directions
T/CAQ 20203-2023 Machine translation service quality evaluation specification for both Chinese and English directions
Basic Information
Scope
Scope: This document specifies the requirements for evaluation methods, evaluation processes, and evaluation capabilities needed for evaluating Chinese-English bidirectional machine translation services. This document is applicable to the quality evaluation of Chinese-English bidirectional machine translation services. Main technical content: This document is based on the internal quality requirements of well-known domestic machine translation providers and industry-standard testing requirements, and unifies and refines evaluation methods, evaluation processes, evaluation capability requirements, evaluation indicators, and judgment rules. By using this document, a unified standard can be applied to conduct scientific, effective, and efficient evaluations of the quality of machine translation services, and to verify the compliance of machine translation products with customer requirements. This document also provides three appendices, which are used to disclose the sources of test sets and the types of error annotations.