T/CECC 021-2023 Machine translation product capability evaluation - Requirements and evaluation methods for Chinese-English bidirectional machine translation

Scope

Scope: This standard specifies the methods for constructing test sets, automatic evaluation methods, and manual evaluation methods for Chinese-English bidirectional machine translation evaluation. This standard applies to the automatic and manual evaluation of the translation quality of Chinese-English bidirectional machine translation; Main technical content: This standard mainly includes the following contents: (1) Scope: This section mainly stipulates the technical requirements and corresponding test methods that Chinese-English bidirectional machine translation products should have. This section is applicable to the design, R&D, testing, evaluation, and acceptance of Chinese-English bidirectional machine translation products. (2) Normative reference documents: This section gives the normative reference documents of this part. (3) Terms and definitions: This section gives the terms and definitions that need to be defined in this part. (4) Symbols and abbreviations: This section gives the symbols and abbreviations that need to be defined in this part. (5) Overall requirements: It proposes the overall requirements for the evaluation of Chinese-English bidirectional machine translation products and clarifies the overall framework of functional points. The overall framework includes 6 first-level functional points, namely scope, normative reference documents, terms and definitions, symbols and abbreviations, overall requirements, and technical requirements. (6) Technical requirements: It expands and describes in detail each first-level functional point in the overall framework, resulting in 5 second-level functional points and 0 third-level functional points. Among them, the functional point types are divided into "mandatory" and "optional". "Mandatory" refers to the functions that need to be supported by data directory management tools, and "optional" refers to the functions that are recommended to be supported by data directory management tools. This section propos

Development Information

Related Standards