T/CES 246-2023 Evaluation specification for natural language processing model of electric power artificial intelligence
T/CES 246-2023 Evaluation specification for natural language processing model of electric power artificial intelligence
Basic Information
Scope
Scope: This standard specifies the evaluation indicators and calculation methods for power artificial intelligence natural language processing models, as well as the evaluation process and methods. This standard is applicable to the performance evaluation, efficiency evaluation, and robustness evaluation of power artificial intelligence models in natural language processing. Main technical content: This standard specifies the evaluation indicators and calculation methods for power artificial intelligence natural language processing models, as well as the evaluation process and methods. (1) Terminology and definitions mainly include the definitions of power artificial intelligence and artificial intelligence natural language processing models. (2) Model basic information includes the model developer, development language, development framework, model version, model type, model application, operating environment, training dataset information, and the definition of model files. (3) Evaluation indicators and calculation methods introduce the performance indicators, efficiency indicators, and robustness indicators for the evaluation of power artificial intelligence natural language processing models. (4) Evaluation process and methods introduce the process and methods for the overall evaluation of power artificial intelligence natural language processing.