T/CITIF 011-2023

Scope: This document specifies the robustness grading requirements and performance evaluation methods for artificial intelligence systems used to detect the safety of video content. This document is applicable to third-party inspection and testing institutions, technology manufacturers, and technology application parties for conducting test evaluations of the robustness of artificial intelligence systems for content safety detection. Main technical content: It specifies the robustness grading requirements for artificial intelligence systems used to detect the safety of video content. According to the generation method of test samples and the difficulty of data acquisition, the test samples are graded. Through the test results of test samples of different grades, a comprehensive evaluation of the performance evaluation indicators, processes, and methods of the robustness of artificial intelligence systems is constructed.