T/SIA 38-2024 Guidelines for Evaluating the Capabilities of Artificial Intelligence Enterprises

Scope

Scope: This standard is applicable to enterprises engaged in artificial intelligence business, aiming to objectively evaluate their overall level and capability in conducting AI-related operations. This standard can serve as the basis for third-party assessments and certifications. Main technical content: - Preface and Introduction - Standards for Evaluating AI Enterprise Capabilities 1. Scope 2. Normative Reference Documents 3. Terms and Definitions 3.1 Artificial Intelligence 3.2 Precision Rate 3.3 Recall Rate 3.4 F1 Value 3.5 Confusion Matrix 3.6 ROC Curve 3.7 AUC Value 3.8 Cross-Entropy Loss 3.9 Robustness 3.10 Software Project Management Capacity Assessment 4. Elements of AI Enterprise Capacity Evaluation 5. AI Enterprise Capacity Evaluation Model 5.1 Enterprise Foundations 5.1.1 Stability 5.1.2 Staffing Scale 5.1.3 Service Chain 5.2 Technological Innovation Capacity 5.2.1 R&D Investment 5.2.2 R&D Personnel 5.2.3 R&D Outputs 5.2.4 Industry Recognition 5.3 Project Management and Quality Management Capacity 5.3.1 Project-Level Management Capacity 5.3.2 Organization-Level Management Capacity 5.3.3 Quality Management Capacity 5.4 Financial and Credit Status 5.4.1 Revenue Situation 5.4.2 Growth Potential 5.4.3 Credit Status 5.5 Product Technology Capacity 5.5.1 General Product Capacity of AI Enterprises 5.5.2 Customized Product Capacity of AI Enterprises 6. Evaluation Standard Grade Classification 7. Application Scenarios of AI Enterprise Capacity Evaluation Model

Development Information

Related Standards