T/SAIAS 019-2024 Financial Big Model Application Evaluation Guideline
T/SAIAS 019-2024 Financial Big Model Application Evaluation Guideline
Basic Information
Scope
Main technical content: This standard aims to establish a framework system for evaluating large-scale financial models. Firstly, it can accurately assess the performance of the model in aspects such as language understanding, logical reasoning, and risk control, so as to promote improvement and upgrading. Secondly, it can ensure financial security and compliance, standardize data processing to ensure safety, and promote applications that meet regulatory requirements to reduce compliance risks. Thirdly, it can promote industry development and innovation, achieve standardization and norms, reduce development and application costs, and stimulate innovation vitality. This standard proposes the core capabilities and evaluation methods required for the application of large-scale models in the financial vertical field, including five aspects: model basic capabilities, financial security and value alignment capabilities, financial risk control capabilities, financial professional cognition capabilities, and financial business auxiliary expansion capabilities. It also provides evaluation methods.