AI data specialist SelectStar (CEO Kim Se-yeop) announced on the 2nd that it participated as a testing agency for the 'AI-MASTER', a private AI reliability certification system hosted by the Korea Artificial Intelligence Industry Association (AIIA).
'AI-MASTER' is a private-sector-led AI reliability verification and certification project that quantitatively verifies a total of 63 evaluation items based on the 'Trustworthy AI' principles of the European Union (EU) and nine ISO/IEC international standards. SelectStar and SureSoftTech are participating as testing agencies.
SelectStar took on the role of a testing agency in the field of large language models (LLM), and participated in jointly designing a certification framework, defining evaluation items, and developing automated evaluation tools. In particular, it designed a rubric-based evaluation system for four major Trustworthy AI evaluation items and eight sub-items: human behavioral subjectivity, supervision, technical robustness, safety, transparency, and social and environmental welfare.
This certification evaluation utilized SelectStar’s self-developed AI reliability verification automation solution, ‘Datumo Eval’. This solution analyzed model response quality and calculated quantitative scores to secure the objectivity of certification, and approximately 60% of all evaluation items were conducted through automated evaluation.
The 'AI-MASTER' certification is issued by the Korea Artificial Intelligence Industry Association after technical verification by a testing agency and certification review by industry, academia, and research experts. It is expected to be linked to government research and development projects, public procurement, and high-impact AI designation systems in the future, and the introduction of a global certification mutual recognition system is also under review.
Kim Se-yeop, CEO of Selectstar, said, “Through participation in the AI-MASTER testing agency, we can now apply our reliability assessment capabilities to the public certification system,” and “We will contribute to improving AI safety and service quality centered on DatuMo Ebal.”
- See more related articles
You must be logged in to post a comment.