Certification Game for the Safety Analysis of AI-Based CPS

Current certification procedures aim at establishing trust in manufacturers of artificial intelligence/machine learning based cyber-physical systems. The certification process usually requires the manufacturer to demonstrate excellence in following safety engineering standards and regulations throughout the holistic system’s engineering process. This paper touches on the need for real-world performance monitoring performed by the certifier to ensure that the operational system does not deviate from the specifications. We propose an interactive cooperative process between the manufacturer and certifier which aims at verifying conformance and consistency between the specifications and the operational model while preserving the manufacturer’s competitive advantage.