Safety is a decisive factor in the development and operation of software and systems. It encompasses both functional safety and information security. Under defined conditions, such a system must work safely and minimize potential dangers. Targeted safety analyses make it possible to take preventive measures at an early stage: Reduce anomalies in system behavior, minimize unauthorized access to data or systems and protect against misuse and loss. In addition, the reliability of the systems is improved and security is continuously increased during development.
A major challenge in performing security analysis is the shortage of skilled labor, which is exacerbated by growing system complexity and the operation of legacy systems. Companies are struggling to optimize time-to-market while ensuring the quality and standard compliance of their systems. Especially in highly automated systems, complex operational areas lead to a multitude of possible critical situations that are difficult to manage.
Artificial intelligence (AI) can help here if it is used in a considered manner. Hallucinations or non-deterministic behavior of the models give rise to risks.
Despite this challenge, AI offers significant advantages. Through the targeted use of AI, companies can focus their scarce human resources on the essential aspects of security and safety analysis. The (partial) automation of processes leads to an increase in efficiency, enables the early detection of security risks and improves response times and risk management. The successful use of AI in security and safety analyses requires detailed knowledge. In-depth experience in the areas of safety, security and AI is also necessary. This is the only way to make the uncertainties, limits and risks of AI manageable. A well-thought-out interaction concept between humans and AI tools is crucial to ensure the quality of results in critical areas and avoid hallucinations. Our ongoing research aims to integrate AI support into safety and security processes and safety analyses of systems.