You are required to read and agree to the below before accessing a full-text version of an article in the IDE article repository.

The full-text document you are about to access is subject to national and international copyright laws. In most cases (but not necessarily all) the consequence is that personal use is allowed given that the copyright owner is duly acknowledged and respected. All other use (typically) require an explicit permission (often in writing) by the copyright owner.

For the reports in this repository we specifically note that

  • the use of articles under IEEE copyright is governed by the IEEE copyright policy (available at http://www.ieee.org/web/publications/rights/copyrightpolicy.html)
  • the use of articles under ACM copyright is governed by the ACM copyright policy (available at http://www.acm.org/pubs/copyright_policy/)
  • technical reports and other articles issued by M‰lardalen University is free for personal use. For other use, the explicit consent of the authors is required
  • in other cases, please contact the copyright owner for detailed information

By accepting I agree to acknowledge and respect the rights of the copyright owner of the document I am about to access.

If you are in doubt, feel free to contact webmaster@ide.mdh.se

Adaptive Runtime Response Time Control in PLC-based Real-Time Systems using Reinforcement Learning

Publication Type:

Conference/Workshop Paper

Venue:

13th International Symposium on Software Engineering for Adaptive and Self-Managing Systems


Abstract

Timing requirements such as constraints on response time are key characteristics of real-time systems and violations of these requirements might cause a total failure, particularly in hard real-time systems. Runtime monitoring of the system properties is of great importance to detect and mitigate such failures. Thus, a runtime control to preserve the system properties could improve the robustness of the system with respect to timing violations. Common control approaches may require a precise analytical model of the system which is difficult to be provided at design time. Reinforcement learning is a promising technique to provide adaptive model-free control when the environment is stochastic, and the control problem could be formulated as a Markov Decision Process. In this paper, we propose an adaptive runtime control using reinforcement learning for real-time programs based on Programmable Logic Controllers (PLCs), to meet the response time requirements. We demonstrate through multiple experiments that our approach could control the response time efficiently to satisfy the timing requirements.

Bibtex

@inproceedings{Helali Moghadam5053,
author = {Mahshid Helali Moghadam and Mehrdad Saadatmand and Markus Borg and Markus Bohlin and Bj{\"o}rn Lisper},
title = {Adaptive Runtime Response Time Control in PLC-based Real-Time Systems using Reinforcement Learning},
month = {May},
year = {2018},
booktitle = {13th International Symposium on Software Engineering for Adaptive and Self-Managing Systems},
url = {http://www.es.mdu.se/publications/5053-}
}