A DEVS Based Methodological Framework for Reinforcement Learning Agent Training

Authors

Keywords:

support for training , RL agents, Reinforcement Learning, DEVS, AI-enabled systems, Artifi

Abstract

Reinforcement Learning has become one of the fastest growing fields of artificial intelligence due to the successful application of its techniques into several domains. In this way, the integration of intelligent agents based on Reinforcement Learning into information systems is a current reality. However, the way in which they “learn” requires a simulation model of the process that must be controlled to obtain large volumes of risk-free information. In this work, a methodological framework to support the training of Reinforcement Learning agents using DEVS is proposed. This framework provides the steps and elements required to implement RL Agents with the purpose of accelerating the agent learning and reducing training costs. Also, it allows modeling the dynamics of complex systems in a modular and hierarchical way, favoring the reuse of simulation components, since it is based on DEVS formalims fundamentals.

Downloads

Download data is not yet available.

Author Biographies

Ezequiel Beccaria, Universidad Tecnológica Nacional

Ezequiel Beccaria received the Engineering degree in Information Systems Engineering from the Universidad Tecnológica Nacional of Argentina (UTN-Argentina) in 2010. Is an aspiring PhD. in Information Systems at the Universidad Tecnológica Nacional and has developed several works in the area of reinforcement learning and deep learning.

Veronica Bogado, Universidad Tecnológica Nacional

Verónica Bogado received a PhD degree in Engineering with Information Systems Engineering (2013) from the Universidad Tecnológica Nacional, Facultad Regional Santa Fe. She is currently working at the Department of Information Systems Engineering of the Facultad Regional Villa María, Universidad Tecnológica Nacional. Her current research interests are related to software quality evaluation, software architecture design, and M\&S of complex systems, particularly DEVS formalism and its application to software problems.

Jorge Andres Palombarini, CIT - CONICET - UNVM / Facultad Regional Villa María - Universidad Tecnológica Nacional

Jorge A. Palombarini received his PhD. in Information Systems Engineering from the Universidad Tecnológica Nacional of Argentina (UTN-Argentina) in 2014. Current academic position includes Associate Professor of Artificial Intelligence and Syntax and Semantic of Languages in the UTN, and Assistant Research Fellow of CONICET. He was a software developer in private sector institutions and auditor of information systems on Universidad Nacional de Villa María, Argentina (UNVM-Argentina). His current research interest includes Reinforcement learning, Deep Learning, Cognitive systems and Formal Frameworks for industrial process modeling and simulation.

Published

2021-06-07

How to Cite

Beccaria, E., Bogado, V., & Palombarini, J. A. (2021). A DEVS Based Methodological Framework for Reinforcement Learning Agent Training. IEEE Latin America Transactions, 19(4), 679–687. Retrieved from https://latamt.ieeer9.org/index.php/transactions/article/view/3873