Machine Learning to Improve Situational Awareness in Beyond Visual Range Air Combat
Keywords:
Artificial Intelligence, Machine Learning, Artificial Neural Networks, Data Science, Air CombatAbstract
This article presents an artificial intelligence model using artificial neural networks that provide parameters to improve the situational awareness of a Beyond Visual Range (BVR) air combat pilot. In this combat modality, it is necessary to make decisions based on information from sensors, mainly radars. Furthermore, since information regarding enemy aircraft systems is sometimes unknown, pilots' decisions are usually based on beliefs regarding the opponent. The presented model proposes to deal with such characteristics, generating behaviors for entities represented in a constructive simulation environment, i.e., simulated people operating simulated systems. We created BVR air combat simulations between two aircraft, with only one missile each, through Latin Hypercube Sampling (LHS) to choose input variables to cover almost homogeneously all their ranges. The aircraft have similar behaviors, and their parameters may change only at the beginning of the simulation. The simulation environment generated ten thousand air combat scenarios, varying thirty-six input parameters, for the analysis proposed in the case study. From this data, we could create supervised machine learning models that substantially improve the BVR air combat pilot's situational awareness regarding offensive situations, in which the reference aircraft employs a missile against a target, or defensive positions, in contrast to when the same reference aircraft tries to avoid a possible enemy's missile launched in its direction. The offensive and defensive models were consistent with the accuracy of 0.930 and 0.924 and the F1-score of 0.717 and 0.678, respectively. Thus, the contribution of this work is to use machine learning algorithms to generate responses concerning the tactical state to improve the pilot's situational awareness and, therefore, the in-flight decision-making process.
Downloads
References
L. C. P. Higby and U. Col, “Promise and reality: Beyond visual range (bvr) air-to-air combat,” Air War College (AWC) Electives Program: Air Power Theory, Doctrine, and Strategy: 1945–Present, vol. 30, 2005.
B. Kurniawan, P. Vamplew, M. Papasimeon, R. Dazeley, and C. Foale, “An empirical study of reward structures for actor-critic reinforcement learning in air combat manoeuvring simulation,” in Australasian Joint Conference on Artificial Intelligence, pp. 54–65, Springer, 2019.
K. Yuan, D. Liu, D. Jiang, Z. Zhang, and X. Lei, “Design of target aircraft auto air-combat tactics decision system,” in Theory, Methodology, Tools and Applications for Modeling and Simulation of Complex Systems, pp. 288–296, Springer, 2016.
H. C. Marques, D. Geraldo, and L. H. Macêdo, “Arcabouço de Combate BVR - Plataforma de Apoio à Decisão e ao Treinamento de Pilotos,” Revista Spectrum, n. 19, Comando-Geral de Operações Aéreas, Setembro 2015.
I. Jane’s, “White Paper Fast Jet Cost Per Flight Hour ( Cpfh ),” 2012.
A. N. Costa, F. L. Medeiros, J. P. Dantas, D. Geraldo, and N. Y. Soma, “Formation control method based on artificial potential fields for aircraft flight simulation,” SIMULATION, p. 00375497211063380, 2021.
A. N. Costa, R. L. Paes, M. Zawadzki, and D. Geraldo, “Scenario analysis as a decision-support tool: a maritime patrol case study,” Spectrum - Aplicações Operacionais Áreas de Defesa, vol. 22, pp. 30–34, 2021.
A. G. Bruzzone and M. Massei, “Simulation-based military training,” in Guide to Simulation-Based Disciplines, pp. 315–361, Springer, 2017.
J. P. Dantas, A. N. Costa, D. Geraldo, M. R. Maximo, and T. Yoneyama, “Engagement decision support for beyond visual range air combat,” in 2021 Latin American Robotics Symposium (LARS), 2021 Brazilian Symposium on Robotics (SBR), and 2021 Workshop on Robotics in Education (WRE), pp. 96–101, IEEE, 2021.
J. Karelahti, K. Virtanen, and T. Raivio, “Game optimal support time of a medium range air-to-air missile,” Journal of guidance, control, and dynamics, vol. 29, no. 5, pp. 1061–1069, 2006.
K. Virtanen, J. Karelahti, and T. Raivio, “Modeling air combat by a moving horizon influence diagram game,” Journal of guidance, control, and dynamics, vol. 29, no. 5, pp. 1080–1091, 2006.
H. Mukai, A. Tanikawa, I. Tunay, I. Ozcan, I. Katz, H. Schättler, P. Rinaldi, G. Wang, L. Yang, and Y. Sawada, “Sequential linear- quadratic method for differential games with air combat applications,” Computational Optimization and Applications, vol. 25, no. 1, pp. 193–222, 2003.
Y. Ma, G. Wang, X. Hu, H. Luo, and X. Lei, “Cooperative occupancy decision making of multi-uav in beyond-visual-range air combat: A game theory approach,” IEEE Access, vol. 8, pp. 11624–11634, 2019.
J.-S. Ha, H.-J. Chae, and H.-L. Choi, “A stochastic game-based approach for multiple beyond-visual-range air combat,” Unmanned Systems, vol. 6, no. 01, pp. 67–79, 2018.
J. Poropudas and K. Virtanen, “Analyzing air combat simulation results with dynamic bayesian networks,” in 2007 winter simulation conference, pp. 1370–1377, IEEE, 2007.
L. Fu, X. Long, and W. He, “Air combat assignment problem based on bayesian optimization algorithm,” Journal of Shanghai Jiaotong University (Science), pp. 1–7, 2021.
N. Rao, S. Kashyap, G. Gopalaratnam, and D. Mandal, “Situation and threat assessment in bvr combat,” in AIAA Guidance, Navigation, and Control Conference, p. 6241, 2011.
P. Du and H.-y. Liu, “Study on air combat tactics decision-making based on bayesian networks,” in 2010 2nd IEEE International Conference on Information Management and Engineering, pp. 252–256, IEEE, 2010.
S. Akabari, M. B. Menhaj, and S. Nikravesh, “Fuzzy modeling of offensive maneuvers in an air-to-air combat,” in Computational Intelligence, Theory and Applications, pp. 171–184, Springer, 2005.
C. Tran, A. Abraham, and L. Jain, “Adaptation of a mamdani fuzzy inference system using neuro-genetic approach for tactical air combat decision support system,” in Australian Joint Conference on Artificial Intelligence, pp. 672–680, Springer, 2002.
A. Prabhu, H. Manivannan, K. Sridhar, S. Ahmed, and L. Shrinivasan, “Decision fusion using type-1 fuzzy logic for situation assessment in aviation scenarios,” in 2014 International Conference on Advances in Electronics Computers and Communications, pp. 1–6, IEEE, 2014.
C. Heinze, B. Smith, and M. Cross, “Thinking quickly: Agents for modeling air warfare,” in Australian Joint Conference on Artificial Intelligence, pp. 47–58, Springer, 1998.
Z. Lin, T. Ming’an, Z. Wei, and Z. Shengyun, “Sequential maneuvering decisions based on multi-stage influence diagram in air combat,” Journal of Systems Engineering and Electronics, vol. 18, no. 3, pp. 551–555, 2007.
D. Hu, R. Yang, J. Zuo, Z. Zhang, J. Wu, and Y. Wang, “Application of deep reinforcement learning in maneuver planning of beyond visual-range air combat,” IEEE Access, vol. 9, pp. 32282–32297, 2021.
A. Toubman, J. J. Roessingh, P. Spronck, A. Plaat, and J. van den Herik, “Rapid adaptation of air combat behaviour,” in Proceedings of the Twenty-Second European Conference on Artificial Intelligence, ECAI’16, (NLD), p. 1791–1796, IOS Press, 2016.
H. Piao, Z. Sun, G. Meng, H. Chen, B. Qu, K. Lang, Y. Sun, S. Yang, and X. Peng, “Beyond-visual-range air combat tactics auto-generation by reinforcement learning,” in 2020 International Joint Conference on Neural Networks (IJCNN), pp. 1–8, IEEE, 2020.
Y. Weilin, D. Wei, P. Shuangchun, X. Yu, and P. Liang, “Decision-making of one-on-one beyond-visual-range air combat based on improved q-network,” in 2018 IEEE International Conference on Mechatronics and Automation (ICMA), pp. 809–815, IEEE, 2018.
G. Li, Y. Wang, C. Lu, and Z. Zhang, “Multi-uav air combat weapon-target assignment based on genetic algorithm and deep learning,” in 2020 Chinese Automation Congress (CAC), pp. 3418–3423, IEEE, 2020.
Z. Yang, D. Zhou, H. Piao, K. Zhang, W. Kong, and Q. Pan, “Evasive maneuver strategy for ucav in beyond-visual-range air combat based on hierarchical multi-objective evolutionary algorithm,” IEEE Access, vol. 8, pp. 46605–46623, 2020.
Y. Kang, Z. Liu, Z. Pu, J. Yi, and W. Zu, “Beyond-visual-range tactical game strategy for multiple uavs,” in 2019 Chinese Automation Congress (CAC), pp. 5231–5236, IEEE, 2019.
J. Yao, Q. Huang, and W. Wang, “Adaptive cgfs based on grammatical evolution,” Mathematical Problems in Engineering, vol. 2015, 2015.
I. N. Da Silva, D. H. Spatti, R. A. Flauzino, L. H. B. Liboni, and S. F. dos Reis Alves, “Artificial neural network architectures and training processes,” in Artificial neural networks, pp. 21–28, Springer, 2017.
J. P. A. Dantas, A. N. Costa, V. C. F. Gomes, A. R. Kuroswiski, F. L. L. Medeiros, and D. Geraldo, “ASA: A Simulation Environment for Evaluating Military Operational Scenarios,” in The 20th International Conference on Scientific Computing (CSC’22), The 2022 World Congress in Computer Science, Computer Engineering & Applied Computing (CSCE’22), 2022.
A. N. Costa, “Sequential Optimization of Formation Flight Control Method Based on Artificial Potential Fields,” Master’s Thesis, Instituto Tecnológico de Aeronáutica, São José dos Campos, SP, Brazil, 2019.
J. P. A. Dantas, “Apoio à decisão para o combate aéreo além do alcance visual: uma abordagem por redes neurais artificiais.,” Master’s Thesis, Instituto Tecnológico de Aeronáutica, São José dos Campos, SP, Brazil, 2018.
J. P. A. Dantas, A. N. Costa, D. Geraldo, M. R. A. O. Maximo, and T. Yoneyama, “Weapon engagement zone maximum launch range estimation using deep neural network,” in Intelligent Systems (A. Britto and K. Valdivia Delgado, eds.), vol. 13074 of Lecture Notes in Computer Science, Springer, Cham., 2021.
F. A. Administration, Airplane Flying Handbook. Oklahoma City, OK: United States Department of Transportation, Airman Testing Standards Branch, 2021.
M. McKay, R. Beckman, and W. Conover, “A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output from a Computer Code,” Technometrics, vol. 21, no. 2, pp. 239–245, 1979.
M. R. Endsley, “Toward a Theory of Situation Awareness in Dynamic Systems,” Human Factors: The Journal of the Human Factors and Ergonomics Society, vol. 37, no. 1, pp. 32–64, 1995.
R. Lippmann, “An introduction to computing with neural nets,” IEEE ASSP Magazine, vol. 4, no. 2, pp. 4–22, 1987.
I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. MIT Press, 2016. http://www.deeplearningbook.org.
G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, “Improving neural networks by preventing co-adaptation of feature detectors,” ArXiv, vol. abs/1207.0580, 2012.
S. Bock and M. Weiß, “A proof of local convergence for the adam optimizer,” in 2019 International Joint Conference on Neural Networks (IJCNN), pp. 1–8, IEEE, 2019.
D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.
M. Kuhn, K. Johnson, et al., Applied predictive modeling, vol. 26. Springer, 2013.
G. Menardi and N. Torelli, “Training and assessing classification rules with imbalanced data,” Data mining and knowledge discovery, vol. 28, no. 1, pp. 92–122, 2014.
L. A. Jeni, J. F. Cohn, and F. De La Torre, “Facing imbalanced data–recommendations for the use of performance metrics,” in 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, pp. 245–251, 2013.
C. E. Brown, “Coefficient of variation,” in Applied multivariate statistics in geohydrology and related sciences, pp. 155–157, Springer, 1998.
