AI-based personalized Human Activity Recognition in walking and trekking sports: A case study
Keywords:
HAR, SPU, WPU, AI, deviceAbstract
Human Activity Recognition (HAR) is a topic of interest in several areas, for example, health and sports. There are several ways to perform HAR tasks, which must be understood before creating the desired tools. In this article, we carry out a theoretical study to understand the HAR problem and its main techniques using AI. In addition, we present a case study in which we developed a prototype HAR system for walking and trekking. In this study, we evaluated new hardware for HAR with IMUs with 9 degrees of freedom. This system, composed of four sensors called SPU’s was attached to the user’s lower limbs. A device called WPU collects information from these sensors. With the fusion of the collected data, AI techniques were applied with CNN models reaching an accuracy of 98% to classify the human activities in this context, thus creating new perspectives for using AI to HAR in sports.
Downloads
References
E. Thomson, K. Lamb, and C. Nicholas, “The development of a reliable amateur boxing performance analysis template,” Journal of sports sciences, vol. 31, no. 5, pp. 516–528, 2013.
B. N. Cˇ ecˇevic´, L. Antic´, and K. Spasic´, “Cost accounting and performance measurement with the purpose of increasing the competitiveness of sports organizations,” Economic Themes, vol. 58, no. 2, pp. 235–253, 2020.
S. Mitchell, J. Forsyth, and M. S. Thompson, “Exploring amateur performance in athletic tests using wearable sensors,” pp. 1–6, 2021.
E. Ramanujam, T. Perumal, and S. Padmavathi, “Human activity recognition with smartphone and wearable sensors using deep learning techniques: A review,” IEEE Sensors Journal, vol. 21, no. 12, pp. 13029– 13040, 2021.
M. Vrigkas, C. Nikou, and I. A. Kakadiaris, “A review of human activity recognition methods,” Frontiers in Robotics and AI, vol. 2, p. 28, 2015.
D. R. Beddiar, B. Nini, M. Sabokrou, and A. Hadid, “Vision-based human activity recognition: a survey,” Multimedia Tools and Applications, vol. 79, no. 41, pp. 30509–30555, 2020.
V. Bijalwan, V. B. Semwal, and V. Gupta, “Wearable sensor-based pattern mining for human activity recognition: Deep learning approach,” Industrial Robot: the international journal of robotics research and application, vol. 49, no. 1, pp. 21–33, 2022.
K. Chen, D. Zhang, L. Yao, B. Guo, Z. Yu, and Y. Liu, “Deep learning for sensor-based human activity recognition: Overview, challenges, and opportunities,” ACM Computing Surveys (CSUR), vol. 54, no. 4, pp. 1–40, 2021.
H. F. Nweke, Y. W. Teh, M. A. Al-Garadi, and U. R. Alo, “Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges,”
Expert Systems with Applications, vol. 105, pp. 233–261, 2018.
T. Gu, L. Wang, Z. Wu, X. Tao, and J. Lu, “A pattern mining approach to sensor-based human activity recognition,” IEEE Transactions on Knowledge and Data Engineering, vol. 23, no. 9, pp. 1359–1372, 2010.
S. B. ud din Tahir, A. Jalal, and M. Batool, “Wearable sensors for activity analysis using smo-based random forest over smart home and sports datasets,” pp. 1–6, 2020.
N. Dua, S. N. Singh, S. K. Challa, V. B. Semwal, and M. Sai Kumar, “A survey on human activity recognition using deep learning techniques and wearable sensor data,” pp. 52–71, 2023.
N. Dua, S. N. Singh, V. B. Semwal, and S. K. Challa, “Inception inspired cnn-gru hybrid network for human activity recognition,” Multimedia Tools and Applications, vol. 82, no. 4, pp. 5369–5403, 2023.
S. Ramasamy Ramamurthy and N. Roy, “Recent trends in machine learning for human activity recognition—a survey,” Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, vol. 8, no. 4, p. e1254, 2018.
S. Wan, L. Qi, X. Xu, C. Tong, and Z. Gu, “Deep learning models for real-time human activity recognition with smartphones,” Mobile Networks and Applications, vol. 25, no. 2, pp. 743–755, 2020.
X. Zhou, W. Liang, I. Kevin, K. Wang, H. Wang, L. T. Yang, and Q. Jin, “Deep-learning-enhanced human activity recognition for internet of healthcare things,” IEEE Internet of Things Journal, vol. 7, no. 7, pp. 6429–6438, 2020.
Y.-L. Hsu, S.-C. Yang, H.-C. Chang, and H.-C. Lai, “Human daily and sport activity recognition using a wearable inertial sensor network,” IEEE Access, vol. 6, pp. 31715–31728, 2018.
H. A. Imran, “Khail-net: A shallow convolutional neural network for recognizing sports activities using wearable inertial sensors,” IEEE Sensors Letters, vol. 6, no. 9, pp. 1–4, 2022.
T. Steels, B. Van Herbruggen, J. Fontaine, T. De Pessemier, D. Plets, and E. De Poorter, “Badminton activity recognition using accelerometer data,” Sensors, vol. 20, no. 17, p. 4685, 2020.
K. K. Verma and B. M. Singh, “Deep multi-model fusion for human activity recognition using evolutionary algorithms,” 2021.
V. Bijalwan, V. B. Semwal, and T. Mandal, “Fusion of multi-sensorbased biomechanical gait analysis using vision and wearable sensor,” IEEE Sensors Journal, vol. 21, no. 13, pp. 14213–14220, 2021.
S. Hurtado, J. García-Nieto, A. Popov, and I. Navas-Delgado, “Human activity recognition from sensorised patient’s data in healthcare: A streaming deep learning-based approach,” 2023.
“Running & jogging - statistics & facts.” https://www.statista.com/topics/1743/running-and-jogging/#dossierKeyfigures.
J. P. Folland, S. J. Allen, M. I. Black, J. C. Handsaker, and S. E. Forrester, “Running Technique is an Important Component of Running Economy and Performance,” Med Sci Sports Exerc, vol. 49, pp. 1412–
, 07 2017.
R. B. Souza, “An Evidence-Based Videotaped Running Biomechanics Analysis,” Phys Med Rehabil Clin N Am, vol. 27, no. 1, pp. 217–236, 2016.
“Dataset for human activity recognition har.” https://www.kaggle.com/datasets/jonathansilva2020/
recognition-of-human-activity-har-four-classes.
N. Ravi, N. Dandekar, P. Mysore, and M. L. Littman, “Activity recognition from accelerometer data,” vol. 5, no. 2005, pp. 1541–1546, 2005.
“tsaug documentation.” https://tsaug.readthedocs.io/en/stable/. Accessed: 2023-02-10.
“Recognition of human activity with data agumentation.” https://www.kaggle.com/datasets/jonathansilva2020/recognition-of-human-activity-data-agumentation.
S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural computation, vol. 9, no. 8, pp. 1735–1780, 1997.
J. Chung, C. Gulcehre, K. Cho, and Y. Bengio, “Empirical evaluation of gated recurrent neural networks on sequence modeling,” arXiv preprint arXiv:1412.3555, 2014.
J. Koutnik, K. Greff, F. Gomez, and J. Schmidhuber, “A clockwork rnn,” pp. 1863–1871, 2014.
M. Hossin and M. N. Sulaiman, “A review on evaluation metrics for data classification evaluations,” International journal of data mining & knowledge management process, vol. 5, no. 2, p. 1, 2015.
V. B. Semwal, N. Gaud, P. Lalwani, V. Bijalwan, and A. K. Alok, “Pattern identification of different human joints for different human walking styles using inertial measurement unit (imu) sensor,” Artificial Intelligence Review, vol. 55, no. 2, pp. 1149–1169, 2022.
V. Bijalwan, V. B. Semwal, G. Singh, and R. G. Crespo, “Heterogeneous computing model for post-injury walking pattern restoration and postural stability rehabilitation exercise recognition,” Expert Systems, vol. 39, no. 6, p. e12706, 2022.
S. K. Challa, A. Kumar, and V. B. Semwal, “A multibranch cnn-bilstm model for human activity recognition using wearable sensor data,” The Visual Computer, vol. 38, no. 12, pp. 4095–4109, 2022.
