AI-driven Human Motion Classification and Analysis using Laban Movement System

by Guo, W. | Craig, O. | Difato, T. | Oliverio, J. | Santoso, M. | Sonke, J. | Barmpoutis, A.

Proceedings of the International Conference on Human-Computer Interaction, Lecture Notes in Computer Science (LNCS), vol. 13319, 2022, pp. 201–210. https://doi.org/10.1007/978-3-031-05890-5_16

Category:

Description

Human movement classification and analysis are important in the research of health sciences and the arts. Laban movement analysis is an effective method to annotate human movement in dance that describes communication and expression. Technology-supported human movement analysis employs motion sensors, infrared cameras, and other wearable devices to capture critical joints of the human skeleton and facial key points. However, the aforementioned technologies are not mainstream, and the most popular form of motion capture is conventional video recording, usually from a single stationary camera. Such video recordings can be used to evaluate human movement or dance performance. Any methods that can systematically analyze and annotate these raw video footage would be of great importance to this field. Therefore, this research offers an analysis and comparison of AI-based computer vision methods that can annotate the human movement automatically. This study trained and compared four different machine learning algorithms (random forest, K neighbors, neural network, and decision tree) through supervised learning on existing video datasets of dance performances. The developed system was able to automatically produce annotation in the four dimensions (effort, space, shape, body) of Laban movement analysis. The results demonstrate accurately produced annotations in comparison to manually entered ground truth Laban annotation.

Additional information

Author

Guo, W., Craig, O., Difato, T., Oliverio, J., Santoso, M., Sonke, J., Barmpoutis, A.

Title

In: Duffy, V.G. (eds) Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. Anthropometry, Human Behavior, and Communication. HCII 2022. Lecture Notes in Computer Science

Year

2022

Pages

201–210

PDF

guo_hcii2022.pdf

DOI

https://doi.org/10.1007/978-3-031-05890-5_16

Journal

Proceedings of the International Conference on Human-Computer Interaction, Lecture Notes in Computer Science (LNCS)

Volume

13319

Citation

Citation

Guo, W., Craig, O., Difato, T., Oliverio, J., Santoso, M., Sonke, J. and Barmpoutis, A., 2022. AI-driven Human Motion Classification and Analysis using Laban Movement System. Proceedings of the International Conference on Human-Computer Interaction, Lecture Notes in Computer Science (LNCS), vol. 13319, pp. 201–210. https://doi.org/10.1007/978-3-031-05890-5_16

BibTex

@article{digitalWorlds:295,
doi = {https://doi.org/10.1007/978-3-031-05890-5_16},
author = {Guo, W. and Craig, O. and Difato, T. and Oliverio, J. and Santoso, M. and Sonke, J. and Barmpoutis, A.},
title = {AI-driven Human Motion Classification and Analysis using Laban Movement System},
journal = {Proceedings of the International Conference on Human-Computer Interaction, Lecture Notes in Computer Science (LNCS)},
volume = {13319},
year = {2022},
pages = {201–210}
}