Investigating how interaction with physical objects within virtual environments affects knowledge acquisition and recall
by Garrett, R. | Gast, J. | Henry, S. | Mellili, K. | Seung, H. J. | Santoso, M. | Barmpoutis, A.
In: Stephanidis, C., Antona, M., Ntoa, S., Salvendy, G. (eds) HCI International 2024 Posters. HCII 2024. Communications in Computer and Information Science (CCIS), vol. 2116, June 29-July 4, 2024, pp. 33-40. https://doi.org/10.1007/978-3-031-61950-2_4
In: Stephanidis, C., Antona, M., Ntoa, S., Salvendy, G. (eds) HCI International 2024 Posters. HCII 2024. Communications in Computer and Information Science (CCIS), vol. 2116, June 29-July 4, 2024, pp. 33-40. https://doi.org/10.1007/978-3-031-61950-2_4
Description
The use of passive haptics in virtual reality environments has been shown to improve procedural learning across various application domains such as first responders training, kayaking, and others (Calandra at al. 2023, Barmpoutis et al. 2020). In this paper we want to go one step further and quantify the effect of passive haptics on knowledge acquisition and recall. We developed a specialized virtual reality application for learning various chemical compounds and their components. Participants engaged in activities that involved precise mixing and proportioning of chemical components to form targeted compounds (see Figure 1). Employing an A-B test framework, participants were randomly assigned to two identical virtual reality environments, differing only in the substitution of the VR controller with a physical jar.
Post-study surveys were administered to gauge user perceptions regarding interaction accuracy and realism, as well as their ability to recall acquired knowledge (specifically, the list of ingredients) from their virtual experience. This pilot study, conducted at the University of Florida Reality Lab, involved 12 subjects. Rigorous statistical analyses, including chi-square tests, were performed on the collected data, with detailed results outlined in this paper.
Two key findings emerged from the study: (a) the presence of the physical jar significantly heightened perceived interaction accuracy, particularly in precise liquid pouring tasks, and (b) users exhibited a remarkable 33% improvement in knowledge recall when utilizing the physical jar as opposed to a conventional VR controller. These results establish a compelling, statistically significant correlation between the integration of passive haptic objects in VR and knowledge acquisition and recall. Furthermore, this study lays the groundwork for a larger-scale study in the future.
Additional information
| Author | Garrett, R., Gast, J., Henry, S., Mellili, K., Seung, H. J., Santoso, M., Barmpoutis, A. |
|---|---|
| Journal | In: Stephanidis, C., Antona, M., Ntoa, S., Salvendy, G. (eds) HCI International 2024 Posters. HCII 2024. Communications in Computer and Information Science (CCIS) |
| Year | 2024 |
barmpoutis_hcii2024b.pdf |
|
| Volumue | 2116 |
| Month | June 29-July 4 |
| Volume | 2116 |
| DOI | |
| Pages | 33-40 |
Citation
Citation
Garrett, R., Gast, J., Henry, S., Mellili, K., Seung, H., Santoso, M. and Barmpoutis, A., 2024. Investigating how interaction with physical objects within virtual environments affects knowledge acquisition and recall. In: Stephanidis, C., Antona, M., Ntoa, S., Salvendy, G. (eds) HCI International 2024 Posters. HCII 2024. Communications in Computer and Information Science (CCIS), vol. 2116, pp. 33-40. https://doi.org/10.1007/978-3-031-61950-2_4
BibTex
@article{digitalWorlds:308,
doi = {https://doi.org/10.1007/978-3-031-61950-2_4},
author = {Garrett, R. and Gast, J. and Henry, S. and Mellili, K. and Seung, H. J. and Santoso, M. and Barmpoutis, A.},
title = {Investigating how interaction with physical objects within virtual environments affects knowledge acquisition and recall},
journal = {In: Stephanidis, C., Antona, M., Ntoa, S., Salvendy, G. (eds) HCI International 2024 Posters. HCII 2024. Communications in Computer and Information Science (CCIS)},
month = {June 29-July 4},
volume = {2116},
year = {2024},
pages = {33-40}
} 
