Extra or supernumerary robotic limbs are actively exploited in the field of body augmentation. The science of self-recognition of additional body parts is an interesting subject. Although the field is primarily led by psychological studies in virtual reality, which facilitate flexible experimental designs, we believe that assessments employing real robots are also essential. In this study, we investigated the sense of body ownership and agency of a dual-arm wearable robotic arm using an inexpensive and safe inflatable structure. We report the results of functional near-infrared spectroscopy (fNIRS) analysis of brain activity during the use of the robotic arm. The questionnaire results from the experiment, which involved a button-touching task, revealed that both the sense of ownership and sense of agency were significantly higher in the goal-oriented collaborative experience compared to the non-goal-oriented condition. This indicates that humans feel ownership of and agency toward an autonomous robot or a remote-controlled robotic arm operated by another person. The analysis of the fNIRS data included a two-factor analysis of variance for the learning and trial phases. While there was no main effect for the conditions within each phase, a significant interaction was observed between the two brain regions of the right angular gyrus and right postcentral gyrus.

1. [1] D. Prattichizzo et al., “Human augmentation by wearable supernumerary robotic limbs: Review and perspectives,” Progress in Biomedical Engineering, Vol.3, No.4, Article No.042005, 2021. https://doi.org/10.1088/2516-1091/ac2294
2. [2] B. Llorens-Bonilla, F. Parietti, and H. H. Asada, “Demonstration-based control of supernumerary robotic limbs,” 2012 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), pp. 3936-3942, 2012. https://doi.org/10.1109/IROS.2012.6386055
3. [3] M. Y. Saraiji, T. Sasaki, R. Matsumura, K. Minamizawa, and M. Inami, “Fusion: Full body surrogacy for collaborative communication,” Proc. of ACM SIGGRAPH 2018 Emerging Technologies, Article No.7, 2018. https://doi.org/10.1145/3214907.3214912
4. [4] A. Kojima, H. Yamazoe, and J.-H. Lee, “Wearable robot arm with consideration of weight reduction and practicality,” J. Robot. Mechatron., Vol.32, No.1, pp. 173-182, 2020. https://doi.org/10.20965/jrm.2020.p0173
5. [5] P. Schmaus et al., “Knowledge driven orbit-to-ground teleoperation of a robot coworker,” IEEE Robotics and Automation Letters, Vol.5, No.1, pp. 143-150, 2020. https://doi.org/10.1109/LRA.2019.2948128
6. [6] H. Kim, Y. Ohmura, and Y. Kuniyoshi, “Transformer-based deep imitation learning for dual-arm robot manipulation,” 2021 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), pp. 8965-8972, 2021. https://doi.org/10.1109/IROS51168.2021.9636301
7. [7] Z. Fu, T. Z. Zhao, and C. Finn, “Mobile ALOHA: Learning bimanual mobile manipulation with low-cost whole-body teleoperation,” arXiv:2401.02117, 2024. https://doi.org/10.48550/arXiv.2401.02117
8. [8] K. Hauser et al., “Analysis and perspectives on the ANA Avatar XPRIZE competition,” Int. J. of Social Robotics, 2024. https://doi.org/10.1007/s12369-023-01095-w
9. [9] K. Kilteni, R. Groten, and M. Slater, “The sense of embodiment in virtual reality,” Presence, Vol.21, No.4, pp. 373-387, 2012. https://doi.org/10.1162/PRES_a_00124
10. [10] E. Abdi, E. Burdet, M. Bouri, and H. Bleuler, “Control of a supernumerary robotic hand by foot: An experimental study in virtual reality,” PLOS ONE, Vol.10, No.7, Article No.e0134501, 2015. https://doi.org/10.1371/journal.pone.0134501
11. [11] K. Arai et al., “Embodiment of supernumerary robotic limbs in virtual reality,” Scientific Reports, Vol.12, No.1, Article No.9769, 2022. https://doi.org/10.1038/s41598-022-13981-w
12. [12] Y. Sato, T. Kawase, K. Takano, C. Spence, and K. Kansaku, “Body ownership and agency altered by an electromyographically controlled robotic arm,” Royal Society Open Science, Vol.5, No.5, Article No.172170, 2018. https://doi.org/10.1098/rsos.172170
13. [13] P. Haselager, “Did I do that? Brain-computer interfacing and the sense of agency,” Minds and Machines, Vol.23, No.3, pp. 405-418, 2013. https://doi.org/10.1007/s11023-012-9298-7
14. [14] M. Jazbec et al., “Body-swapping experiment with an android robot: Investigation of the relationship between agency and a sense of ownership toward a different body,” 2017 IEEE Int. Conf. on Systems, Man, and Cybernetics (SMC), pp. 1471-1476, 2017. https://doi.org/10.1109/SMC.2017.8122821
15. [15] L. Aymerich-Franch, D. Petit, G. Ganesh, and A. Kheddar, “Embodiment of a humanoid robot is preserved during partial and delayed control,” 2015 IEEE Int. Workshop on Advanced Robotics and its Social Impacts (ARSO), 2015. https://doi.org/10.1109/ARSO.2015.7428218
16. [16] I. Hussain, G. Salvietti, G. Spagnoletti, and D. Prattichizzo, “The Soft-SixthFinger: A wearable EMG controlled robotic extra-finger for grasp compensation in chronic stroke patients,” IEEE Robotics and Automation Letters, Vol.1, No.2, pp. 1000-1006, 2016. https://doi.org/10.1109/LRA.2016.2530793
17. [17] L. Tiziani et al., “Empirical characterization of modular variable stiffness inflatable structures for supernumerary grasp-assist devices,” The Int. J. of Robotics Research, Vol.36, Nos.13-14, pp. 1391-1413, 2017. https://doi.org/10.1177/0278364917714062
18. [18] P. H. Nguyen, C. Sparks, S. G. Nuthi, N. M. Vale, and P. Polygerinos, “Soft Poly-Limbs: Toward a new paradigm of mobile manipulation for daily living tasks,” Soft Robotics, Vol.6, No.1, pp. 38-53, 2018. https://doi.org/10.1089/soro.2018.0065
19. [19] X. Liang et al., “Design and characterization of a novel fabric-based robotic arm for future wearable robot application,” 2017 IEEE Int. Conf. on Robotics and Biomimetics (ROBIO), pp. 367-372, 2017. https://doi.org/10.1109/ROBIO.2017.8324445
20. [20] Y. Seong, “Design research of wearable soft avatar robot for interactive social presence,” J. Robot. Mechatron., Vol.34, No.2, pp. 325-327, 2022. https://doi.org/10.20965/jrm.2022.p0325
21. [21] M. Shiomi, H. Sumioka, and H. Ishiguro, “Survey of social touch interaction between humans and robots,” J. Robot. Mechatron., Vol.32, No.1, pp. 128-135, 2020. https://doi.org/10.20965/jrm.2020.p0128
22. [22] H. Nito, M. Narita, K. Higo, and S. Shimada, “A study on self-body recognition for a four-armed avatar simultaneously controlled by two people in a VR space,” Trans. of the Virtual Reality Society of Japan, Vol.27, No.4, pp. 323-330, 2022 (in Japanese). https://doi.org/10.18974/tvrsj.27.4_323
23. [23] T. Yamada, S. Umeyama, and K. Matsuda, “Separation of fNIRS signals into functional and systemic components based on differences in hemodynamic modalities,” PLOS ONE, Vol.7, No.11, Article No.e50271, 2012. https://doi.org/10.1371/journal.pone.0050271
24. [24] A. K. Singh, M. Okamoto, H. Dan, V. Jurcak, and I. Dan, “Spatial registration of multichannel multi-subject fNIRS data to MNI space without MRI,” NeuroImage, Vol.27, No.4, pp. 842-851, 2005. https://doi.org/10.1016/j.neuroimage.2005.05.019
25. [25] D. W. Shattuck et al., “Construction of a 3D probabilistic atlas of human cortical structures,” NeuroImage, Vol.39, No.3, pp. 1064-1080, 2008. https://doi.org/10.1016/j.neuroimage.2007.09.031
26. [26] J. O. Wobbrock, L. Findlater, D. Gergle, and J. J. Higgins, “The aligned rank transform for nonparametric factorial analyses using only anova procedures,” Proc. of the SIGCHI Conf. on Human Factors in Computing Systems (CHI’11), pp. 143-146, 2011. https://doi.org/10.1145/1978942.1978963
27. [27] D. M. Wegner and T. Wheatley, “Apparent mental causation: Sources of the experience of will,” American Psychologist, Vol.54, No.7, pp. 480-492, 1999. https://psycnet.apa.org/doi/10.1037/0003-066X.54.7.480
28. [28] E. A. Caspar et al., “New frontiers in the rubber hand experiment: When a robotic hand becomes one’s own,” Behavior Research Methods, Vol.47, No.3, pp. 744-755, 2015. https://doi.org/10.3758/s13428-014-0498-3
29. [29] S. Shimada, “Deactivation in the sensorimotor area during observation of a human agent performing robotic actions,” Brain and Cognition, Vol.72, No.3, pp. 394-399, 2010. https://doi.org/10.1016/j.bandc.2009.11.005