Survey of Social Touch Interaction Between Humans and Robots
Masahiro Shiomi*, Hidenobu Sumioka*, and Hiroshi Ishiguro*,**
*Advanced Telecommunications Research Institute International (ATR)
2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan
**Graduate School of Engineering Science, Osaka University
1-3 Machikaneyama, Toyonaka, Osaka 560-8531, Japan
In human-human interaction, social touch provides several merits, from both physical and mental perspectives. The physical existence of robots helps them reproduce human-like social touch, during their interaction with people. Such social touch shows positive effects, similar to those observed in human-human interaction. Therefore, social touch is a growing research topic in the field of human-robot interaction. This survey provides an overview of the work conducted so far on this topic.
-  J. Li, “The benefit of being physically present: A survey of experimental works comparing copresent robots, telepresent robots and virtual agents,” Int. J. of Human-Computer Studies, Vol.77, pp. 23-37, 2015.
-  W. A. Bainbridge, J. Hart, E. S. Kim, and B. Scassellati, “The effect of presence on human-robot interaction,” Proc. of the 17th IEEE Int. Symp. on Robot and Human Interactive Communication (RO-MAN 2008), pp. 701-706, 2008.
-  A. Powers, S. Kiesler, S. Fussell, and C. Torrey, “Comparing a computer agent with a humanoid robot,” Proc. of 2007 2nd ACM/IEEE Int. Conf. on Human-Robot Interaction (HRI), pp. 145-152, 2007.
-  K. Shinozawa, F. Naya, J. Yamato, and K. Kogure, “Differences in effect of robot and screen agent recommendations on human decision-making,” Int. J. of Human-Computer Studies, Vol.62, No.2, pp. 267-279, 2005.
-  Y. Takeuchi and H. Naito, “How Do Real or Virtual Agent’s Body and Instructions Contribute to Task Achievement?,” Proc. of Symp. on Human Interface, pp. 142-151, 2011.
-  K. M. Grewen, B. J. Anderson, S. S. Girdler, and K. C. Light, “Warm partner contact is related to lower cardiovascular reactivity,” Behavioral Medicine, Vol.29, No.3, pp. 123-130, 2003.
-  S. Cohen, D. Janicki-Deverts, R. B. Turner, and W. J. Doyle, “Does hugging provide stress-buffering social support? A study of susceptibility to upper respiratory infection and illness,” Psychological Science, Vol.26, No.2, pp. 135-147, 2015.
-  B. K. Jakubiak and B. C. Feeney, “Keep in touch: The effects of imagined touch support on stress and exploration,” J. of Experimental Social Psychology, Vol.65, pp. 59-67, 2016.
-  A. Gallace and C. Spence, “The science of interpersonal touch: an overview,” Neuroscience & Biobehavioral Reviews, Vol.34, No.2, pp. 246-259, 2010.
-  K. C. Light, K. M. Grewen, and J. A. Amico, “More frequent partner hugs and higher oxytocin levels are linked to lower blood pressure and heart rate in premenopausal women,” Biological Psychology, Vol.69, No.1, pp. 5-21, 2005.
-  T. Field, “Touch for socioemotional and physical well-being: A review,” Developmental Review, Vol.30, No.4, pp. 367-383, 2010.
-  B. Mutlu, T. Shiwa, T. Kanda, H. Ishiguro, and N. Hagita, “Footing in human-robot conversations: how robots might shape participant roles using gaze cues,” Proc. of the 4th ACM/IEEE Int. Conf. on Human Robot Interaction, pp. 61-68, 2009.
-  Y. Kuno, K. Sadazuka, M. Kawashima, K. Yamazaki, A. Yamazaki, and H. Kuzuoka, “Museum guide robot based on sociological interaction analysis,” Proc. of the SIGCHI Conf. on Human Factors in Computing Systems, San Jose, California, USA, pp. 1191-1194, 2007.
-  T. Komatsubara, M. Shiomi, T. Kanda, H. Ishiguro, and N. Hagita, “Can a social robot help children’s understanding of science in classrooms?,” Proc. of the 2nd Int. Conf. on Human-agent interaction, Tsukuba, Japan, pp. 83-90, 2014.
-  Y. Tamura, M. Kimoto, M. Shiomi, T. Iio, K. Shimohara, and N. Hagita, “Effects of a Listener Robot with Children in Storytelling,” Proc. of the 5th Int. Conf. on Human Agent Interaction, Bielefeld, Germany, pp. 35-43, 2017.
-  S. Satake, T. Kanda, D. F. Glas, M. Imai, H. Ishiguro, and N. Hagita, “A Robot that Approaches Pedestrians,” IEEE Trans. on Robotics, Vol.29, No.2, pp. 508-524, 2013.
-  K. Hayashi, M. Shiomi, T. Kanda, and N. Hagita, “Friendly patrolling: A model of natural encounters,” Proc. of Robotics: Science and Systems, pp. 121-128, 2011.
-  M. Gharbi, P. V. Paubel, A. Clodic, O. Carreras, R. Alami, and J. M. Cellier, “Toward a better understanding of the communication cues involved in a human-robot object transfer,” Proc. of 2015 24th IEEE Int. Symp. on Robot and Human Interactive Communication (RO-MAN), pp. 319-324, 2015.
-  T. Hirano et al., “How Do Communication Cues Change Impressions of Human-Robot Touch Interaction?,” Int. J. of Social Robotics, Vol.10, No.1, pp. 21-31, 2018.
-  Z. N. Kain et al., “Healthcare provider-child-parent communication in the preoperative surgical setting,” Pediatric Anesthesia, Vol.19, No.4, pp. 376-384, 2009.
-  E. B. Wright, C. Holcombe, and P. Salmon, “Doctors’ communication of trust, care, and respect in breast cancer: qualitative study,” BMJ, Vol.328, No.7444, p. 864, 2004.
-  R. F. Brown and C. L. Bylund, “Communication skills training: describing a new conceptual model,” Academic Medicine, Vol.83, No.1, pp. 37-44, 2008.
-  I. Rae, L. Takayama, and B. Mutlu, “The influence of height in robot-mediated communication,” Proc. of 2013 8th ACM/IEEE Int. Conf. on Human-Robot Interaction (HRI), pp. 1-8, 2013.
-  Y. Hiroi and A. Ito, “Influence of the Height of a Robot on Comfortableness of Verbal Interaction,” IAENG Int. J. of Computer Science, Vol.43, No.4, pp. 447-455, 2016.
-  T. L. Chen, C.-H. A. King, A. L. Thomaz, and C. C. Kemp, “An Investigation of Responses to Robot-Initiated Touch in a Nursing Context,” Int. J. of Social Robotics, Vol.6, No.1, pp. 141-161, 2013.
-  Y. Okuno, T. Kanda, M. Imai, H. Ishiguro, and N. Hagita, “Providing route directions: design of robot’s utterance, gesture, and timing,” Proc. of the 4th ACM/IEEE Int. Conf. on Human Robot Interaction, pp. 53-60, 2009.
-  T. Shiwa, T. Kanda, M. Imai, H. Ishiguro, and N. Hagita, “How Quickly Should a Communication Robot Respond? Delaying Strategies and Habituation Effects,” Int. J. of Social Robotics, Vol.1, No.2, pp. 141-155, 2009.
-  R. Nakanishi, K. Inoue, S. Nakamura, K. Takanashi, and T. Kawahara, “Generating fillers based on dialog act pairs for smooth turn-taking by humanoid robot,” Proc. of 9th Int. Workshop on Spoken Dialogue System Technology (IWSDS), pp. 91-101, 2018.
-  M. Shimada and T. Kanda, “What is the appropriate speech rate for a communication robot?,” Interaction Studies, Vol.13, No.3, pp. 408-435, 2012.
-  C. O’lynn and L. Krautscheid, “‘How should I touch you?’: a qualitative study of attitudes on intimate touch in nursing care,” AJN The American J. of Nursing, Vol.111, No.3, pp. 24-31, 2011.
-  J. T. Suvilehto, E. Glerean, R. I. M. Dunbar, R. Hari, and L. Nummenmaa, “Topography of social touching depends on emotional bonds between humans,” Proc. of the National Academy of Sciences, Vol.112, No.45, pp. 13811-13816, 2015.
-  B. Alenljung, R. Andreasson, R. Lowe, E. Billing, and J. Lindblom, “Conveying Emotions by Touch to the Nao Robot: A User Experience Perspective,” Multimodal Technologies and Interaction, Vol.2, No.4, p. 82, 2018.
-  X. Zheng, M. Shiomi, T. Minato, and H. Ishiguro, “What Kinds of Robot’s Touch Will Match Expressed Emotions?,” IEEE Robotics and Automation Letters, Vol.5, No.1, pp. 127-134, 2019.
-  X. Meng, N. Yoshida, X. Wan, and T. Yonezawa, “Emotional Gripping Expression of a Robotic Hand as Physical Contact,” Proc. of the 7th Int. Conf. on Human-Agent Interaction, pp. 37-42, 2019.
-  M. Shiomi, K. Shatani, T. Minato, and H. Ishiguro, “How should a Robot React before People’s Touch?: Modeling a Pre-Touch Reaction Distance for a Robot’s Face,” IEEE Robotics and Automation Letters, Vol.3, No.4, pp. 3773-3780, 2018.
-  A. Saito, M. Kimoto, T. Iio, K. Shimohara, and M. Shiomi, “Preliminary Investigation of Pre-Touch Reaction Distances toward Virtual Agents,” Proc. of the 7th Int. Conf. on Human-Agent Interaction, pp. 292-293, 2019.
-  T. Goodman and R. Spence, “The effect of system response time on interactive computer aided problem solving,” ACM SIGGRAPH Computer Graphics, Vol.12, pp. 100-104, 1978.
-  J. L. Guynes, “Impact of system response time on state anxiety,” Communications of the ACM, Vol.31, No.3, pp. 342-347, 1988.
-  R. B. Miller, “Response time in man-computer conversational transactions,” Proc. of AFIPS Fall Joint Computing Conf. (Part I), pp. 267-277, 1968.
-  M. Shiomi, T. Minato, and H. Ishiguro, “Subtle Reaction and Response Time Effects in Human-Robot Touch Interaction,” Int. Conf. on Social Robotics, pp. 242-251, 2017.
-  Y. Yamashita, H. Ishihara, T. Ikeda, and M. Asada, “Investigation of causal relationship between touch sensations of robots and personality impressions by path analysis,” Int. J. of Social Robotics, Vol.11, No.1, pp. 141-150, 2019.
-  A. E. Block and K. J. Kuchenbecker, “Softness, Warmth, and Responsiveness Improve Robot Hugs,” Int. J. of Social Robotics, Vol.11, No.1, pp. 49-64, 2019.
-  E. Park and J. Lee, “I am a warm robot: the effects of temperature in physical human-robot interaction,” Robotica, Vol.32, No.1, pp. 133-142, 2014.
-  J. Nie, M. Park, A. L. Marin, and S. S. Sundar, “Can you hold my hand? Physical warmth in human-robot interaction,” Proc. of 2012 7th ACM/IEEE Int. Conf. on Human-Robot Interaction (HRI), pp. 201-202, 2012.
-  D. S. Stier and J. A. Hall, “Gender differences in touch: An empirical and theoretical review,” J. of personality and social psychology, Vol.47, No.2, pp. 440-459, 1984.
-  A. S. E. Hubbard, A. A. Tsuji, C. Williams, and V. Seatriz, “Effects of Touch on Gratuities Received in Same-Gender and Cross-Gender Dyads,” J. of Applied Social Psychology, Vol.33, No.11, pp. 2427-2438, 2003.
-  J. A. Evans, “Cautious caregivers: gender stereotypes and the sexualization of men nurses’ touch,” J. of Advanced Nursing, Vol.40, No.4, pp. 441-448, 2002.
-  M. Shiomi, K. Nakagawa, K. Shinozawa, R. Matsumura, H. Ishiguro, and N. Hagita, “Does A Robot’s Touch Encourage Human Effort?,” Int. J. of Social Robotics, Vol.9, pp. 5-15, 2016.
-  L. Tremblay et al., “Body image and anti-fat attitudes: an experimental study using a haptic virtual reality environment to replicate human touch,” Cyberpsychology, Behavior, and Social Networking, Vol.19, No.2, pp. 100-106, 2016.
-  Y. Yamashita, H. Ishihara, T. Ikeda, and M. Asada, “Appearance of a Robot Influences Causal Relationship between Touch Sensation and the Personality Impression,” Proc. of the 5th Int. Conf. on Human Agent Interaction, pp. 457-461, 2017.
-  A. H. Crusco and C. G. Wetzel, “The Midas Touch: The Effects of Interpersonal Touch on Restaurant Tipping,” Personality and Social Psychology Bulletin, Vol.10, No.4, pp. 512-517, 1984.
-  K. Takemura, “The effect of interpersonal sentiments on behavioral intention of helping behavior among Japanese students,” The J. of Social Psychology, Vol.133, No.5, pp. 675-681, 1993.
-  J. D. Fisher, M. Rytting, and R. Heslin, “Hands Touching Hands: Affective and Evaluative Effects of an Interpersonal Touch,” Sociometry, Vol.39, No.4, pp. 416-421, 1976.
-  N. Guéguen, “Touch, awareness of touch, and compliance with a request,” Perceptual and Motor Skills, Vol.95, No.2, pp. 355-360, 2002.
-  N. Guéguen, C. Jacob, and G. Boulbry, “The effect of touch on compliance with a restaurant’s employee suggestion,” Int. J. of Hospitality Management, Vol.26, No.4, pp. 1019-1023, 2007.
-  H. Fukuda, M. Shiomi, K. Nakagawa, and K. Ueda, “‘Midas touch’ in human-robot interaction: Evidence from event-related potentials during the ultimatum game,” Proc. of 2012 7th ACM/IEEE Int. Conf. on Human-Robot Interaction (HRI), pp. 131-132, 2012.
-  A. Haans and W. A. Usselsteijn, “The virtual Midas touch: Helping behavior after a mediated social touch,” IEEE Trans. on Haptics, Vol.2, No.3, pp. 136-140, 2009.
-  C. Bevan and D. S. Fraser, “Shaking hands and cooperation in tele-present human-robot negotiation,” Proc. of the 10th Annual ACM/IEEE Int. Conf. on Human-Robot Interaction, pp. 247-254, 2015.
-  J. Nakanishi, K. Kuwamura, T. Minato, S. Nishio, and H. Ishiguro, “Evoking Affection for a Communication Partner by a Robotic Communication Medium,” Proc. of the First Int. Conf. on Human-Agent Interaction, III-1-4, 2013.
-  H. Takahashi, M. Ban, H. Osawa, J. Nakanishi, H. Sumioka, and H. Ishiguro, “Huggable communication medium enhances unconditional trust during conversation,” Frontiers in Psychology, Vol.8, p. 1862, doi: 10.3389/fpsyg.2017.01862, 2017.
-  J. Nakanishi, H. Sumioka, and H. Ishiguro, “Virtual Hug Induces Modulated Impression on Hearsay Information,” Proc. of the 6th Annual Int. Conf. on Human-Agent Interaction, pp. 199-204, 2018.
-  J. Nakanishi, H. Sumioka, and H. Ishiguro, “Impact of mediated intimate interaction on education: a huggable communication medium that encourages listening,” Front. Psychol., Vol.7, p. 510, doi: 10.3389/fpsyg.2016.00510, 2016.
-  J. Nakanishi, H. Sumioka, and H. Ishiguro, “A huggable communication medium can provide sustained listening support for special needs students in a classroom,” Computer in Human Behavior, Vol.93, pp. 106-113, 2019.
-  R. Yu et al., “Use of a Therapeutic, Socially Assistive Pet Robot (PARO) in Improving Mood and Stimulating Social Interaction and Communication for People With Dementia: Study Protocol for a Randomized Controlled Trial,” JMIR Research Protocols, Vol.4, No.2, e45, 2015.
-  T. Hirano et al., “Communication Cues in a Human-Robot Touch Interaction,” Proc. of the 4th Int. Conf. on Human Agent Interaction, Biopolis, Singapore, pp. 201-206, 2016.
-  F. Tanaka, A. Cicourel, and J. R. Movellan, “Socialization between toddlers and robots at an early childhood education center,” Proc. of the National Academy of Sciences, Vol.104, No.46, pp. 17954-17958, 2007.
-  T. Kanda, R. Sato, N. Saiwaki, and H. Ishiguro, “A two-month field trial in an elementary school for long-term human-robot interaction,” IEEE Trans. on Robotics, Vol.23, No.5, pp. 962-971, 2007.
-  K. Wada and T. Shibata, “Robot therapy in a care house – Its sociopsychological and physiological effects on the residents,” Proc. of the IEEE Int. Conf. on Robotics and Automation, pp. 3966-3971, 2006.
-  H. Sumioka, A. Nakae, R. Kanai, and H. Ishiguro, “Huggable communication medium decreases cortisol levels,” Scientific Reports, Vol.3, p. 3034, 2013.
-  C. Shi, M. Shiomi, C. Smith, T. Kanda, and H. Ishiguro, “A Model of Distributional Handing Interaction for a Mobile Robot,” Proc. of Robotics: Science and Systems, pp. 24-28, 2013.
-  S. Satake, K. Hayashi, K. Nakatani, and T. Kanda, “Field trial of an information-providing robot in a shopping mall,” Proc. of 2015 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), pp. 1832-1839, 2015.