Top > JRM > Mapping Facial Expression to Internal States Based on Intuitiv ...

single-rb.php

JRM Vol.19 No.3 pp. 315-323
doi: 10.20965/jrm.2007.p0315
(2007)

Paper:

Views over last 60 days: 663

Mapping Facial Expression to Internal States Based on Intuitive Parenting

Ayako Watanabe*, Masaki Ogino**, and Minoru Asada**,***

*Graduate School of Engineering, Osaka University, 2-1 Yamadaoka, Suita, Osaka 565-0871, Japan

**Asada Synergistic Intelligence Project, ERATO, Japan Science and Technology Agency, FRC1, Graduate School of Engineering, Osaka University

***Osaka University, 2-1 Yamadaoka, Suita, Osaka 565-0871, Japan

Received:
October 18, 2006
Accepted:
March 12, 2007
Published:
June 20, 2007
Creative Commons License
Keywords:
intuitive parenting, infant robot, facial expression, emotion model, Hebbian learning
Abstract
Sympathy is a key issue in interaction and communication between robots and their users. In developmental psychology, intuitive parenting is considered the maternal scaffolding upon which children develop sympathy when caregivers mimic or exaggerate the child’s emotional facial expressions [1]. We model human intuitive parenting using a robot that associates a caregiver’s mimicked or exaggerated facial expressions with the robot’s internal state to learn a sympathetic response. The internal state space and facial expressions are defined using psychological studies and change dynamically in response to external stimuli. After learning, the robot responds to the caregiver’s internal state by observing human facial expressions. The robot then expresses its own internal state facially if synchronization evokes a response to the caregiver’s internal state.
Cite this article as:
A. Watanabe, M. Ogino, and M. Asada, “Mapping Facial Expression to Internal States Based on Intuitive Parenting,” J. Robot. Mechatron., Vol.19 No.3, pp. 315-323, 2007.
Data files:
References
  1. [1] G. Gergely and J. S. Watson, “Early socio-emotional development: Contingency perception and the social-biofeedback model,” in P. Rochat (Ed.), “Early Social Cognition: Understanding Others in the First Months of Life,” Mahwah, NJ: Lawrence Erlbaum, pp. 101-136, 1999.
  2. [2] A. Mehrabian, “Implicit communication of emotions and attitudes,” Wadsworth, 1981.
  3. [3] M. H. Johnson and J. Morton, “Biology and cognitive development,” Blackwell, 1991.
  4. [4] D. Rosenstein and H. Oster, “Differential facial responses to four basic tastes in newborns,” Blackwell Publishing, Vol.59, pp. 1555-1568, Dec., 1988.
  5. [5] D. Matsui, T. Minato, K. F. MacDorman, and H. Ishiguro, “Generating natural motion in an android by mapping human motion,” Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1089-1096, 2005.
  6. [6] T. Hashimoto, M. Sennda, and H. Kobayashi, “Realization of realistic and rich facial expressions by face robot,” 2004 1st IEEE Technical Exhibition Based Conference on Robotics and Automation, pp. 37-38, Nov., 2004.
  7. [7] C. Breazeal, D. Buchsbaum, J. Gray, D. Gatenby, and B. Blumberg, “Learning from and about others: Towards using imitation to bootstrap the social understanding of others by robots,” Artificial Life, Vol.11, pp. 31-62, 2005.
  8. [8] T. Kobayashi, Y. Ogawa, K. Kato, and K. Yamamoto, “Learning system of human facial expression for a family robot,” in Proceeding of the Sixth International Conference on Automatic Face and Gesture Recognition, pp. 481-486, 2004.
  9. [9] H. Papousek and M. Papousek, “Intuitive parenting: a dialectic counterpart to the infant’s precocity in integrative capacities,” Handbook of Infant Development, pp. 669-720, 1987.
  10. [10] P. Rochat, “The infant’s world,” Artificial Life, 2001.
  11. [11] M. Asada, K. F. MacDorman, H. Ishiguro, and Y. Kuniyoshi, “Cognitive developmental robotics as a new paradigm for the design of humanoid robots,” in Proceeding of the 1st IEEE/RSJ International Conference on Humanoid Robots, CDROM, 2000.
  12. [12] J. A. Russell, “A circumplex model of affect,” Journal of Personality and Social Psychology, Vol.39, pp. 1161-1178, 1980.
  13. [13] H. Yamada, “Visual information for categorizing facial expression of emotion,” Japan Psychology Review, Vol.35, pp. 172-181, 1993.
  14. [14] K. Lorenz, “Studies in animal and human behavior,” London: Methuen, 1970-1971.
  15. [15] T. Kohonen, “Self-organizing maps,” Springer-Verlag, Berlin Heidelberg, 1995.
  16. [16] T. Singer, B. Seymour, J. O’Doherty, H. Kaube, R. J. Dolan, and C. D. Frith, “Empathy for pain involves the affective but not sensory components of pain,” Science, Vol.303, No.20, pp. 1157-1162, Feb., 2004.

Creative Commons License  This article is published under a Creative Commons Attribution-NoDerivatives 4.0 Internationa License.

Copyright© 2007 by Fuji Technology Press Ltd. and Japan Society of Mechanical Engineers. All right reserved.

*This site is desgined based on HTML5 and CSS3 for modern browsers, e.g. Chrome, Firefox, Safari, Edge, Opera.

Last updated on Jul. 04, 2025