A Supporting System of Choral Singing for Visually Impaired Persons Using Depth Image Sensor
Noriyuki Kawarazaki*, Yuhei Kaneishi*, Nobuyuki Saito**,
and Takashi Asakawa***
*Kanagawa Institute of Technology, 1030 Shimo-Ogino, Atsugi-shi, Kanagawa 243-0292, Japan
**Asap System Co., Ltd., Setoru Higashioume 109, 2-18-5 Higashioume, Oume, Tokyo 198-0042, Japan
***Kinki University Technical College, 7-1 Kasugaoka, Nabari, Mie 518-0459, Japan
Supporting system of choral singing
Visually impaired persons may find it difficult to take part in a chorus or other singing group because they cannot see the beat indicated by conductor’s hand movements. This paper provides a chorus support system for visually impaired persons using depth image sensor. This consists of an electric music baton with an acceleration sensor, a radio module, haptic interface devices with vibration motors, a depth image sensor, and a PC. The electric music baton transmits the signal indicating the conductor’s motion to visually impaired players based on sensor acceleration. Since the conductor must give individual instruction to player, we use a depth image sensor to indicate the direction in which the conductor’s baton points. This direction is estimated based on the conductor’s posture. We also attempted to develop a chorus support system without using the electric music baton. The beat is obtained by the maximum velocity position of the conductor’s hand motion using a depth image sensor. The effectiveness of our system is clarified by several experimental results.
-  Y. Nagamatsu, “Outdoor Activities of the Complete Blind (Papers of the 3rd Scientific Research Meeting),” Zoen Zassi, Vol.48, No.5, pp. 217-221, 1985.
-  Y. Nagamatsu, “A Study on the Utilization of the Park for the Blind,” Zoen Zassi, Vol.49, No.1, pp. 1-9, 1985.
-  Y. Nagamatsu, “A Study on Leisure Time Activities of the Blind School Students,” Zoen Zassi, Vol.55, No.5, pp. 265-270, 1992.
-  T. Asakawa, N. Saito, N. Kawarazaki, T. Yoshidome, and K. Nishihara, “Development of an Electronic Baton for a Visually Handicapped Person’s Music Study Support,” Proc. of the Welfare Engineering Symposium 2009, pp. 112-113, 2009.
-  T. Asakawa and N. Kawarazaki, “An Electric Music Baton System using a Haptic Interface for Visually Disabled Persons,” Proc. of the SICE annual Conf. 2012, TuB10-01, 2012.
-  T. Asakawa, N. Saito, N. Kawarazaki, and K. Nishihara, “A Study of an Electronic Baton for Visually Handicapped Persons: Support Method for Chorus Circle which Include Visually Handicapped Persons,” The 10th SICE System Integration, 3F1-1, pp. 1555-1557, 2009.
-  T. Asakawa, K. Nishihara, and N. Kawarazaki, “A Music Baton for an Assistance of Visual Handicapped Persons,” The 6th China-Japan Conf. on Mechatronics, PJ002(4), 2010.
-  S. Ito, K. Kotani, and K. Horii, “A Measurement of Differential Limen of Force for Haptic-Interface,” human interface, Vol.7, No.2, pp. 21-24, 2005.
-  A. G. Dodds, D. Clark, and C. I. Howarth, “The effects of precueing on vibrotactile reaction times: Implications for guidance device for blind people,” Ergonomics, Vol.29, No.9, pp. 1063-1071, 1986.
-  Y. Mori, T. Tanaka, and S. Kaneko, “Vibration Alert Interface for Detecting Surroundings,” Third Asia Int. Symposium on Mechatronics, FA1-1(3), 2008.
-  K. Nakamura, K. Tanaka, and H. Miyagi, “Kinect for Windows SDK Programming C#-hen,” Shuwa System, 2012 (in Japanese).
-  Y. Saita, “Hajimeteno Shikihou,” Ongaku no Tomo Sya, 1999 (in Japanese).
-  T. Asakawa, N. Kawarazaki, K. Nishihara, and N. Saito, “Study of Improvement of Response Time Using Haptic Interface,” Proc. 2011 JSME Conf. on Robotics and Mechatronics, 2P1-D09, 2011.
- [a] Light Center of Kanagawa prefecture,
http://www.kanagawalc.org/ [Accessed December 20, 2012]
- [b] A. Hiraiwa, M. Fukumoto, and T. Uchiyama, “Conductor’s baton operation display device for blind,” Japan Patent 1995-261751,
http://www.directorypatent.com/JP/1995ZZDASHZZ261751.html [Accessed April 10, 2012]
- [c] Cableless Datalogging System AS-RS168/RR168,
http://www.asap-sys.co.jp/ [Accessed October 15, 2012]
- [d] KINECT for windows,
http://www.microsoft.com/en-us/kinectforwindows/ [Accessed June 18, 2012]
- [e] RENESUS H8S/2218, 2212,
http://japan.renesas.com/products/mpumcu/h8s/h8s2200/h8s2218_h8s2212/index.jsp [Accessed November 20, 2012]
Supporting Online Materials:
This article is published under a Creative Commons Attribution-NoDerivatives 4.0 Internationa License.