Vol 17, No 1 (2013) > Articles >

Recognition System of Indonesia Sign Language based on Sensor and Artificial Neural Network

Endang Supriyati 1 , Mohammad Iqbal 2

Affiliations:

  1. Informatics Engineering Department, Muria Kudus University, Gondangmanis Kudus 59352, Indonesia
  2. Electrical Engineering Department, Muria Kudus University, Gondangmanis Kudus 59352, Indonesia

 

Abstract: Sign language as a kind of gestures is one of the most natural ways of communication for most people in deaf community. The aim of the sign language recognition is to provide a translation for sign gestures into meaningful text or speech so that communication between deaf and hearing society can easily be made. In this research, the Indonesian sign language recognition system based on flex sensors and an accelerometer is developed. This recognition system uses a sensory glove to capture data. The sensor data that are processed into feature vector are the 5-fingers bending andthe palm acceleration when performing the sign language. The most important part of the recognition system is a featureextraction. In this research, histogram is used as feature extraction. The extracted features are used as data training and data testing for Adaptive Neighborhood based Modified Backpropagation (ANMBP). The system is implemented andtested using a data set of 1000 samples of 50 Indonesia sign, 20 samples for each sign. Among these 500 data were usedas the training data, and the remaining 500 data were used as the testing data. The system obtains the recognition rate of91.60% in offline mode.
Keywords: accelerometer sensor, backpropagation, flex sensor, Indonesia sign language, neural network
Published at: Vol 17, No 1 (2013) pages: 25-31
DOI:

Access Counter: 1538 views, 1202 PDF downloads, .

Full PDF Download

References:

Q. Munib, M. Habeeb, B. Takruri, H.A Al-Malik, Expert Sistems Appl. 32 (2007) 24.

Y.-H. Lee, C.-Y. Tsai, Expert Sistems Appl. 36 (2009) 1123.

M. AL-Rousan, K. Assaleh, A. Tala’a, Appl. Soft Comput. 9 (2009) 990.

W. Gao, G. Fanga, D. Zhaoa, Y. Chen, Pattern Recognit. 37 (2004) 2389.

C. Oz, M.C. Leu, Neuro Comput. 70 (2007) 2891.

M.H. Yang, N. Ahuja, IEEE Conference on Computer Vision and Pattern Recognition, Fort Collins, Colorado, 1 (1999) 466.

T. Kathirvalakumar, S.J. Subavathi, Neuro Comput. 72 (2009) 3915.

E.T. Sekar, Tesis Magister ITB, Bandung, Indonesia, 2001.

Spectrasymbol, Flex Sensor, http://spectrasymbol.com, 2012.

Parallax Inc., Hitachi® H48C 3-Axis Accelerometer Module, http://www.parallax.com, 2007.

S. Abid, F. Fnaiech, M. Najim, IEEE Trans. Neural Netw. 12 (2001) 424.

A. Toledo, M. Pinzolas, J.J. Ibarrola, G. Lera, IEEE Trans. Neural Netw. 16 (2005) 988.

L. Behera, S. Kumar, A. Patnaik, IEEE Trans. Neural Netw. 17 (2006) 1116.

PT. Telekomunikasi Indonesia, Tbk., i-CHAT, http://app.i-chat.web.id, 2010.

H.P. Mauridhi, K. Agus, Supervised Neural Network dan Aplikasinya, Penerbit Graha Ilmu, Yogyakarta, 2006, p.176.

A. Akl, Thesis, Department of Electrical and Computer Engineering, University of Toronto, 2010.

J. Liua, L. Zhong, J. Wickramasuriya, V. Vasudevan, Pervasive and Mobile Comput. 5 (2009) 657.

R. Kohavi, F. Provost, Glossary of Terms, Mach. Learn. 30/2-3 (1998) 271.

M.M. Fernandez, Fundamentals on Estimation Theory, http://lmi.bwh.harvard.edu/papers/pdfs/2004/martin-fernandezCOURSE04b.pdf, access on 5-Peb-2010.