Dual LMCs fusion for recognition of isolated Arabic sign language words

In this paper, we propose a Dual-Leap Motion Controllers (DLMC) based Arabic Sign Language recognition system. More particularly, we propose to use both front and side controllers to cater for the challenges of finger occlusions and missing data. For feature extraction, we select an optimum set of geometric features extracted from both controllers, while for classification, we used both a Bayesian approach with a Gaussian Mixture Model (GMM) and a simple Linear Discriminant Analysis (LDA) approach. Though this paper focused only on the GMM approach. Data was collected from a native adult signer, for 100 isolated Arabic words. Ten observations were collected for each of the signs. The proposed framework uses an intelligent strategy to handle the case of missing data from one or both controllers. A recognition accuracy of 94.63% was achieved, with the proposed system. The proposed system outperforms glove-based systems and a single-LMC based techniques.