FingerTalk: Real-time Fingertip Trajectories Tracking Service Based on IoTtalk

Internet of Things (IoT) integrates with finger tracking and 3D signature verification can provide the user authentication service for these IoT applications which require user identification and authorization, such as the home automation and security system. This work develops two modules. The FingerTalk module provides the fingertip trajectories tracking service based on a Leap Motion camera and IoTtalk, The AirSig module provides 3D signature verification service to recognize whether a signature is signed form the authenticated user. The AirSig module requires only two user signature samples to train the neural network model which significantly reduces the process time for signature collection. The validation results from 10 people show the average accuracy is up to 93.6% on 3D signature verification.