The HealthSign project, current state and future activities

This paper presents the HealthSign project, which deals with the problem of sign language recognition with focus on medical interac- tion scenarios. The deaf user will be able to communicate in his native sign language with a physician. The continuous signs will be translated to text and presented to the physician. Similarly, the speech will be recognized and presented as text to the deaf users. Two alternative versions of the system will be developed, one doing the recognition on a server, and another one doing the recognition on a mobile device.