Liopa has created a novel, robust and convenient VSR platform, known as LipRead. Specifically, the Liopa technology can determine speech by analysing the movement of a user’s lips as they speak into a camera. These lip movements are known as visemes and are the visual equivalent of a phoneme or unit of sound in spoken language.
LipRead is initially being offered as a standalone VSR system capable of recognising a limited and predefined vocabulary – for applications such as Liveness Checking during on-line authentication (known as LipSecure).
Liopa is also developing a version of LipRead which can be integrated with Audio Speech Recognition (ASR) systems. ASR accuracy levels universally degrade in noisy (real-world) environments – LipRead can solve this problem and maintain high accuracy levels in challenging environments. Where a camera can be trained on the head of the speaker, the combined Audio-Visual Speech recognition (AVSR) system will boost word accuracy when background noise levels increase.
The Liopa solution requires no additional hardware and will work on any device with a standard forward facing camera (e.g. smartphone, tablet, laptop, desktop, in-vehicle dashboard etc.). LipRead supports standard RGB cameras, but IR/ToF sensor support is currently being developed.