论文标题

语言翻译的手语的新架构

A new architecture for hand-worn Sign language to Speech translator

论文作者

Bodda, Sai Charan, Gupta, Palki, Joshi, Gaurav, Chaturvedi, Ayush

论文摘要

有言语和听力障碍的人通常依靠手语与他人交流,但是大多数一般人群无法理解手语,手语本身是一种很难学习的语言,因此绝对需要技术将手语翻译成语言。在本文中,我们描述了Smart Glove的设计和实现,Smart Glove是一种手工戴的硬件设备,能够通过跟踪手指的方向,手势和手动运动来将美国手语手势转换为英语语音。它使用flex,加速度计和陀螺仪以及智能软件等硬件传感器来捕获和将手势转化为语音。本文解释了字母和单词手势的翻译。提出并实施了新的方法和算法,以解决现有基于手套的设计中的硬件依赖性问题。整个设备设计为具有分布式处理单元的模块化,以鼓励模块化增强,降低子系统之间的相互关系。我们希望此后提到的设计和体系结构将成为与基于传感器的手语翻译有关的研究的基础,以及针对智能手套和控制论配件的研究。

People with speech and hearing impairments often rely on sign language to communicate with others but most of the general population cannot understand sign language and sign language itself is a difficult language to learn, so there is a definite need for technologies to translate sign language to speech. In this paper, we describe the design and implementation of Smart glove, a hand-worn hardware device capable of translating American Sign Language gestures into English speech by tracking the finger's orientation, gestures and hand motion. It uses hardware sensors like Flex, Accelerometer and gyroscope and intelligent software to capture and translate the gestures into speech. This paper explains the translation of both Alphabet and Word gestures. New approaches and algorithms are proposed and implemented to address hardware-dependent issues in existing glove based designs. The whole device is designed to be modular with distributed processing units to encourage modular enhancement, reducing complexity, and interrelation between subsystems.Decision Trees are used in gesture recognition and error correction. We hope that the henceforth mentioned design and architecture would be the basis for the advancement in research related to sensor-based sign language translation along with research for smart glove and cybernetic accessories.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源