A Speech-Driven Sign Language Avatar Animation System for Hearing Impaired Applications
Abstract
Sign language is the communication language used in hearing impaired community. Recently, the research of sign language production has made great progress but still need to cope with some critical challenges. In this paper, we propose a system-level scheme and push forward the implementation of sign language production for practical usage. We build a system capable of translating speech into sign language avatar. Different from previous approach only focusing on single technology, we systematically combine algorithms of language translation, body gesture animation and facial avatar generation. We also develop two applications: Sign Language Interpretation APP and Virtual Sign Language Anchor, to facilitate easy and clear communication for hearing impaired people.
Cite
Text
Hu et al. "A Speech-Driven Sign Language Avatar Animation System for Hearing Impaired Applications." International Joint Conference on Artificial Intelligence, 2022. doi:10.24963/IJCAI.2022/852Markdown
[Hu et al. "A Speech-Driven Sign Language Avatar Animation System for Hearing Impaired Applications." International Joint Conference on Artificial Intelligence, 2022.](https://mlanthology.org/ijcai/2022/hu2022ijcai-speech/) doi:10.24963/IJCAI.2022/852BibTeX
@inproceedings{hu2022ijcai-speech,
title = {{A Speech-Driven Sign Language Avatar Animation System for Hearing Impaired Applications}},
author = {Hu, Li and Li, Jiahui and Zhang, Jiashuo and Wang, Qi and Zhang, Bang and Tan, Ping},
booktitle = {International Joint Conference on Artificial Intelligence},
year = {2022},
pages = {5912-5915},
doi = {10.24963/IJCAI.2022/852},
url = {https://mlanthology.org/ijcai/2022/hu2022ijcai-speech/}
}