Deep learning approaches for speech restoration from face movement biosignals
- Denboraldia:
- 2023-tik 2026 arte
- Finantzaketa egin duen erakundea:
- Ministerio de Ciencia e Innovación
- Zenbatekoa guztira:
- 186875
- Deskribapena:
-
The GENERAL OBJECTIVE of DeepRESTORE is to overcome the limitations of both traditional voice rehabilitation methods and previous SSI studies by investigating SSI-based communication systems for restoring communication to individuals who have been deprived of the ability to speak. In particular, in the subproject that will be developed at UPV/EHU total-laryngectomy patients, whose upper vocal tract (i.e. mouth, tongue, lips, etc.) is intact but cannot speak normally because their entire larynx (an organ essential for sound production) has been surgically removed to treat laryngeal cancer will be considered. These persons still retain the control over their speech articulators and, hence, biosignals reflecting the movements of the articulators can be easily captured using EMG and or video images of their faces.