DEIALDI PUBLIKOETAN FINANTZIATUTAKO IKERKETA PROIEKTUAK

Deep learning approaches for speech restoration from face movement biosignals

Denboraldia:
2023-tik 2026 arte
Finantzaketa egin duen erakundea:
Ministerio de Ciencia e Innovación
Zenbatekoa guztira:
186875
Deskribapena:

The GENERAL OBJECTIVE of DeepRESTORE is to overcome the limitations of both traditional voice rehabilitation methods and previous SSI studies by investigating SSI-based communication systems for restoring communication to individuals who have been deprived of the ability to speak. In particular, in the subproject that will be developed at UPV/EHU total-laryngectomy patients, whose upper vocal tract (i.e. mouth, tongue, lips, etc.) is intact but cannot speak normally because their entire larynx (an organ essential for sound production) has been surgically removed to treat laryngeal cancer will be considered. These persons still retain the control over their speech articulators and, hence, biosignals reflecting the movements of the articulators can be easily captured using EMG and or video images of their faces.