Multimodal system supporting acoustic communication with computers


The purpose of the MODALITY project, carried out by Audio Acoustics Laboratory, Multimedia Systems Department and Intel Technology Poland, is to reinforce audio and audio-visual communication with mobile computers. Portable computer devices, such as tablets, netbooks or smartphones, have gained a lot of popularity in the past few years. The research conducted within the project serves the purpose of improving the usage standards of such devices through improvement of the quality of the audio tract and human-computer interaction. Two main research topics are related to this goal: Smart Sound technology and audiovisual speech recognition. Thanks to the cooperation with a leading semiconductor devices manufacturer the results have the chance for commercialization of global range.

Photo: Bartosz Kunka