Keynote TalkListening the Chinese Way
Abstract
Humans have a remarkable ability to pay their auditory attention only to a sound source of interest, that we call selective auditory attention, in a multi-talker environment or a Cocktail Party. As discovered in neuroscience and psychoacoustics, the auditory attention is achieved by a modulation of top-down and bottom-up attention. However, signal processing approach to target speaker extraction in a multi-talker environment remains a challenge. Human listening is more of an art than a science. The Chinese character for the word 'listening' carries the ancient wisdom about important aspects of what people believe it means to really 'listen' to someone, i.e. hearing, seeing, and understanding. In this talk, we study the deep learning solutions to target speaker extraction that enable selective auditory attention. We review the findings from human audio-visual speech perception to motivate the design of speech perception algorithms. We will also discuss the computational auditory models, technical challenges and the recent advances in the field.
Short Bio
Dr. Haizhou Li is a Presidential Chair Professor and Dean at the School of Artificial Intelligence, CUHKSZ. He is also an adjunct professor at NUS. He earned his B.Sc., M.Sc., and Ph.D. from South China University of Technology. A veteran in speech and language technology since 1988, Dr. Li has held global academic posts and significant research/industry leadership roles, including at Apple-ISS Research Centre, Lernout & Hauspie, and the Institute for Infocomm Research (I2R), Singapore. He co-founded the Baidu-I2R Research Centre. His technical contributions include award-winning products like Apple's Chinese Dictation Kits and major deployments like Baidu Music Search. His research interests are ASR (Automatic Speech Recognition), NLP (Natural Language Processing), and IR (Information Retrieval). He has held numerous prestigious service positions, including Editor-in-Chief of IEEE/ACM Transactions on Audio, Speech and Language Processing, and President of International Speech Communication Association (ISCA) and Asia Pacific Signal and Information Processing Association (APSIPA). He has chaired major conferences like ACL (Association for Computational Linguistics) 2012, INTERSPEECH 2014, and ICASSP (International Conference on Acoustics, Speech, and Signal Processing) 2022. Dr. Li is an IEEE Fellow, an ISCA Fellow, a Member of Academy of Engineering Singapore, and a recipient of Singapore's President's Technology Award (2013).