Noninvasive EEG-Based Auditory Attention Detection for Online Modulation of Sound Sources
Keywords:
EEG, auditory attention, noninvasive, brain-computer interface, sound source modulationAbstract
Noninvasive EEG-based auditory attention detection has the potential to revolutionize the field of hearing aids. This study presents a novel investigation into the feasibility of online modulation of sound sources through probabilistic detection of auditory attention, utilizing a noninvasive EEG-based brain-computer interface. The proposed online system achieves modulation of upcoming sound sources by employing gain adaptation based on soft decisions from a classifier trained on offline calibration data. During calibration sessions, EEG data were collected while participants listened to two sound sources, one attended and one unattended. Cross-correlation coefficients between the EEG measurements and the envelope of the attended and unattended sound sources were analyzed to reveal differences in neural response sharpness and delays for attended versus unattended sound sources. Salient features were identified from the correlation patterns to distinguish attended sources from unattended ones and used to train an auditory attention classifier. The results of this study contribute significantly in two aspects. Firstly, the high offline detection performance of the auditory attention classifier was demonstrated using shorter duration single-channel EEG measurements, outperforming existing approaches that employ a larger number of channels and longer EEG recordings. Secondly, the performance of the online sound source modulation system, utilizing the classifier trained offline, was evaluated. The findings indicate that the online system effectively maintains a higher level of the attended sound source compared to the unattended source. This research paves the way for advancements in the development of improved hearing aids incorporating noninvasive EEG-based auditory attention detection.
References
Chung K. Challenges and recent developments in hearing aids: Part I. Speech understanding in noise, microphone technologies and noise reduction algorithms. Trends in Amplification. 2004;8(3):83-124.
Schroeder TB, Houghtaling J, Wilts BD, Mayer M. It's not a bug, it's a feature: functional materials in insects. Advanced Materials. 2018 May;30(19):1705322.
Lunner T, Rudner M, Rönnberg J. Cognition and hearing aids. Scandinavian journal of psychology. 2009 Oct;50(5):395-403.
Lai YH, Tsao Y, Lu X, Chen F, Su YT, Chen KC, Chen YH, Chen LC, Li LP, Lee CH. Deep learning–based noise reduction approach to improve speech intelligibility for cochlear implant recipients. Ear and hearing. 2018 Jul 1;39(4):795-809.
Mauger SJ, Warren CD, Knight MR, Goorevich M, Nel E. Clinical evaluation of the Nucleus® 6 cochlear implant system: Performance improvements with SmartSound iQ. International journal of Audiology. 2014 Aug 1;53(8):564-76.
Izadi S, Jabari K, Izadi M, Hamedani BK, Ghaffari A. Identification and Diagnosis of Dynamic and Static Misalignment in Induction Motor Using Unscented Kalman Filter. In2021 13th Iranian Conference on Electrical Engineering and Computer Science (ICEESC) 2021.
Bentler R, Chiou LK. Digital noise reduction: An overview. Trends in amplification. 2006 Jun;10(2):67-82.
Bentler R, Wu YH, Kettel J, Hurtig R. Digital noise reduction: Outcomes from laboratory and field studies. International journal of audiology. 2008 Jan 1;47(8):447-60.
Keshavarzi M, Kegler M, Kadir S, Reichenbach T. Transcranial alternating current stimulation in the theta band but not in the delta band modulates the comprehension of naturalistic speech in noise. NeuroImage. 2020 Apr 15;210:116557.
K. Jabari, M. Izadi, S. Izadi, B. Khadem Hamedani, and A. Ghaffari, "Predictive and Data-Driven Control of Traffic Lights in Urban Road Networks using Linear and Time-Varying Model," in 2022 14th Iranian Conference on Electrical Engineering and Computer Science (ICEESC), 2022.
Brons I, Houben R, Dreschler WA. Perceptual effects of noise reduction with respect to personal preference, speech intelligibility, and listening effort. Ear and Hearing. 2013 Jan 1;34(1):29-41.
Najari, A., Shabani, F. and Hosseynzadeh, M., 2021. INTEGRATED INTELLIGENT CONTROL SYSTEM DESIGN TO IMPROVE VEHICLE ROTATIONAL STABILITY USING ACTIVE DIFFERENTIAL. Acta Technica Corviniensis-Bulletin of Engineering, 14(1), pp.79-82.
Alickovic E, Lunner T, Wendt D, Fiedler L, Hietkamp R, Ng EH, Graversen C. Neural representation enhanced for speech and reduced for background noise with a hearing aid noise reduction scheme during a selective attention task. Frontiers in neuroscience. 2020 Sep 10;14:846.
Gustafson S, McCreery R, Hoover B, Kopun JG, Stelmachowicz P. Listening effort and perceived clarity for normal hearing children with the use of digital noise reduction. Ear and hearing. 2014 Mar;35(2):183.
Crukley J, Scollie S, Parsa V. An exploration of non-quiet listening at school. Journal of Educational Audiology. 2011;17(1):23-35.
Blamey PJ. Adaptive dynamic range optimization (ADRO): a digital amplification strategy for hearing aids and cochlear implants. Trends in amplification. 2005;9(2):77-98.
Timmer BH, Hickson L, Launer S. Adults with mild hearing impairment: Are we meeting the challenge?. International journal of audiology. 2015 Nov 2;54(11):786-95.
Kadir S, Kaza C, Weissbart H, Reichenbach T. Modulation of speech-in-noise comprehension through transcranial current stimulation with the phase-shifted speech envelope. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2019 Nov 18;28(1):23-31.
Cheraghifard M, Shafaroodi N, Khalafbeigi M, Yazdani F, Alvandi F. Psychometric properties of the Persian version of Volitional Questionnaire in Patients with Severe Mental Illnesses. Journal of Rehabilitation Sciences & Research. 2019 Jun 1;6(2):86-90.