Towards an FPGA implementation of IOT-based multi-modal Hearing AID System

Godwin Enemali; Abhijeet Bishnu; Tharmalingam Ratnarajah; Tughrul Arslan

doi:10.1109/ICASSPW59220.2023.10192936

Towards an FPGA implementation of IOT-based multi-modal Hearing AID System

Godwin Enemali^*, Abhijeet Bishnu, Tharmalingam Ratnarajah, Tughrul Arslan

^*Corresponding author for this work

Electronic Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

93 Downloads (Pure)

Abstract

This paper presents implementing a cloud-based multimodal hearing aid (HA) system. It identifies major processing blocks to be implemented on an embedded Field Programmable Gate Array (FPGA) and focuses on aspects of a custom block that deals with the integration of multiple input sources of the HA. In particular, the integration block deals with the combination of audio and video (AV) data at different sampling rates, with each having a different number of bits to encode their information. It realizes seamless combination of AV data by assigning a scaled number of bits to each component in the combined signal to achieve a real-time data transmission of all data sources. In addition, key issues such as security is discussed and plan to address this in our future work is stated.

Original language	English
Title of host publication	ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings
Publisher	IEEE
Number of pages	4
ISBN (Electronic)	9798350302615
ISBN (Print)	9798350302622
DOIs	https://doi.org/10.1109/ICASSPW59220.2023.10192936
Publication status	Published - 2 Aug 2023

Publication series

Name	ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings
ISSN (Print)	1520-6149

Keywords

Audio-visual speech enhancement
embedded platform
multimodal hearing aid
multi-modal hearing aid

ASJC Scopus subject areas

Information Systems
Signal Processing
Computer Networks and Communications
Computer Science Applications
Acoustics and Ultrasonics

Documents and Links

10.1109/ICASSPW59220.2023.10192936

Author accepted manuscript
© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Author accepted manuscript, 289 KB

Cite this

Enemali, G., Bishnu, A., Ratnarajah, T., & Arslan, T. (2023). Towards an FPGA implementation of IOT-based multi-modal Hearing AID System. In ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings (ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings). IEEE. https://doi.org/10.1109/ICASSPW59220.2023.10192936

Enemali, Godwin ; Bishnu, Abhijeet ; Ratnarajah, Tharmalingam et al. / Towards an FPGA implementation of IOT-based multi-modal Hearing AID System. ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings. IEEE, 2023. (ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings).

@inproceedings{fa7e0f0798ac4ddba44591f14905882b,

title = "Towards an FPGA implementation of IOT-based multi-modal Hearing AID System",

abstract = "This paper presents implementing a cloud-based multimodal hearing aid (HA) system. It identifies major processing blocks to be implemented on an embedded Field Programmable Gate Array (FPGA) and focuses on aspects of a custom block that deals with the integration of multiple input sources of the HA. In particular, the integration block deals with the combination of audio and video (AV) data at different sampling rates, with each having a different number of bits to encode their information. It realizes seamless combination of AV data by assigning a scaled number of bits to each component in the combined signal to achieve a real-time data transmission of all data sources. In addition, key issues such as security is discussed and plan to address this in our future work is stated.",

keywords = "Audio-visual speech enhancement, embedded platform, multimodal hearing aid, multi-modal hearing aid",

author = "Godwin Enemali and Abhijeet Bishnu and Tharmalingam Ratnarajah and Tughrul Arslan",

year = "2023",

month = aug,

day = "2",

doi = "10.1109/ICASSPW59220.2023.10192936",

language = "English",

isbn = "9798350302622",

series = "ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings",

publisher = "IEEE",

booktitle = "ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings",

address = "United States",

}

Enemali, G, Bishnu, A, Ratnarajah, T & Arslan, T 2023, Towards an FPGA implementation of IOT-based multi-modal Hearing AID System. in ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings. ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings, IEEE. https://doi.org/10.1109/ICASSPW59220.2023.10192936

Towards an FPGA implementation of IOT-based multi-modal Hearing AID System. / Enemali, Godwin; Bishnu, Abhijeet; Ratnarajah, Tharmalingam et al.
ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings. IEEE, 2023. (ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Towards an FPGA implementation of IOT-based multi-modal Hearing AID System

AU - Enemali, Godwin

AU - Bishnu, Abhijeet

AU - Ratnarajah, Tharmalingam

AU - Arslan, Tughrul

PY - 2023/8/2

Y1 - 2023/8/2

N2 - This paper presents implementing a cloud-based multimodal hearing aid (HA) system. It identifies major processing blocks to be implemented on an embedded Field Programmable Gate Array (FPGA) and focuses on aspects of a custom block that deals with the integration of multiple input sources of the HA. In particular, the integration block deals with the combination of audio and video (AV) data at different sampling rates, with each having a different number of bits to encode their information. It realizes seamless combination of AV data by assigning a scaled number of bits to each component in the combined signal to achieve a real-time data transmission of all data sources. In addition, key issues such as security is discussed and plan to address this in our future work is stated.

AB - This paper presents implementing a cloud-based multimodal hearing aid (HA) system. It identifies major processing blocks to be implemented on an embedded Field Programmable Gate Array (FPGA) and focuses on aspects of a custom block that deals with the integration of multiple input sources of the HA. In particular, the integration block deals with the combination of audio and video (AV) data at different sampling rates, with each having a different number of bits to encode their information. It realizes seamless combination of AV data by assigning a scaled number of bits to each component in the combined signal to achieve a real-time data transmission of all data sources. In addition, key issues such as security is discussed and plan to address this in our future work is stated.

KW - Audio-visual speech enhancement

KW - embedded platform

KW - multimodal hearing aid

KW - multi-modal hearing aid

U2 - 10.1109/ICASSPW59220.2023.10192936

DO - 10.1109/ICASSPW59220.2023.10192936

M3 - Conference contribution

SN - 9798350302622

T3 - ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings

BT - ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings

PB - IEEE

ER -

Enemali G, Bishnu A, Ratnarajah T, Arslan T. Towards an FPGA implementation of IOT-based multi-modal Hearing AID System. In ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings. IEEE. 2023. (ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings). doi: 10.1109/ICASSPW59220.2023.10192936

Towards an FPGA implementation of IOT-based multi-modal Hearing AID System

Abstract

Publication series

Keywords

ASJC Scopus subject areas

Documents and Links

Fingerprint

Cite this