WavBERT: Exploiting semantic and non-semantic speech using Wav2vec and BERT for dementia detection

Youxiang Zhu; Abdelrahman Obyat; Xiaohui Liang; John A. Batsis; Robert M. Roth

doi:10.21437/Interspeech.2021-332

WavBERT: Exploiting semantic and non-semantic speech using Wav2vec and BERT for dementia detection

Youxiang Zhu
, Abdelrahman Obyat
, Xiaohui Liang
, John A. Batsis
, Robert M. Roth

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Original language	English
Title of host publication	22nd Annual Conference of the International Speech Communication Association, INTERSPEECH 2021
Publisher	International Speech Communication Association
Pages	4221-4225
Number of pages	5
ISBN (Electronic)	9781713836902
DOIs	https://doi.org/10.21437/Interspeech.2021-332
State	Published - 2021
Event	22nd Annual Conference of the International Speech Communication Association, INTERSPEECH 2021 - Brno, Czech Republic Duration: Aug 30 2021 → Sep 3 2021

Publication series

Name	Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
Volume	6
ISSN (Print)	2308-457X
ISSN (Electronic)	1990-9772

Conference

Conference	22nd Annual Conference of the International Speech Communication Association, INTERSPEECH 2021
Country/Territory	Czech Republic
City	Brno
Period	8/30/21 → 9/3/21

ASJC Scopus Subject Areas

Language and Linguistics
Human-Computer Interaction
Signal Processing
Software
Modeling and Simulation

Keywords

Automatic speech recognition
Dementia detection
Non-semantic information
Speech analysis

Access to Document

10.21437/Interspeech.2021-332

Cite this

Zhu, Y., Obyat, A., Liang, X., Batsis, J. A., & Roth, R. M. (2021). WavBERT: Exploiting semantic and non-semantic speech using Wav2vec and BERT for dementia detection. In 22nd Annual Conference of the International Speech Communication Association, INTERSPEECH 2021 (pp. 4221-4225). (Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH; Vol. 6). International Speech Communication Association. https://doi.org/10.21437/Interspeech.2021-332

WavBERT: Exploiting semantic and non-semantic speech using Wav2vec and BERT for dementia detection. / Zhu, Youxiang; Obyat, Abdelrahman; Liang, Xiaohui et al.
22nd Annual Conference of the International Speech Communication Association, INTERSPEECH 2021. International Speech Communication Association, 2021. p. 4221-4225 (Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH; Vol. 6).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Zhu, Y, Obyat, A, Liang, X, Batsis, JA & Roth, RM 2021, WavBERT: Exploiting semantic and non-semantic speech using Wav2vec and BERT for dementia detection. in 22nd Annual Conference of the International Speech Communication Association, INTERSPEECH 2021. Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, vol. 6, International Speech Communication Association, pp. 4221-4225, 22nd Annual Conference of the International Speech Communication Association, INTERSPEECH 2021, Brno, Czech Republic, 8/30/21. https://doi.org/10.21437/Interspeech.2021-332

Zhu Y, Obyat A, Liang X, Batsis JA, Roth RM. WavBERT: Exploiting semantic and non-semantic speech using Wav2vec and BERT for dementia detection. In 22nd Annual Conference of the International Speech Communication Association, INTERSPEECH 2021. International Speech Communication Association. 2021. p. 4221-4225. (Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH). doi: 10.21437/Interspeech.2021-332

Zhu, Youxiang ; Obyat, Abdelrahman ; Liang, Xiaohui et al. / WavBERT : Exploiting semantic and non-semantic speech using Wav2vec and BERT for dementia detection. 22nd Annual Conference of the International Speech Communication Association, INTERSPEECH 2021. International Speech Communication Association, 2021. pp. 4221-4225 (Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH).

@inproceedings{30edf912f67c4ce3bfceca209b5c8502,

title = "WavBERT: Exploiting semantic and non-semantic speech using Wav2vec and BERT for dementia detection",

keywords = "Automatic speech recognition, Dementia detection, Non-semantic information, Speech analysis",

author = "Youxiang Zhu and Abdelrahman Obyat and Xiaohui Liang and Batsis, \{John A.\} and Roth, \{Robert M.\}",

note = "Publisher Copyright: Copyright {\textcopyright} 2021 ISCA.; 22nd Annual Conference of the International Speech Communication Association, INTERSPEECH 2021 ; Conference date: 30-08-2021 Through 03-09-2021",

year = "2021",

doi = "10.21437/Interspeech.2021-332",

language = "English",

series = "Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH",

publisher = "International Speech Communication Association",

pages = "4221--4225",

booktitle = "22nd Annual Conference of the International Speech Communication Association, INTERSPEECH 2021",

}

TY - GEN

T1 - WavBERT

T2 - 22nd Annual Conference of the International Speech Communication Association, INTERSPEECH 2021

AU - Zhu, Youxiang

AU - Obyat, Abdelrahman

AU - Liang, Xiaohui

AU - Batsis, John A.

AU - Roth, Robert M.

PY - 2021

Y1 - 2021

KW - Automatic speech recognition

KW - Dementia detection

KW - Non-semantic information

KW - Speech analysis

UR - https://www.scopus.com/pages/publications/85119284337

UR - https://www.scopus.com/pages/publications/85119284337#tab=citedBy

U2 - 10.21437/Interspeech.2021-332

DO - 10.21437/Interspeech.2021-332

M3 - Conference contribution

AN - SCOPUS:85119284337

T3 - Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

SP - 4221

EP - 4225

BT - 22nd Annual Conference of the International Speech Communication Association, INTERSPEECH 2021

PB - International Speech Communication Association

Y2 - 30 August 2021 through 3 September 2021

ER -

WavBERT: Exploiting semantic and non-semantic speech using Wav2vec and BERT for dementia detection

Publication series

Conference

ASJC Scopus Subject Areas

Keywords

Access to Document

Other files and links

Fingerprint

Cite this