Face-Mic: Inferring live speech and speaker identity via subtle facial dynamics captured by AR/VR motion sensors

Cong Shi; Xiangyu Xu; Tianfang Zhang; Payton Walker; Yi Wu; Jian Liu; Nitesh Saxena; Yingying Chen; Jiadi Yu

doi:10.1145/3447993.3483272

Face-Mic: Inferring live speech and speaker identity via subtle facial dynamics captured by AR/VR motion sensors

Cong Shi
, Xiangyu Xu
, Tianfang Zhang
, Payton Walker
, Yi Wu
, Jian Liu
, Nitesh Saxena
, Yingying Chen
, Jiadi Yu

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Original language	English
Title of host publication	ACM MobiCom 2021 - Proceedings of the 27th ACM Annual International Conference On Mobile Computing And Networking
Publisher	Association for Computing Machinery
Pages	478-490
Number of pages	13
ISBN (Electronic)	9781450383424
DOIs	https://doi.org/10.1145/3447993.3483272
State	Published - Oct 25 2021
Externally published	Yes
Event	27th ACM Annual International Conference On Mobile Computing And Networking, MobiCom 2021 - New Orleans, United States Duration: Mar 28 2022 → Apr 1 2022

Publication series

Name	Proceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM
ISSN (Print)	1543-5679

Conference

Conference	27th ACM Annual International Conference On Mobile Computing And Networking, MobiCom 2021
Country/Territory	United States
City	New Orleans
Period	3/28/22 → 4/1/22

ASJC Scopus Subject Areas

Software
Hardware and Architecture
Computer Networks and Communications

Keywords

AR/VR headsets
facial dynamics
speech and speaker privacy

Access to Document

10.1145/3447993.3483272

Cite this

Shi, C., Xu, X., Zhang, T., Walker, P., Wu, Y., Liu, J., Saxena, N., Chen, Y., & Yu, J. (2021). Face-Mic: Inferring live speech and speaker identity via subtle facial dynamics captured by AR/VR motion sensors. In ACM MobiCom 2021 - Proceedings of the 27th ACM Annual International Conference On Mobile Computing And Networking (pp. 478-490). (Proceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM). Association for Computing Machinery. https://doi.org/10.1145/3447993.3483272

Face-Mic: Inferring live speech and speaker identity via subtle facial dynamics captured by AR/VR motion sensors. / Shi, Cong; Xu, Xiangyu; Zhang, Tianfang et al.
ACM MobiCom 2021 - Proceedings of the 27th ACM Annual International Conference On Mobile Computing And Networking. Association for Computing Machinery, 2021. p. 478-490 (Proceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Shi, C, Xu, X, Zhang, T, Walker, P, Wu, Y, Liu, J, Saxena, N, Chen, Y & Yu, J 2021, Face-Mic: Inferring live speech and speaker identity via subtle facial dynamics captured by AR/VR motion sensors. in ACM MobiCom 2021 - Proceedings of the 27th ACM Annual International Conference On Mobile Computing And Networking. Proceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM, Association for Computing Machinery, pp. 478-490, 27th ACM Annual International Conference On Mobile Computing And Networking, MobiCom 2021, New Orleans, United States, 3/28/22. https://doi.org/10.1145/3447993.3483272

Shi C, Xu X, Zhang T, Walker P, Wu Y, Liu J et al. Face-Mic: Inferring live speech and speaker identity via subtle facial dynamics captured by AR/VR motion sensors. In ACM MobiCom 2021 - Proceedings of the 27th ACM Annual International Conference On Mobile Computing And Networking. Association for Computing Machinery. 2021. p. 478-490. (Proceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM). doi: 10.1145/3447993.3483272

Shi, Cong ; Xu, Xiangyu ; Zhang, Tianfang et al. / Face-Mic : Inferring live speech and speaker identity via subtle facial dynamics captured by AR/VR motion sensors. ACM MobiCom 2021 - Proceedings of the 27th ACM Annual International Conference On Mobile Computing And Networking. Association for Computing Machinery, 2021. pp. 478-490 (Proceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM).

@inproceedings{080998f26c804085b417747a548ec682,

title = "Face-Mic: Inferring live speech and speaker identity via subtle facial dynamics captured by AR/VR motion sensors",

keywords = "AR/VR headsets, facial dynamics, speech and speaker privacy",

author = "Cong Shi and Xiangyu Xu and Tianfang Zhang and Payton Walker and Yi Wu and Jian Liu and Nitesh Saxena and Yingying Chen and Jiadi Yu",

note = "Publisher Copyright: {\textcopyright} 2021 ACM.; 27th ACM Annual International Conference On Mobile Computing And Networking, MobiCom 2021 ; Conference date: 28-03-2022 Through 01-04-2022",

year = "2021",

month = oct,

day = "25",

doi = "10.1145/3447993.3483272",

language = "English",

series = "Proceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM",

publisher = "Association for Computing Machinery",

pages = "478--490",

booktitle = "ACM MobiCom 2021 - Proceedings of the 27th ACM Annual International Conference On Mobile Computing And Networking",

}

TY - GEN

T1 - Face-Mic

T2 - 27th ACM Annual International Conference On Mobile Computing And Networking, MobiCom 2021

AU - Shi, Cong

AU - Xu, Xiangyu

AU - Zhang, Tianfang

AU - Walker, Payton

AU - Wu, Yi

AU - Liu, Jian

AU - Saxena, Nitesh

AU - Chen, Yingying

AU - Yu, Jiadi

PY - 2021/10/25

Y1 - 2021/10/25

KW - AR/VR headsets

KW - facial dynamics

KW - speech and speaker privacy

UR - https://www.scopus.com/pages/publications/85179557229

UR - https://www.scopus.com/pages/publications/85179557229#tab=citedBy

U2 - 10.1145/3447993.3483272

DO - 10.1145/3447993.3483272

M3 - Conference contribution

AN - SCOPUS:85179557229

T3 - Proceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM

SP - 478

EP - 490

BT - ACM MobiCom 2021 - Proceedings of the 27th ACM Annual International Conference On Mobile Computing And Networking

PB - Association for Computing Machinery

Y2 - 28 March 2022 through 1 April 2022

ER -

Face-Mic: Inferring live speech and speaker identity via subtle facial dynamics captured by AR/VR motion sensors

Publication series

Conference

ASJC Scopus Subject Areas

Keywords

Access to Document

Other files and links

Fingerprint

Cite this