Skip to main navigation Skip to search Skip to main content

New User Intent Discovery With Robust Pseudo Label Training and Source Domain Joint Training

  • Xi'an Jiaotong University

Research output: Contribution to journal › Article › peer-review

Abstract

Discovering new user intents based on existing intents from constantly incoming unlabeled data is an important task in many intelligent systems deployed in the real world (e.g., dialogue systems). Since data with new intents are completely unlabeled, most current approaches employ clustering methods to generate pseudo labels to train their models. However, due to intent gaps between existing and new intents, pseudo labels generated by these models are noisy, and prior knowledge from existing intents is not fully utilized. To mitigate these issues, we propose a robust pseudo label training and source domain joint-training network to refine the noisy pseudo labels and make full use of prior knowledge. Experimental results on three intent detection datasets show that our model is more effective and robust than state-of-the-art methods. The code and data are released at https://github.com/Lackel/PTJN.

Original languageEnglish
Pages (from-to)21-31
Number of pages11
JournalIEEE Intelligent Systems
Volume38
Issue number4
DOIs
StatePublished - Jul 1 2023

ASJC Scopus Subject Areas

  • Computer Networks and Communications
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'New User Intent Discovery With Robust Pseudo Label Training and Source Domain Joint Training'. Together they form a unique fingerprint.

Cite this