Skip to main navigation Skip to search Skip to main content

ELECTRA-KG: A Transformer-Knowledge Graph Recommender System

  • University of Massachusetts Boston
  • Oakland University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Knowledge graphs (KGs) are becoming popular in recommender systems in recent times because of the wealth of side information they provide. Many researchers rely on KGs to help resolve the issues of cold start, diversity, and explainability in recommendations. However, the existing approaches usually ignore entity descriptions, which are essential in providing content information for entities in KGs. In this work, we propose a contextual language model for KG completion known as ELECTRA-KG (Efficiently Learning an Encoder that Classifies Token Replacements Accurately). We formulate the recommendation task as a KG link prediction task where we have an incomplete knowledge graph and we use state-of-the-art approaches to complete it. We do this by identifying missing facts among entities from our test data. To evaluate and validate our method, we perform a couple of experiments. First, we run experiments to demonstrate how well our model compares to state-of-the-art KG embedding models. Second, we run further experiments with our model on the tag recommendation task and compare our results to existing baselines. Our results show that our model outperforms the existing baselines on the tag recommendation task.

Original languageEnglish
Title of host publicationServices Computing – SCC 2022 - 19th International Conference, Held as Part of the Services Conference Federation, SCF 2022, Proceedings
EditorsWang Qingyang, Liang-Jie Zhang
PublisherSpringer Science and Business Media Deutschland GmbH
Pages56-70
Number of pages15
ISBN (Print)9783031235146
DOIs
StatePublished - 2022
Event19th International Conference on Services Computing, SCC 2022, held as part of the Services Conference Federation, SCF 2022 - Honolulu, United States
Duration: Dec 10 2022 → Dec 14 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13738 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference19th International Conference on Services Computing, SCC 2022, held as part of the Services Conference Federation, SCF 2022
Country/TerritoryUnited States
CityHonolulu
Period12/10/22 → 12/14/22

ASJC Scopus Subject Areas

  • Theoretical Computer Science
  • General Computer Science

Keywords

  • Deep learning
  • Language modeling
  • Recommender systems
  • Reinforcement learning
  • word2vec

Fingerprint

Dive into the research topics of 'ELECTRA-KG: A Transformer-Knowledge Graph Recommender System'. Together they form a unique fingerprint.

Cite this