Skip to main navigation Skip to search Skip to main content

A Transductive Model-Agnostic Contrastive Learning Framework for Few-Shot Learning

  • University of Massachusetts Boston

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Few-shot learning is critical in data mining systems where new or long-tail categories appear with only a few labeled examples. We propose MACL, a transductive and model-agnostic contrastive learning framework for robust few-shot classification. MACL contains two branches. The contrastive branch learns margin-aware embeddings through hard-negative mining, boundary-sensitive reweighting, and semi-positive construction. The transductive branch refines class weights by maximizing mutual information over the entire query set with support supervision. A lightweight gradient-based scheme adaptively balances the loss terms, and parameter-efficient tuning with adapters, LoRA, and visual prompts enables scalable adaptation across convolutional and transformer backbones. We construct controlled few-shot evaluations based on miniImageNet and tieredImageNet to assess robustness under spurious correlations, label noise, and open-set queries. Experiments show that MACL and its ViT-based variant consistently outperform strong inductive and transductive baselines in accuracy, calibration, and robustness. Overall, the results suggest that MACL benefits from a tightly coupled contrastive and transductive design in which margin-aware supervised contrastive learning shapes the posteriors optimized by the InfoMax objective under adaptive balancing. This cooperative mechanism goes beyond a simple combination of SupCon, TIM, and gradient reweighting and provides a unified and scalable solution for few-shot learning in practical data mining and knowledge discovery tasks.

Original languageEnglish
Title of host publicationAdvances in Knowledge Discovery and Data Mining - 30th Pacific-Asia Conference on Knowledge Discovery and Data Mining, PAKDD 2026, Proceedings
EditorsRaymond Chi-Wing Wong, Hanghang Tong, Hua Lu, James Kwok, Flora Salim, Yuanfeng Song, Man Lung Yiu
PublisherSpringer Science and Business Media Deutschland GmbH
Pages545-556
Number of pages12
ISBN (Print)9789819212996
DOIs
StatePublished - 2026
Event30th Pacific-Asia Conference on Knowledge Discovery and Data Mining, PAKDD 2026 - Hong Kong, China
Duration: Jun 9 2026 → Jun 12 2026

Publication series

NameLecture Notes in Computer Science
Volume16597 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference30th Pacific-Asia Conference on Knowledge Discovery and Data Mining, PAKDD 2026
Country/TerritoryChina
CityHong Kong
Period6/9/26 → 6/12/26

ASJC Scopus Subject Areas

  • Theoretical Computer Science
  • General Computer Science

Keywords

  • Contrastive learning
  • Few-shot learning
  • Foundation models
  • Hard negatives
  • Transductive inference

Cite this