TY - GEN
T1 - A Transductive Model-Agnostic Contrastive Learning Framework for Few-Shot Learning
AU - Kang, Tianyu
AU - Zheng, Chengjie
AU - Chen, Ping
AU - Ding, Wei
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2026.
PY - 2026
Y1 - 2026
N2 - Few-shot learning is critical in data mining systems where new or long-tail categories appear with only a few labeled examples. We propose MACL, a transductive and model-agnostic contrastive learning framework for robust few-shot classification. MACL contains two branches. The contrastive branch learns margin-aware embeddings through hard-negative mining, boundary-sensitive reweighting, and semi-positive construction. The transductive branch refines class weights by maximizing mutual information over the entire query set with support supervision. A lightweight gradient-based scheme adaptively balances the loss terms, and parameter-efficient tuning with adapters, LoRA, and visual prompts enables scalable adaptation across convolutional and transformer backbones. We construct controlled few-shot evaluations based on miniImageNet and tieredImageNet to assess robustness under spurious correlations, label noise, and open-set queries. Experiments show that MACL and its ViT-based variant consistently outperform strong inductive and transductive baselines in accuracy, calibration, and robustness. Overall, the results suggest that MACL benefits from a tightly coupled contrastive and transductive design in which margin-aware supervised contrastive learning shapes the posteriors optimized by the InfoMax objective under adaptive balancing. This cooperative mechanism goes beyond a simple combination of SupCon, TIM, and gradient reweighting and provides a unified and scalable solution for few-shot learning in practical data mining and knowledge discovery tasks.
AB - Few-shot learning is critical in data mining systems where new or long-tail categories appear with only a few labeled examples. We propose MACL, a transductive and model-agnostic contrastive learning framework for robust few-shot classification. MACL contains two branches. The contrastive branch learns margin-aware embeddings through hard-negative mining, boundary-sensitive reweighting, and semi-positive construction. The transductive branch refines class weights by maximizing mutual information over the entire query set with support supervision. A lightweight gradient-based scheme adaptively balances the loss terms, and parameter-efficient tuning with adapters, LoRA, and visual prompts enables scalable adaptation across convolutional and transformer backbones. We construct controlled few-shot evaluations based on miniImageNet and tieredImageNet to assess robustness under spurious correlations, label noise, and open-set queries. Experiments show that MACL and its ViT-based variant consistently outperform strong inductive and transductive baselines in accuracy, calibration, and robustness. Overall, the results suggest that MACL benefits from a tightly coupled contrastive and transductive design in which margin-aware supervised contrastive learning shapes the posteriors optimized by the InfoMax objective under adaptive balancing. This cooperative mechanism goes beyond a simple combination of SupCon, TIM, and gradient reweighting and provides a unified and scalable solution for few-shot learning in practical data mining and knowledge discovery tasks.
KW - Contrastive learning
KW - Few-shot learning
KW - Foundation models
KW - Hard negatives
KW - Transductive inference
UR - https://www.scopus.com/pages/publications/105041808586
UR - https://www.scopus.com/pages/publications/105041808586#tab=citedBy
U2 - 10.1007/978-981-92-1300-9_43
DO - 10.1007/978-981-92-1300-9_43
M3 - Conference contribution
AN - SCOPUS:105041808586
SN - 9789819212996
T3 - Lecture Notes in Computer Science
SP - 545
EP - 556
BT - Advances in Knowledge Discovery and Data Mining - 30th Pacific-Asia Conference on Knowledge Discovery and Data Mining, PAKDD 2026, Proceedings
A2 - Wong, Raymond Chi-Wing
A2 - Tong, Hanghang
A2 - Lu, Hua
A2 - Kwok, James
A2 - Salim, Flora
A2 - Song, Yuanfeng
A2 - Yiu, Man Lung
PB - Springer Science and Business Media Deutschland GmbH
T2 - 30th Pacific-Asia Conference on Knowledge Discovery and Data Mining, PAKDD 2026
Y2 - 9 June 2026 through 12 June 2026
ER -