On Neural Collapse in Contrastive Learning with Imbalanced Datasets

Thuan Nguyen; Ruijie Jiang; Shuchin Aeron; Prakash Ishwar; D. Richard Brown

doi:10.1109/MLSP58920.2024.10734809

On Neural Collapse in Contrastive Learning with Imbalanced Datasets

Thuan Nguyen
, Ruijie Jiang
, Shuchin Aeron
, Prakash Ishwar
, D. Richard Brown

Tufts University
Boston University College of Engineering
Department of Electrical and Computer Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Original language	English
Title of host publication	34th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2024 - Proceedings
Publisher	IEEE Computer Society
ISBN (Electronic)	9798350372250
DOIs	https://doi.org/10.1109/MLSP58920.2024.10734809
State	Published - 2024
Event	34th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2024 - London, United Kingdom Duration: Sep 22 2024 → Sep 25 2024

Publication series

Name	IEEE International Workshop on Machine Learning for Signal Processing, MLSP
ISSN (Print)	2161-0363
ISSN (Electronic)	2161-0371

Conference

Conference	34th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2024
Country/Territory	United Kingdom
City	London
Period	9/22/24 → 9/25/24

ASJC Scopus Subject Areas

Human-Computer Interaction
Signal Processing

Keywords

Contrastive learning
imbalanced datasets
neural collapse
optimal geometry
representation learning

Access to Document

10.1109/MLSP58920.2024.10734809

Cite this

Nguyen, T., Jiang, R., Aeron, S., Ishwar, P., & Brown, D. R. (2024). On Neural Collapse in Contrastive Learning with Imbalanced Datasets. In 34th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2024 - Proceedings (IEEE International Workshop on Machine Learning for Signal Processing, MLSP). IEEE Computer Society. https://doi.org/10.1109/MLSP58920.2024.10734809

On Neural Collapse in Contrastive Learning with Imbalanced Datasets. / Nguyen, Thuan; Jiang, Ruijie; Aeron, Shuchin et al.
34th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2024 - Proceedings. IEEE Computer Society, 2024. (IEEE International Workshop on Machine Learning for Signal Processing, MLSP).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Nguyen, T, Jiang, R, Aeron, S, Ishwar, P & Brown, DR 2024, On Neural Collapse in Contrastive Learning with Imbalanced Datasets. in 34th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2024 - Proceedings. IEEE International Workshop on Machine Learning for Signal Processing, MLSP, IEEE Computer Society, 34th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2024, London, United Kingdom, 9/22/24. https://doi.org/10.1109/MLSP58920.2024.10734809

@inproceedings{63801ed985d14fd1bb7144e9ad80842f,

title = "On Neural Collapse in Contrastive Learning with Imbalanced Datasets",

keywords = "Contrastive learning, imbalanced datasets, neural collapse, optimal geometry, representation learning",

author = "Thuan Nguyen and Ruijie Jiang and Shuchin Aeron and Prakash Ishwar and Brown, \{D. Richard\}",

note = "Publisher Copyright: {\textcopyright} 2024 IEEE.; 34th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2024 ; Conference date: 22-09-2024 Through 25-09-2024",

year = "2024",

doi = "10.1109/MLSP58920.2024.10734809",

language = "English",

series = "IEEE International Workshop on Machine Learning for Signal Processing, MLSP",

publisher = "IEEE Computer Society",

booktitle = "34th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2024 - Proceedings",

}

TY - GEN

T1 - On Neural Collapse in Contrastive Learning with Imbalanced Datasets

AU - Nguyen, Thuan

AU - Jiang, Ruijie

AU - Aeron, Shuchin

AU - Ishwar, Prakash

AU - Brown, D. Richard

PY - 2024

Y1 - 2024

KW - Contrastive learning

KW - imbalanced datasets

KW - neural collapse

KW - optimal geometry

KW - representation learning

UR - https://www.scopus.com/pages/publications/85209413216

UR - https://www.scopus.com/pages/publications/85209413216#tab=citedBy

U2 - 10.1109/MLSP58920.2024.10734809

DO - 10.1109/MLSP58920.2024.10734809

M3 - Conference contribution

AN - SCOPUS:85209413216

T3 - IEEE International Workshop on Machine Learning for Signal Processing, MLSP

BT - 34th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2024 - Proceedings

PB - IEEE Computer Society

T2 - 34th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2024

Y2 - 22 September 2024 through 25 September 2024

ER -

On Neural Collapse in Contrastive Learning with Imbalanced Datasets

Publication series

Conference

ASJC Scopus Subject Areas

Keywords

Access to Document

Other files and links

Cite this