Self-supervised learning for small-scale medical imaging dataset

E Maria Joseph Saron Fdo *, A. Antony Amal Rekshin, G Gino Gains, X Antony Marian Mcchenzi and A Jentzen Pablo Peniel

Computer Science Department, St. Mother Theresa Engineering College, Vagaikulam, Thoothukudi-628001
 
Research Article
World Journal of Advanced Engineering Technology and Sciences, 2024, 13(02), 142–145.
Article DOI: 10.30574/wjaets.2024.13.2.0526
Publication history: 
Received on 22 September 2024; revised on 05 November 2024; accepted on 07 November 2024
 
Abstract: 
In recent years, advancements in deep learning have dramatically improved performance in medical image analysis, yet these models typically rely on large-scale labeled datasets, which are often unattainable in medical settings due to privacy concerns, limited data availability, and high annotation costs. This study explores the application of self-supervised learning (SSL) techniques to overcome these limitations and effectively utilize small-scale medical imaging datasets. By leveraging SSL, we enable models to learn useful feature representations without requiring extensive labeled data. We investigate various self-supervised approaches, including contrastive learning and masked image modeling, and evaluate their effectiveness on a limited dataset of medical images. Our experiments demonstrate that SSL-based models can achieve competitive performance, even when trained on a fraction of the labeled data typically required for supervised methods. Additionally, we explore the impact of SSL on model robustness and generalization across diverse medical imaging modalities. The findings suggest that self-supervised techniques could reduce dependency on annotated data, paving the way for broader, more scalable applications in medical imaging. This research contributes to the development of efficient, scalable diagnostic tools that can be deployed in data-constrained environments, potentially improving diagnostic accuracy and accessibility in smaller healthcare facilities.
 
Keywords: 
Self-Supervised Learning; Medical Imaging; Small-Scale Dataset; Contrastive Learning; Unsupervised Representation Learning; Data Efficiency; Deep Learning in Healthcare; Medical Image Analysis; Diagnostic Imaging; Transfer Learning; Data Scarcity; Medical Data
 
Full text article in PDF: