Comparative Analysis of Transfer Learning Models for Breast Cancer Classification

Breast cancer (BC) is a malignant disease that arises in the breast tissue, usually starting with the unregulated growth of cells. The presence of malignant cells frequently results in the development of a discernible tumor, which can be detected by the utilization of imaging methods like mammography[1].

The timely identification of breast cancer is essential, although it poses difficulties due to the frequently asymptomatic presentation of the illness throughout its early phases. Diagnostic procedures, such as mammography, ultrasound, and biopsy, are crucial in differentiating between benign and malignant tumors[2].

Nevertheless, traditional manual diagnosis is time-consuming and necessitates the proficiency of exceptionally trained pathologists, who may still be susceptible to diagnostic inaccuracies as a result of human constraints and variations in expertise. In order to tackle these difficulties, Computer-Aided Diagnostic (CAD) systems have been created and proven to greatly assist in the diagnostic procedure[3].

The recent achievements of Convolutional Neural Networks (CNNs) in several fields of image classification have motivated their use in medical imaging, namely for the categorization of histopathology images[4]. CNN possess the ability to acquire and extract hierarchical characteristics from images, rendering them well-suited for the identification of intricate patterns linked to malignant tumors.The classification task entails the allocation of each image or image patch to its corresponding category, such as benign or malignant[5].

This automated methodology seeks to enhance the accuracy and effectiveness of breast cancer identification, potentially resulting in earlier detection and improved patient prognosis[6]. Araujo et al.[3] showed that CNNs are highly effective at categorizing breast cancer histology images, resulting in substantial enhancements compared to conventional approaches.

In addition, recent progress in deep learning has brought forth more advanced models such as ResNet, DenseNet, and Vision Transformers. These models have demonstrated promising outcomes in the field of medical picture processing. These models utilize complex structures, residual connections, and attention mechanisms to improve accuracy performance [6].

Furthermore, alternative machine learning methodologies have been investigated alongside CNNs. Support Vector Machines (SVMs) have been employed in gene selection and cancer categorization, showcasing the adaptability and potential of machine learning in the field of oncology[2]. In addition, sophisticated models such as EfficientNet and MobileNet have been modified for medical purposes, providing a harmonious combination of precision and computing efficiency [7].

This research aims to identify the most effective approaches for classifying histopathology images of breast cancer by conducting a comparative analysis of eight advanced models: ResNet-50, DenseNet-121, ResNeXt-50, Vision Transformer (ViT), GoogLeNet (Inception v3), EfficientNet, MobileNet, and SqueezeNet. This undertaking aims to make a valuable contribution to the profession by improving the accuracy of diagnoses, ultimately leading to better outcomes for patients and potentially saving lives.

Breast cancer continues to be a serious worldwide health concern, causing substantial rates of death and illness. According to statistics from 2012, breast cancer caused 522,000 deaths globally, and there were 1.68 million newly diagnosed cases [8]. In 2018, the World Cancer Research Fund reported over 2 million newly diagnosed instances of breast cancer, indicating a persistent increase in its occurrence. This significant rise highlights the urgent requirement for prompt identification and management to enhance rates of survival.

Timely identification of breast cancer is crucial, as it significantly improves the likelihood of effective therapy and prolonged survival. Research has indicated that over 95 percent of women who are diagnosed with early-stage breast cancer have a survival rate of five years or more [9, 10]. This statistic emphasizes the life-saving capacity of early diagnosis and the significance of creating dependable and effective diagnostic techniques.

The conventional approaches for diagnosing breast cancer, which mainly depend on manual examination by pathologists, are not only time-consuming but also susceptible to human fallibility. Pathologists of different proficiency levels may generate uneven outcomes, potentially resulting in misdiagnoses. Therefore, there is an urgent want for automated, precise, and effective diagnostic methods to aid in the timely identification of breast cancer. The progress in machine learning and deep learning has created new opportunities for enhancing breast cancer diagnostics. CNNs have shown exceptional performance in a wide range of image classification applications, including medical imaging [4]. These models have the ability to understand complex patterns in histopathological pictures that may be difficult for humans to see, making them a reliable tool for detecting cancerous cells.

Recent research has investigated the application of deep learning models in the classification of breast cancer histopathology images, yielding encouraging outcomes. Golatkar et al. [10] provided evidence of the efficacy of deep learning models in accurately categorizing breast cancer histology images, while Beam and Kohane [9] explored the transformative potential of big data and machine learning in the field of healthcare.

Furthermore, cutting-edge architectures like ResNet, DenseNet, and Vision Transformers have demonstrated exceptional efficacy in the field of medical image processing. Praveen et al. [11] emphasized the utilization of ResNet-32 and Fastai in the detection of ductal cancer from 2D tissue slides. Their approach resulted in notable enhancements in diagnostic precision. These developments demonstrate the potential of incorporating deep learning models into clinical practice to improve diagnostic accuracy and efficiency.

This project seeks to utilize advanced deep-learning models to create a CAD system, in response to the rising occurrence of breast cancer and the crucial significance of early detection. This research aims to determine the most effective methods for categorizing histopathology images of breast cancer by conducting a comparative examination of eight sophisticated models. The primary objective is to enhance the early identification and intervention process, consequently diminishing death rates and enhancing patient outcomes.

In recent years, there has been considerable interest in classifying breast histopathology photos. Researchers have been investigating several deep learning models to enhance the accuracy of diagnosis. This section provides an overview of the progress made in deep learning methods for classifying breast cancer. It specifically focuses on research that compares various models and emphasizes their effectiveness[11]. Praveen et al. [11] developed a specialized ResNet-32 architecture that improves the precision of categorizing breast histopathology pictures. Their study conducted a comparison analysis using different CNN-based models, such as AlexNet, VGG, and Inception. Their demonstration showcased the superior performance of ResNet-32 compared to these models, emphasizing the advantages of deeper topologies incorporating residual connections[12].

Brennon et al. [12] performed a comparative analysis of two commonly employed convolutional neural network structures: the VGG network and the Residual network. ResNet integrates shortcut connections and batch normalization, which helps expedite the training process and enhance the network’s capacity to generalize. The exceptional efficacy of their ensemble model, which merges VGG-based and ResNet-based classifiers, suggests that these architectures might mutually reinforce each other to improve diagnostic precision[13]. Nawaz et al. [13] enhanced the DenseNet model, showcasing the ability of deep learning techniques employed in natural image processing to reach outstanding results in medical image processing. Their model attained an accuracy of around 96 percent in multi-class breast cancer classification, surpassing the proficiency of human experts in the diagnostic domain. In addition, recent research has investigated the use of Vision Transformers (ViTs) for classifying medical images[14].

Dosovitskiy et al. [14] presented the Vision Transformer, a model that utilizes self-attention mechanisms to analyze visuals without relying heavily on preconceived notions. This model has demonstrated favorable outcomes in diverse picture classification assignments, such as medical imaging, owing to its proficient capacity to successfully capture extensive connections and contextual information.

Furthermore, the Inception network, which was proposed by Szegedy et al.[15]has been extensively utilized in medical image analysis because of its ability to interpret several scales. The architecture of Inception enables the effective extraction of characteristics at various sizes, making it well-suited for intricate image classification problems such as breast cancer detection. The EfficientNet model, as presented by Tan and Le[7], has also been examined for its possible applications in the field of medical imaging. EfficientNet employs a compound scaling technique to achieve a harmonious balance between network depth, width, and resolution, resulting in enhanced performance and efficiency. The use of this technology in categorizing breast cancer has shown substantial enhancements in both accuracy and computing efficiency.

To summarize, the existing research on breast cancer classification using deep learning models focuses on the ongoing progress and comparative evaluations of different architectures. The studies mentioned highlight the promise of deep learning in improving the accuracy and efficiency of breast cancer diagnosis, ranging from standard CNNs such as AlexNet and VGG to newer models like Vision Transformers and EfficientNet[16].

ResNet is a deep learning architecture that introduced skip connections to improve gradient propagation during training. Instead of learning a direct input-output mapping, ResNet learns residuals, which are combined with the input to produce the output. This approach allows the network to be very deep, with over 100 layers, and still be trainable. The added depth enhances performance in tasks like image classification and object detection by capturing intricate details, while residual learning helps address the vanishing gradient problem[16].

ResNeXt enhances the ResNet architecture by introducing "cardinality," which increases the number of independent pathways within each residual block. Unlike traditional ResNets, ResNeXt processes input data through multiple paths or groups concurrently, allowing the model to capture a broader range of features and improve its representational power. This approach enhances the model’s ability to learn complex patterns, resulting in better performance across various tasks. By incorporating grouped convolutions, ResNeXt achieves greater accuracy and efficiency compared to standard ResNet models[17].

DenseNet introduces a connectivity architecture where each layer is directly connected to all preceding layers, ensuring efficient feature reuse and improved gradient flow. This dense connectivity allows the model to receive input from all earlier layers, effectively addressing the vanishing gradient problem and optimizing parameter usage. By concatenating feature maps instead of summing them, DenseNet reduces the overall parameter count while maintaining high performance, making it highly effective for tasks like image classification and segmentation[18].

Inception v3 is a deep learning framework that extends the original Inception (GoogleLeNet) model with several enhancements to improve performance and efficiency. It addresses the challenge of varying object sizes in images by employing a multi-scale approach within each module, enabling the model to capture features at different resolutions. Inception v3 introduces factorized convolutions, which break down larger convolutions into smaller ones, reducing computational load and improving efficiency. Additionally, the model incorporates batch normalization to stabilize training and label smoothing to reduce overconfidence and enhance generalization. The architecture, composed of multiple Inception modules with various convolutional filters and pooling operations, allows for simultaneous analysis of spatial features at different scales. This multi-scale processing capability, combined with architectural improvements, makes Inception v3 particularly effective for tasks like analyzing medical images, such as breast histopathology classification, by capturing intricate details and improving detection accuracy[15].

EfficientNet is a series of CNN designed for high accuracy and processing efficiency, introduced by Tan and Le. It utilizes a unique compound scaling technique to proportionally scale the network’s depth, width, and resolution, optimizing performance without unnecessary computational costs. Starting with a baseline model, EfficientNet-B0, which balances accuracy and efficiency, the family includes models B1 to B7, each scaled up systematically in depth, width, and resolution for improved accuracy. EfficientNet incorporates Mobile Inverted Bottleneck Convolution (MBConv) layers for mobile efficiency, uses the Swish activation function for smoother gradients, and applies dropout and stochastic depth to enhance generalization and prevent overfitting. These innovations allow EfficientNet to achieve top accuracy on benchmark datasets with fewer computational resources, making it particularly effective for tasks like breast cancer histopathology image classification[7].

MobileNet is a category of efficient CNNs designed for mobile and embedded vision applications. The key innovation in MobileNet is the use of depthwise separable convolutions, which reduce the number of parameters and computational complexity compared to traditional convolutional layers. In this approach, spatial filtering and channel-wise operations are separated into two layers: depthwise convolutions, which apply a single filter per input channel to reduce computational load, and pointwise convolutions, which use a 1x1 filter to combine the depthwise results. This separation results in faster inference times and lower power consumption. MobileNet also incorporates width multipliers to adjust the number of channels per layer and resolution multipliers to control input image resolution, allowing for flexible scaling based on available computational resources. These features make MobileNet highly suitable for mobile and embedded devices, as well as for medical image analysis tasks like breast histopathology classification, where it provides accurate results within limited computational constraints[15].

SqueezeNet is a highly efficient convolutional neural network to match the accuracy of AlexNet while significantly reducing the number of parameters. This compact architecture is ideal for resource-constrained environments, such as mobile and embedded systems. The key innovation in SqueezeNet is the "fire module," which consists of a squeeze layer and an expansion layer. The squeeze layer uses 1x1 convolutions to reduce the number of input channels, lowering computational load and parameter count, while the expansion layer combines 1x1 and 3x3 convolutions to expand the compressed data, allowing the network to learn intricate features. SqueezeNet also employs techniques like 1x1 convolutions and delayed downsampling to further reduce model size without compromising accuracy. Additionally, it is highly compressible through methods like pruning, quantization, and Huffman coding, making it well-suited for devices with limited storage and processing power. In medical image analysis, SqueezeNet’s efficiency and reduced parameter count make it an excellent choice for tasks like breast histopathology classification, providing accurate and efficient real-time diagnostics in resource-limited settings[20].

Transformer-based models have proven effective across various tasks in Natural Language Processing and Computer Vision, with the Vision Transformer (ViT) standing out for its performance in medical imaging [21, 14]. Unlike traditional CNN that excel in learning spatial hierarchies through convolutional layers, ViT applies the Transformer architecture, originally designed for sequential data like text, to image data. ViT divides an image into fixed-size patches, converts these patches into token embeddings, and incorporates positional embeddings to maintain spatial information. These token embeddings are then processed by a transformer encoder, utilizing self-attention mechanisms to capture both global and local information within the image, resulting in robust feature representations.

One of the key advantages of ViT is its ability to handle images of varying dimensions without requiring resizing or cropping, thanks to its patch-based processing method. This flexibility makes ViT a versatile option for diverse image recognition tasks. In our studies, we employed the standard ViT model along with additional models, initially pre-training them on the ImageNet dataset. We then fine-tuned the models on our specific histopathology dataset to accurately distinguish between samples with invasive ductal carcinoma (IDC) and those without IDC, showcasing ViT’s effectiveness in medical image analysis.

Table 2 presents a comprehensive overview of the performance outcomes of different deep learning models assessed in this research. It includes precise measurements such as precision, recall, F1-score, and total accuracy metrics for both non-IDC and IDC classifications. This thorough comparison evaluates the performance of the models, offering insights into their efficacy for classifying breast cancer histopathology images, and includes a ranking of their relative performance.

The experimental system architecture was deployed on a system equipped with an AMD Ryzen Threadripper PRO 5965WX 24-core CPU, 62 GB of RAM, and an NVIDIA RTX A4500 GPU with 20 GB of memory. The models were created using Python and the PyTorch framework, leveraging its flexibility and comprehensive support for deep learning research. The training parameters were carefully selected to balance computational efficiency and model performance. All models trained for 10 epochs. To optimize training time and GPU memory usage, a batch size of 128 was chosen for training, while a batch size of 64 was used for validation and testing to balance memory consumption and processing efficiency.

The Adam optimizer was used with a learning rate of 0.0001, known for its ability to adjust the learning rate for each parameter, thus facilitating faster convergence. The models’ weights were initialized using pre-trained weights from the ImageNet dataset to enable transfer learning. This approach utilizes features learned from a large dataset, enhancing the model’s ability to quickly and efficiently converge on the specific task of classifying histopathological images. This configuration ensures a thorough and comprehensive assessment of the models, enabling the determination of the most effective architecture for classifying IDC in breast histopathology images.

The ResNet-50 model was trained for a total of 10 epochs, consistently showing a gain in accuracy and a reduction in loss during both the training and validation stages. The model attained a comprehensive accuracy rate of 91%. The non-cancerous forecasts had a precision of 0.93 and a recall of 0.94, while the malignant predictions had a precision of 0.85 and a recall of 0.81. The F1-scores for non-cancerous and malignant classifications were 0.94 and 0.83, respectively. These values demonstrate a balanced precision-recall tradeoff, which is crucial for accurate medical diagnosis.

In the same manner, the DenseNet-121 model underwent training for 10 epochs and attained an overall accuracy of 91%. The accuracy for identifying non-cancerous cases was 0.93, with a sensitivity of 0.95. On the other hand, the accuracy for identifying cancerous cases was 0.86, with a sensitivity of 0.81. The F1-scores for non-cancerous and malignant classifications were 0.94 and 0.83, respectively, indicating the model’s high accuracy in categorizing histopathological pictures.

The ResNeXt-50 model, trained for a duration of 20 epochs, also attained an overall accuracy rate of 91%. The non-cancerous predictions made by the model had a precision of 0.93 and a recall of 0.94, whereas the cancerous predictions had a precision of 0.85 and a recall of 0.82. The F1-scores achieved by this model were 0.94 for non-cancerous classifications and 0.84 for cancerous classifications, indicating its strong performance in classifying medical images.

The GoogLeNet (Inception v3) model, after being trained for 10 epochs, achieved an overall accuracy of 91%. The non-cancerous forecasts had a precision of 0.93 and a recall of 0.94, while the malignant predictions had a precision of 0.84 and a recall of 0.83. The F1-scores for non-cancerous and malignant classifications were 0.94 and 0.84, respectively, demonstrating a robust capacity to maintain a balance between precision and recall.

The EfficientNet model, after undergoing 10 epochs of training, attained the best level of accuracy among the CNN models, reaching 92%. The non-cancerous forecasts achieved a precision of 0.95 and a recall of 0.93, but the malignant predictions had a precision of 0.83 and a recall of 0.89. The F1-scores achieved were 0.94 for non-cancerous classifications and 0.86 for cancerous classifications, indicating that the model exhibited exceptional performance in the field of medical picture classification.

The MobileNetV2 model, trained for 10 epochs, attained a 90% accuracy rate. The benign forecasts exhibited a precision of 0.94 and a recall of 0.93, while the malignant predictions demonstrated a precision of 0.82 and a recall of 0.85. The F1-scores achieved were 0.93 for non-cancerous classifications and 0.83 for cancerous classifications, demonstrating the effectiveness of the system even with limited computational resources.

The SqueezeNet model, after undergoing 10 epochs of training, attained an overall accuracy rate of 88%. The non-cancerous forecasts had a precision of 0.95 and a recall of 0.88, but the cancerous predictions had a precision of 0.74 and a recall of 0.87. The F1-scores for non-cancerous and malignant classifications were 0.91 and 0.80, respectively, indicating its performance in a resource-limited setting.

The Vision Transformer (ViT) model demonstrated superior performance compared to other models. It was trained for 10 epochs and achieved an overall accuracy of 93%. The non-cancerous forecasts achieved a precision of 0.94 and a recall of 0.96, but the malignant predictions had a precision of 0.89 and a recall of 0.84. The F1-scores for the ViT model were 0.95 for non-cancerous classifications and 0.87 for malignant classifications, demonstrating its excellent capacity to successfully balance precision and recall.

The Vision Transformer (ViT) model showed improved performance in comparison to conventional CNN designs. ViT achieved a superior overall accuracy of 93%, surpassing other models that had accuracy rates ranging from 88% to 92%. The precision and recall values of ViT for non-cancerous (0.94 and 0.96, respectively) and malignant (0.89 and 0.84, respectively) predictions demonstrate a high degree of dependability in accurately distinguishing between the two classes. The F1-scores of 0.95 for non-cancerous and 0.87 for cancerous classifications highlight the strong ability of the system to properly handle both positive and negative samples.

EfficientNet, one of the CNN models, achieved the maximum accuracy of 92%, demonstrating excellent precision and recall metrics. Nevertheless, it did not quite match the level of performance demonstrated by the ViT model. ResNet, DenseNet, ResNeXt, and GoogLeNet all attained a 91% accuracy, showcasing their efficacy albeit with somewhat inferior precision and recall when compared to EfficientNet and ViT. MobileNetV2 and SqueezeNet, albeit computationally efficient, exhibited lower accuracy (90% and 88% respectively) and somewhat diminished performance metrics, rendering them less effective than the other models for this particular job.

The Vision Transformer (ViT) model is the most successful architecture for classifying invasive ductal carcinoma (IDC) in breast histopathology images. It achieves maximum accuracy and maintains a well-balanced precision, recall, and F1-score. The utilization of self-attention processes in capturing both global and local information inside images provides it with a distinct advantage over conventional CNN architectures.