Skip to content

Commit

Permalink
vr 004
Browse files Browse the repository at this point in the history
  • Loading branch information
pbiecek committed Jul 30, 2024
1 parent 60d7570 commit ac42e85
Show file tree
Hide file tree
Showing 2 changed files with 28 additions and 0 deletions.
28 changes: 28 additions & 0 deletions _publications/2024-01-13-Breast.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
---
title: "Validation report 004: Breast Cancer Detector Model"
collection: publications
permalink: /publication/2024-01-13-Breast
excerpt: "This study conducts a Red Teaming analysis on a CNN-based Breast Cancer Detector Model, using XAI techniques to assess its reliability and uncover vulnerabilities. The analysis found that while the model is generally robust, certain intricate vulnerabilities could be exposed through data augmentation and out-of-distribution samples. LIME and SHAP analyses highlighted important phenomena, emphasizing the need for high-quality input data to ensure model reliability in clinical applications."
date: 2024-01-13
venue: 'Explainable Machine Learning 2023/2024 course'
paperurl: 'https://modeloriented.github.io/CVE-AI/files/2023_Breast.pdf'
citation: 'Mikolaj Drzewiecki, Monika Michaluk. (2024). &quot;Red Teaming analysis of the Breast Cancer Detector Model.&quot; <i>Github: ModelOriented/CVE-AI</i>.'
tags:
- BreCaHAD
- Breast Histopathology Images
- LIME
- SHAP
---

This study conducts a Red Teaming analysis on the Breast Cancer Detector Model, a Convolutional Neural Network designed for predicting breast cancer from tissue scans. Using eXplainable Artificial Intelligence (XAI) techniques, we assess the model’s reliability, investigating influences from unintended artifacts and evaluating its generalization with out-of-distribution samples. Our aim is to uncover vulnerabilities and enhance the model’s robustness in clinical applications.

<hr/>

Performed analysis proved strength of the model. Various vulnerabilities we were able to find turned out to be very intricate, unlike to be revealed in day to day usage. We assess the uncertainty while classifying the sample as infected tissue, to be promising field to improve.

We can conclude that phenomena discovered during LIME and SHAP analysis are deeply connected to this problem. Also, we advise care in ensuring the quality of input data, as vulnerabilities involving data augmentation were exposed.

<hr/>

Link to original datasets: [Breast Histopathology Images](https://www.kaggle.com/datasets/paultimothymooney/breast-histopathology-images), [BreCaHAD](https://www.kaggle.com/datasets/truthisneverlinear/brecahad).

Binary file added files/2023_Breast.pdf
Binary file not shown.

0 comments on commit ac42e85

Please sign in to comment.