Publikationen

Information mismatch in PHH3-assisted mitosis annotation leads to interpretation shifts in H&E slide analysis

Ganz, J., Marzahl, C., Ammeling, J., Rosbach, E., Richter, B., Puget, C., … Aubreville, M. (2024). Information mismatch in PHH3-assisted mitosis annotation leads to interpretation shifts in H&E slide analysis. Scientific Reports, 14, 26273. http://doi.org/10.1038/s41598-024-77244-6

Abstract

Abstract The count of mitotic figures (MFs) observed in hematoxylin and eosin (H&E)-stained slides is an important prognostic marker, as it is a measure for tumor cell proliferation. However, the identification of MFs has a known low inter-rater agreement. In a computer-aided setting, deep learning algorithms can help to mitigate this, but they require large amounts of annotated data for training and validation. Furthermore, label noise introduced during the annotation process may impede the algorithms’ performance. Unlike H&E, where identification of MFs is based mainly on morphological features, the mitosis-specific antibody phospho-histone H3 (PHH3) specifically highlights MFs. Counting MFs on slides stained against PHH3 leads to higher agreement among raters and has therefore recently been used as a ground truth for the annotation of MFs in H&E. However, as PHH3 facilitates the recognition of cells indistinguishable from H&E staining alone, the use of this ground truth could potentially introduce an interpretation shift and even label noise into the H&E-related dataset, impacting model performance. This study analyzes the impact of PHH3-assisted MF annotation on inter-rater reliability and object level agreement through an extensive multi-rater experiment. Subsequently, MF detectors, including a novel dual-stain detector, were evaluated on the resulting datasets to investigate the influence of PHH3-assisted labeling on the models’ performance. We found that the annotators’ object-level agreement significantly increased when using PHH3-assisted labeling (F1: 0.53 to 0.74). However, this enhancement in label consistency did not translate to improved performance for H&E-based detectors, neither during the training phase nor the evaluation phase. Conversely, the dual-stain detector was able to benefit from the higher consistency. This reveals an information mismatch between the H&E and PHH3-stained images as the cause of this effect, which renders PHH3-assisted annotations not well-aligned for use with H&E-based detectors. Based on our findings, we propose an improved PHH3-assisted labeling procedure.
- Suche auf Google Scholar
- DOI Verweis
Exportformate
Weiterführende Links
- Personenseiten
  
  Aubreville, Marc
- Forschungsprojekt
  
  Robust and Accurate Multi-Tumor, Multi-Species, Multi-Laboratory and Multi-Scanner Mitosis Detection with Large-Scale Datasets and Artificial Intelligence
- Abteilung/Einrichtung
  
  FLAIR - Flensburg Artificial Intelligence Research
  
  CIVU – Center for Interaction, Visualization and Usability
- Profilbereich
  
  Informatik und Gestaltung
- Forschungsfeld
  
  Human-Computer-Interaction
  
  Data Science und Künstliche Intelligenz
- Fachbereich
  
  Fachbereich 3: Information und Kommunikation
Filter Tags
An Interdisciplinary Perspective on AI-Supported Decision Making in Medicine

Ammeling, J., Aubreville, M., Fritz, A., Kießig, A., Krügel, S., & Uhl, M. (2024). An Interdisciplinary Perspective on AI-Supported Decision Making in Medicine. Technology in Society, 102791.
- Suche auf Google Scholar
Exportformate
Weiterführende Links
- Personenseiten
  
  Aubreville, Marc
- Forschungsprojekt
  
  Robust and Accurate Multi-Tumor, Multi-Species, Multi-Laboratory and Multi-Scanner Mitosis Detection with Large-Scale Datasets and Artificial Intelligence
- Abteilung/Einrichtung
  
  FLAIR - Flensburg Artificial Intelligence Research
  
  CIVU – Center for Interaction, Visualization and Usability
- Profilbereich
  
  Informatik und Gestaltung
- Forschungsfeld
  
  Data Science und Künstliche Intelligenz
- Fachbereich
  
  Fachbereich 3: Information und Kommunikation
Filter Tags
Data-Driven Analysis of Physical and Mental Rotation Strategies

Wetzel, S., & Bertel, S. (2024). Data-Driven Analysis of Physical and Mental Rotation Strategies. CogSci 2025 conference. Rotterdam: Cognitive Science Society.

Abstract

Studying physical rotation (i.e., rotation tasks during which figures can be physically rotated, such as through gestures) can offer insights also into problem solving processes at work during mental rotation. We present a novel method for behavioral pattern analysis which we applied to data from 2,999 physical rotation tasks gathered in-class from 50 secondary school students. The method uses normalized, resampled, time-dependent data on angular offsets between figures over time and agglomerative, correlation-based clustering. Each cluster represents a distinct behavioral pattern and its respective prototype a problem solving strategy. Results indicate that multiple strategies were employed: The dominant strategy matches the classical model of mental rotation, in which angular offsets between figures are decreased over time. For the secondary strategy, angular offsets were actually increased. A subsequent analysis shows that the secondary strategy was more frequently used for symmetric figures, possibly indicating problems with correctly matching segments across figures.
- Suche auf Google Scholar
Exportformate
Weiterführende Links
- Personenseiten
  
  Bertel, Sven
- Forschungsprojekt
  
  Kompetenzen für eine digitale Welt: partizipative Entwicklung von Apps zum Training räumlicher Fähigkeiten im Unterricht
- Abteilung/Einrichtung
  
  CIVU – Center for Interaction, Visualization and Usability
- Profilbereich
  
  Informatik und Gestaltung
- Forschungsfeld
  
  Human-Computer-Interaction
- Fachbereich
  
  Fachbereich 3: Information und Kommunikation
Filter Tags
Training for Ultrasound Imaging: An Evaluation of SonoGame

Gürgan, S., Henze, V., Gall, C., Schoenfisch, B., Brucker, S., Hahn, M., … Teistler, M. (2024). Training for Ultrasound Imaging: An Evaluation of SonoGame. ACM Symposium on Spatial User Interaction (SUI 2024). Trier, Germany: ACM, New York. http://doi.org/10.1145/3677386.3688880
- Suche auf Google Scholar
- DOI Verweis
Exportformate
Weiterführende Links
- Personenseiten
  
  Bertel, Sven
  
  Teistler, Michael
- Abteilung/Einrichtung
  
  CIVU – Center for Interaction, Visualization and Usability
- Profilbereich
  
  Informatik und Gestaltung
- Forschungsfeld
  
  Human-Computer-Interaction
- Fachbereich
  
  Fachbereich 3: Information und Kommunikation
Filter Tags
Problem Solving Strategies in Physical and Mental Rotation

Wetzel, S., & Bertel, S. (2024). Problem Solving Strategies in Physical and Mental Rotation. Spatial Cognition Conference 2024. Dublin.
- Suche auf Google Scholar
Exportformate
Weiterführende Links
- Personenseiten
  
  Bertel, Sven
- Forschungsprojekt
  
  Kompetenzen für eine digitale Welt: partizipative Entwicklung von Apps zum Training räumlicher Fähigkeiten im Unterricht
- Abteilung/Einrichtung
  
  CIVU – Center for Interaction, Visualization and Usability
- Profilbereich
  
  Informatik und Gestaltung
- Forschungsfeld
  
  Human-Computer-Interaction
- Fachbereich
  
  Fachbereich 3: Information und Kommunikation
Filter Tags
Information mismatch in PHH3-assisted mitosis annotation leads to interpretation shifts in H&E slide analysis

Ganz, J., Marzahl, C., Ammeling, J., Rosbach, E., Richter, B., Puget, C., … Aubreville, M. (2024). Information mismatch in PHH3-assisted mitosis annotation leads to interpretation shifts in H&E slide analysis. Scientific Reports, 14, 26273. http://doi.org/10.1038/s41598-024-77244-6

Abstract

Abstract The count of mitotic figures (MFs) observed in hematoxylin and eosin (H&E)-stained slides is an important prognostic marker, as it is a measure for tumor cell proliferation. However, the identification of MFs has a known low inter-rater agreement. In a computer-aided setting, deep learning algorithms can help to mitigate this, but they require large amounts of annotated data for training and validation. Furthermore, label noise introduced during the annotation process may impede the algorithms’ performance. Unlike H&E, where identification of MFs is based mainly on morphological features, the mitosis-specific antibody phospho-histone H3 (PHH3) specifically highlights MFs. Counting MFs on slides stained against PHH3 leads to higher agreement among raters and has therefore recently been used as a ground truth for the annotation of MFs in H&E. However, as PHH3 facilitates the recognition of cells indistinguishable from H&E staining alone, the use of this ground truth could potentially introduce an interpretation shift and even label noise into the H&E-related dataset, impacting model performance. This study analyzes the impact of PHH3-assisted MF annotation on inter-rater reliability and object level agreement through an extensive multi-rater experiment. Subsequently, MF detectors, including a novel dual-stain detector, were evaluated on the resulting datasets to investigate the influence of PHH3-assisted labeling on the models’ performance. We found that the annotators’ object-level agreement significantly increased when using PHH3-assisted labeling (F1: 0.53 to 0.74). However, this enhancement in label consistency did not translate to improved performance for H&E-based detectors, neither during the training phase nor the evaluation phase. Conversely, the dual-stain detector was able to benefit from the higher consistency. This reveals an information mismatch between the H&E and PHH3-stained images as the cause of this effect, which renders PHH3-assisted annotations not well-aligned for use with H&E-based detectors. Based on our findings, we propose an improved PHH3-assisted labeling procedure.
- Suche auf Google Scholar
- DOI Verweis
Exportformate
Weiterführende Links
- Personenseiten
  
  Aubreville, Marc
- Forschungsprojekt
  
  Robust and Accurate Multi-Tumor, Multi-Species, Multi-Laboratory and Multi-Scanner Mitosis Detection with Large-Scale Datasets and Artificial Intelligence
- Abteilung/Einrichtung
  
  FLAIR - Flensburg Artificial Intelligence Research
  
  CIVU – Center for Interaction, Visualization and Usability
- Profilbereich
  
  Informatik und Gestaltung
- Forschungsfeld
  
  Human-Computer-Interaction
  
  Data Science und Künstliche Intelligenz
- Fachbereich
  
  Fachbereich 3: Information und Kommunikation
Filter Tags
SonoGame

Gürgan, S., Bertel, S., Gall, C., Henze, V., Mayer, L., Seller, A., … Hahn, M. (2023). SonoGame. Ultraschall Med, 44(S 01). http://doi.org/https://doi.org/10.1055/s-0043-1772423
- Suche auf Google Scholar
- DOI Verweis
Exportformate
Weiterführende Links
- Personenseiten
  
  Bertel, Sven
  
  Teistler, Michael
- Forschungsprojekt
  
  Entwicklung und praktischer Einsatz virtueller und spielbasierter Lernsysteme in der medizinischen Bildgebung
- Abteilung/Einrichtung
  
  CIVU – Center for Interaction, Visualization and Usability
- Profilbereich
  
  Informatik und Gestaltung
- Forschungsfeld
  
  Digitalisierung im Gesundheitswesen
  
  Human-Computer-Interaction
- Fachbereich
  
  Fachbereich 3: Information und Kommunikation
Filter Tags
SonoGame

Gürgan, S., Bertel, S., Gall, C., Henze, V., Mayer, L., Seller, A., … Hahn, M. (2023). SonoGame. Ultraschall Med, 44(S 01). http://doi.org/https://doi.org/10.1055/s-0043-1772423
- Suche auf Google Scholar
- DOI Verweis
Exportformate
Weiterführende Links
- Personenseiten
  
  Bertel, Sven
  
  Teistler, Michael
- Forschungsprojekt
  
  Entwicklung und praktischer Einsatz virtueller und spielbasierter Lernsysteme in der medizinischen Bildgebung
- Abteilung/Einrichtung
  
  CIVU – Center for Interaction, Visualization and Usability
- Profilbereich
  
  Informatik und Gestaltung
- Forschungsfeld
  
  Digitalisierung im Gesundheitswesen
  
  Human-Computer-Interaction
- Fachbereich
  
  Fachbereich 3: Information und Kommunikation
Filter Tags
Gallery Walk in Virtual Reality – immersive Einblicke in VR-Projekte der medizinischen Ausbildung

Willemer, M.-C., Klus, C., Teistler, M., Flägel, K., Junga, A., Schulze, H., … Speidel, R. (2023). Gallery Walk in Virtual Reality – immersive Einblicke in VR-Projekte der medizinischen Ausbildung . Jahrestagung der Gesellschaft für Medizinische Ausbildung (GMA). http://doi.org/https://dx.doi.org/10.3205/23gma294 (Original work published Oktober 2023)
- Suche auf Google Scholar
- DOI Verweis
Exportformate
Weiterführende Links
- Personenseiten
  
  Teistler, Michael
- Forschungsprojekt
  
  Entwicklung und praktischer Einsatz virtueller und spielbasierter Lernsysteme in der medizinischen Bildgebung
- Abteilung/Einrichtung
  
  CIVU – Center for Interaction, Visualization and Usability
- Profilbereich
  
  Informatik und Gestaltung
- Forschungsfeld
  
  Digitalisierung im Gesundheitswesen
  
  Human-Computer-Interaction
- Fachbereich
  
  Fachbereich 3: Information und Kommunikation
Filter Tags
Gallery Walk in Virtual Reality – immersive Einblicke in VR-Projekte der medizinischen Ausbildung

Willemer, M.-C., Klus, C., Teistler, M., Flägel, K., Junga, A., Schulze, H., … Speidel, R. (2023). Gallery Walk in Virtual Reality – immersive Einblicke in VR-Projekte der medizinischen Ausbildung . Jahrestagung der Gesellschaft für Medizinische Ausbildung (GMA). http://doi.org/https://dx.doi.org/10.3205/23gma294 (Original work published Oktober 2023)
- Suche auf Google Scholar
- DOI Verweis
Exportformate
Weiterführende Links
- Personenseiten
  
  Teistler, Michael
- Forschungsprojekt
  
  Entwicklung und praktischer Einsatz virtueller und spielbasierter Lernsysteme in der medizinischen Bildgebung
- Abteilung/Einrichtung
  
  CIVU – Center for Interaction, Visualization and Usability
- Profilbereich
  
  Informatik und Gestaltung
- Forschungsfeld
  
  Digitalisierung im Gesundheitswesen
  
  Human-Computer-Interaction
- Fachbereich
  
  Fachbereich 3: Information und Kommunikation
Filter Tags

Publikationen

Abstract

Exportformate

Weiterführende Links

Filter Tags

Exportformate

Weiterführende Links

Filter Tags

Abstract

Exportformate

Weiterführende Links

Filter Tags

Exportformate

Weiterführende Links

Filter Tags

Exportformate

Weiterführende Links

Filter Tags

Abstract

Exportformate

Weiterführende Links

Filter Tags

Exportformate

Weiterführende Links

Filter Tags

Exportformate

Weiterführende Links

Filter Tags

Exportformate

Weiterführende Links

Filter Tags

Exportformate

Weiterführende Links

Filter Tags