Refining Biologically Inconsistent Segmentation Masks with Masked Autoencoders
Abstract
Microscopy images often feature regions of low signal-to-noise ratio (SNR) which leads to a considerable amount of ambiguity in the correct corresponding segmentation. This ambiguity can introduce inconsistencies in the segmentation mask which violate known biological constraints. In this work, we present a methodology which identifies areas of low SNR and refines the segmentation masks such that they are consistent with biological structures. Low SNR regions with uncertain segmentation are detected using model ensembling and selectively restored by a masked autoencoder (MAE) which leverages information about well-imaged surrounding areas. The prior knowledge of biologically consistent segmentation masks is directly learned from the data.We validate our approach in the context of analysing intracellular structures, specifically by refining segmentation masks of mitochondria in expansion microscopy images with a global staining.
Cite
Text
Sauer et al. "Refining Biologically Inconsistent Segmentation Masks with Masked Autoencoders." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2024. doi:10.1109/CVPRW63382.2024.00684Markdown
[Sauer et al. "Refining Biologically Inconsistent Segmentation Masks with Masked Autoencoders." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2024.](https://mlanthology.org/cvprw/2024/sauer2024cvprw-refining/) doi:10.1109/CVPRW63382.2024.00684BibTeX
@inproceedings{sauer2024cvprw-refining,
title = {{Refining Biologically Inconsistent Segmentation Masks with Masked Autoencoders}},
author = {Sauer, Alexander and Tian, Yuan and Bewersdorf, Joerg and Rittscher, Jens},
booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
year = {2024},
pages = {6904-6912},
doi = {10.1109/CVPRW63382.2024.00684},
url = {https://mlanthology.org/cvprw/2024/sauer2024cvprw-refining/}
}