Classification of Freshwater Snails of the Genus Radomaniola with Multimodal Triplet Networks
Abstract
In this paper, we present our first proposal of a machine learning system for the classification of freshwater snails of the genus Radomaniola. We elaborate on the specific challenges encountered during system design, and how we tackled them; namely a small, very imbalanced dataset with a high number of classes and high visual similarity between classes. We then show how we employed triplet networks and the multiple input modalities of images, measurements, and genetic information to overcome these challenges and reach a performance comparable to that of a trained domain expert.
Cite
Text
Vetter et al. "Classification of Freshwater Snails of the Genus Radomaniola with Multimodal Triplet Networks." ICML 2024 Workshops: AI4Science, 2024.Markdown
[Vetter et al. "Classification of Freshwater Snails of the Genus Radomaniola with Multimodal Triplet Networks." ICML 2024 Workshops: AI4Science, 2024.](https://mlanthology.org/icmlw/2024/vetter2024icmlw-classification/)BibTeX
@inproceedings{vetter2024icmlw-classification,
title = {{Classification of Freshwater Snails of the Genus Radomaniola with Multimodal Triplet Networks}},
author = {Vetter, Dennis and Ahsan, Muhammad and Delicado, Diana and Neubauer, Thomas A. and Wilke, Thomas and Roig, Gemma},
booktitle = {ICML 2024 Workshops: AI4Science},
year = {2024},
url = {https://mlanthology.org/icmlw/2024/vetter2024icmlw-classification/}
}