Leverage the Explainability of Transformer Models to Improve the DNA 5-Methylcytosine Identification (Student Abstract)
Abstract
DNA methylation is an epigenetic mechanism for regulating gene expression, and it plays an important role in many biological processes. While methylation sites can be identified using laboratory techniques, much work is being done on developing computational approaches using machine learning. Here, we present a deep-learning algorithm for determining the 5-methylcytosine status of a DNA sequence. We propose an ensemble framework that treats the self-attention score as an explicit feature that is added to the encoder layer generated by fine-tuned language models. We evaluate the performance of the model under different data distribution scenarios.
Cite
Text
Zeng and Huson. "Leverage the Explainability of Transformer Models to Improve the DNA 5-Methylcytosine Identification (Student Abstract)." AAAI Conference on Artificial Intelligence, 2024. doi:10.1609/AAAI.V38I21.30533Markdown
[Zeng and Huson. "Leverage the Explainability of Transformer Models to Improve the DNA 5-Methylcytosine Identification (Student Abstract)." AAAI Conference on Artificial Intelligence, 2024.](https://mlanthology.org/aaai/2024/zeng2024aaai-leverage/) doi:10.1609/AAAI.V38I21.30533BibTeX
@inproceedings{zeng2024aaai-leverage,
title = {{Leverage the Explainability of Transformer Models to Improve the DNA 5-Methylcytosine Identification (Student Abstract)}},
author = {Zeng, Wenhuan and Huson, Daniel H.},
booktitle = {AAAI Conference on Artificial Intelligence},
year = {2024},
pages = {23703-23704},
doi = {10.1609/AAAI.V38I21.30533},
url = {https://mlanthology.org/aaai/2024/zeng2024aaai-leverage/}
}