Interpretable Network Visualizations: A Human-in-the-Loop Approach for Post-Hoc Explainability of CNN-Based Image Classification

Abstract

Spatio-temporal trajectories are crucial for data mining tasks, requiring versatile learning methods that can accurately extract movement patterns and travel purposes. While large language models (LLMs) have shown remarkable versatility through training on extensive datasets, and trajectories share similarities with natural language, standard LLMs cannot directly handle spatio-temporal features or extract trajectory-specific information. We propose TrajCogn, a model that effectively adapts LLMs for trajectory learning. TrajCogn incorporates a novel trajectory semantic embedder to process spatio-temporal features and extract movement patterns and travel purposes, along with a trajectory prompt that integrates this information into LLMs for various downstream tasks. Experiments on three real-world datasets and four representative tasks demonstrate TrajCogn's effectiveness.

Cite

Text

Bianchi et al. "Interpretable Network Visualizations: A Human-in-the-Loop Approach for Post-Hoc Explainability of CNN-Based Image Classification." International Joint Conference on Artificial Intelligence, 2024. doi:10.24963/ijcai.2024/411

Markdown

[Bianchi et al. "Interpretable Network Visualizations: A Human-in-the-Loop Approach for Post-Hoc Explainability of CNN-Based Image Classification." International Joint Conference on Artificial Intelligence, 2024.](https://mlanthology.org/ijcai/2024/bianchi2024ijcai-interpretable/) doi:10.24963/ijcai.2024/411

BibTeX

@inproceedings{bianchi2024ijcai-interpretable,
  title     = {{Interpretable Network Visualizations: A Human-in-the-Loop Approach for Post-Hoc Explainability of CNN-Based Image Classification}},
  author    = {Bianchi, Matteo and De Santis, Antonio and Tocchetti, Andrea and Brambilla, Marco},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year      = {2024},
  pages     = {3715-3723},
  doi       = {10.24963/ijcai.2024/411},
  url       = {https://mlanthology.org/ijcai/2024/bianchi2024ijcai-interpretable/}
}