Unveiling the Potential of Text in High-Dimensional Time Series Forecasting

Abstract

Time series forecasting has traditionally focused on univariate and multivariate numerical data, often overlooking the benefits of incorporating multimodal information, particularly textual data. In this paper, we propose a novel framework that integrates time series models with Large Language Models to improve high-dimensional time series forecasting. Inspired by multimodal models, our method combines time series and textual data in the dual-tower structure. This fusion of information creates a comprehensive representation, which is then processed through a linear layer to generate the final forecast. Extensive experiments demonstrate that incorporating text enhances high-dimensional time series forecasting performance. This work paves the way for further research in multimodal time series forecasting.

Cite

Text

Zhou et al. "Unveiling the Potential of Text in High-Dimensional Time Series Forecasting." NeurIPS 2024 Workshops: TSALM, 2024.

Markdown

[Zhou et al. "Unveiling the Potential of Text in High-Dimensional Time Series Forecasting." NeurIPS 2024 Workshops: TSALM, 2024.](https://mlanthology.org/neuripsw/2024/zhou2024neuripsw-unveiling/)

BibTeX

@inproceedings{zhou2024neuripsw-unveiling,
  title     = {{Unveiling the Potential of Text in High-Dimensional Time Series Forecasting}},
  author    = {Zhou, Xin and Wang, Weiqing and Qu, Shilin and Zhang, Zhiqiang and Bergmeir, Christoph},
  booktitle = {NeurIPS 2024 Workshops: TSALM},
  year      = {2024},
  url       = {https://mlanthology.org/neuripsw/2024/zhou2024neuripsw-unveiling/}
}