TRENDNERT: A Benchmark for Trend and Downtrend Detection in a Scientific Domain
Abstract
Computational analysis and modeling of the evolution of trends is an important area of research in Natural Language Processing (NLP) because of its socio-economic impact. However, no large publicly available benchmark for trend detection currently exists, making a comparative evaluation of methods impossible. We remedy this situation by publishing the benchmark TRENDNERT, consisting of a set of gold trends and downtrends and document labels that is available as an unrestricted download, and a large underlying document collection that can also be obtained for free. We propose Mean Average Precision (MAP) as an evaluation measure for trend detection and apply this measure in an investigation of several baselines.
Cite
Text
Moiseeva and Schütze. "TRENDNERT: A Benchmark for Trend and Downtrend Detection in a Scientific Domain." AAAI Conference on Artificial Intelligence, 2020. doi:10.1609/AAAI.V34I05.6372Markdown
[Moiseeva and Schütze. "TRENDNERT: A Benchmark for Trend and Downtrend Detection in a Scientific Domain." AAAI Conference on Artificial Intelligence, 2020.](https://mlanthology.org/aaai/2020/moiseeva2020aaai-trendnert/) doi:10.1609/AAAI.V34I05.6372BibTeX
@inproceedings{moiseeva2020aaai-trendnert,
title = {{TRENDNERT: A Benchmark for Trend and Downtrend Detection in a Scientific Domain}},
author = {Moiseeva, Alena and Schütze, Hinrich},
booktitle = {AAAI Conference on Artificial Intelligence},
year = {2020},
pages = {8512-8519},
doi = {10.1609/AAAI.V34I05.6372},
url = {https://mlanthology.org/aaai/2020/moiseeva2020aaai-trendnert/}
}