Automatic Evaluation of Text Coherence: Models and Representations
Abstract
This paper investigates the automatic evaluation of text coherence for machine-generated texts. We introduce a fully-automatic, linguistically rich model of local coherence that correlates with human judgments. Our modeling approach relies on shallow text properties and is relatively inexpensive. We present experimental results that assess the predictive power of various discourse representations proposed in the linguistic literature. Our results demonstrate that certain models capture complementary aspects of coherence and thus can be combined to improve performance. 1
Cite
Text
Lapata and Barzilay. "Automatic Evaluation of Text Coherence: Models and Representations." International Joint Conference on Artificial Intelligence, 2005.Markdown
[Lapata and Barzilay. "Automatic Evaluation of Text Coherence: Models and Representations." International Joint Conference on Artificial Intelligence, 2005.](https://mlanthology.org/ijcai/2005/lapata2005ijcai-automatic/)BibTeX
@inproceedings{lapata2005ijcai-automatic,
title = {{Automatic Evaluation of Text Coherence: Models and Representations}},
author = {Lapata, Mirella and Barzilay, Regina},
booktitle = {International Joint Conference on Artificial Intelligence},
year = {2005},
pages = {1085-1090},
url = {https://mlanthology.org/ijcai/2005/lapata2005ijcai-automatic/}
}