Representation and Induction of Finite State Machines Using Time-Delay Neural Networks

Abstract

This work investigates the representational and inductive capabili(cid:173) ties of time-delay neural networks (TDNNs) in general, and of two subclasses of TDNN, those with delays only on the inputs (IDNN), and those which include delays on hidden units (HDNN) . Both ar(cid:173) chitectures are capable of representing the same class of languages, the definite memory machine (DMM) languages, but the delays on the hidden units in the HDNN helps it outperform the IDNN on problems composed of repeated features over short time windows.

Cite

Text

Clouse et al. "Representation and Induction of Finite State Machines Using Time-Delay Neural Networks." Neural Information Processing Systems, 1996.

Markdown

[Clouse et al. "Representation and Induction of Finite State Machines Using Time-Delay Neural Networks." Neural Information Processing Systems, 1996.](https://mlanthology.org/neurips/1996/clouse1996neurips-representation/)

BibTeX

@inproceedings{clouse1996neurips-representation,
  title     = {{Representation and Induction of Finite State Machines Using Time-Delay Neural Networks}},
  author    = {Clouse, Daniel S. and Giles, C. Lee and Horne, Bill G. and Cottrell, Garrison W.},
  booktitle = {Neural Information Processing Systems},
  year      = {1996},
  pages     = {403-409},
  url       = {https://mlanthology.org/neurips/1996/clouse1996neurips-representation/}
}