MOSER: Learning Sensory Policy for Task-Specific Viewpoint via View-Conditional World Model

Abstract

An important class of neuro-symbolic (NeSy) methods relies on knowledge compilation (KC) techniques to transform logical constraints into a differentiable exact arithmetic circuit (AC) that represents all models of a logical formula. However, given the complexity of KC, compiling such exact circuits can be infeasible. Previous works in such cases proposed to compile a circuit for a subset of models. In this work, we will show that gradients calculated on a subset of models can be very far from true gradients. We propose a new framework that calculates gradients based on compiling logical constraints partially in not only a lower-bound circuit but also an upper-bound circuit. We prove that from this pair of ACs, gradients that are within a bounded distance from true gradients can be calculated. Our experiments show that adding the upper-bound AC also helps the learning process in practice, allowing for similar or better generalisation than working solely with fully compiled ACs, even with less than 150 seconds of partial compilation.

Cite

Text

Wan et al. "MOSER: Learning Sensory Policy for Task-Specific Viewpoint via View-Conditional World Model." International Joint Conference on Artificial Intelligence, 2024. doi:10.24963/ijcai.2024/558

Markdown

[Wan et al. "MOSER: Learning Sensory Policy for Task-Specific Viewpoint via View-Conditional World Model." International Joint Conference on Artificial Intelligence, 2024.](https://mlanthology.org/ijcai/2024/wan2024ijcai-moser/) doi:10.24963/ijcai.2024/558

BibTeX

@inproceedings{wan2024ijcai-moser,
  title     = {{MOSER: Learning Sensory Policy for Task-Specific Viewpoint via View-Conditional World Model}},
  author    = {Wan, Shenghua and Sun, Hai-Hang and Gan, Le and Zhan, De-Chuan},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year      = {2024},
  pages     = {5046-5054},
  doi       = {10.24963/ijcai.2024/558},
  url       = {https://mlanthology.org/ijcai/2024/wan2024ijcai-moser/}
}