Fernandez, Roland

7 publications

JAIR 2025 Mechanisms of Symbol Processing for In-Context Learning in Transformer Networks Paul Smolensky, Roland Fernandez, Zhenghao Herbert Zhou, Mattia Opper, Adam Davies, Jianfeng Gao
TMLR 2025 TRA: Better Length Generalisation with Threshold Relative Attention Mattia Opper, Roland Fernandez, Paul Smolensky, Jianfeng Gao
NeurIPS 2024 Compositional Generalization Across Distributional Shifts with Sparse Tree Operations Paul Soulos, Henry Conklin, Mattia Opper, Paul Smolensky, Jianfeng Gao, Roland Fernandez
NeurIPSW 2024 Compositional Generalization Across Distributional Shifts with Sparse Tree Operations Paul Soulos, Henry Conklin, Mattia Opper, Paul Smolensky, Jianfeng Gao, Roland Fernandez
ICML 2023 Differentiable Tree Operations Promote Compositional Generalization Paul Soulos, Edward J Hu, Kate Mccurdy, Yunmo Chen, Roland Fernandez, Paul Smolensky, Jianfeng Gao
ICMLW 2023 Differentiable Tree Operations Promote Compositional Generalization Paul Soulos, Edward J Hu, Kate McCurdy, Yunmo Chen, Roland Fernandez, Paul Smolensky, Jianfeng Gao
ICML 2020 Working Memory Graphs Ricky Loynd, Roland Fernandez, Asli Celikyilmaz, Adith Swaminathan, Matthew Hausknecht