Melo, Francisco S.

18 publications

ICLR 2026 Solving General-Utility Markov Decision Processes in the Single-Trial Regime with Online Planning Pedro Pinto Santos, Alberto Sardinha, Francisco S. Melo

TMLR 2025 Multi-Bellman Operator for Convergence of $q$-Learning with Linear Function Approximation Diogo S. Carvalho, Pedro A. Santos, Francisco S. Melo

ICML 2025 The Number of Trials Matters in Infinite-Horizon General-Utility Markov Decision Processes Pedro Pinto Santos, Alberto Sardinha, Francisco S. Melo

NeurIPS 2024 NeuralSolver: Learning Algorithms for Consistent and Efficient Extrapolation Across General Tasks Bernardo Esteves, Miguel Vasco, Francisco S. Melo

AAAI 2024 TEAMSTER: Model-Based Reinforcement Learning for Ad Hoc Teamwork (Abstract Reprint) João G. Ribeiro, Gonçalo Rodrigues, Alberto Sardinha, Francisco S. Melo

MLJ 2024 The Impact of Data Distribution on Q-Learning with Function Approximation Pedro P. Santos, Diogo S. Carvalho, Alberto Sardinha, Francisco S. Melo

JAIR 2022 Cooperation and Learning Dynamics Under Wealth Inequality and Diversity in Individual Risk Ramona Merhej, Fernando P. Santos, Francisco S. Melo, Francisco C. Santos

ICML 2022 Geometric Multimodal Contrastive Representation Learning Petra Poklukar, Miguel Vasco, Hang Yin, Francisco S. Melo, Ana Paiva, Danica Kragic

NeurIPS 2020 A New Convergent Variant of Q-Learning with Linear Function Approximation Diogo Carvalho, Francisco S. Melo, Pedro Santos

IJCAI 2018 Interactive Optimal Teaching with Unknown Learners Francisco S. Melo, Carla Guerra, Manuel Lopes

AAAI 2017 Associate Latent Encodings in Learning from Demonstrations Hang Yin, Francisco S. Melo, Aude Billard, Ana Paiva

IJCAI 2016 Synthesizing Robotic Handwriting Motion by Learning from Human Demonstrations Hang Yin, Patrícia Alves-Oliveira, Francisco S. Melo, Aude Billard, Ana Paiva

AAAI 2011 Differential Eligibility Vectors for Advantage Updating and Gradient Methods Francisco S. Melo

ECML-PKDD 2010 Learning from Demonstration Using MDP Induced Metrics Francisco S. Melo, Manuel Lopes

ECML-PKDD 2009 Active Learning for Reward Estimation in Inverse Reinforcement Learning Manuel Lopes, Francisco S. Melo, Luis Montesano

ICML 2008 An Analysis of Reinforcement Learning with Function Approximation Francisco S. Melo, Sean P. Meyn, M. Isabel Ribeiro

ECML-PKDD 2008 Fitted Natural Actor-Critic: A New Algorithm for Continuous State-Action MDPs Francisco S. Melo, Manuel Lopes

COLT 2007 Q -Learning with Linear Function Approximation Francisco S. Melo, M. Isabel Ribeiro