Kira, Zsolt

72 publications

ICLR 2026 Let's Think in Two Steps: Mitigating Agreement Bias in MLLMs with Self-Grounded Verification Moises Andrade, Joonhyuk Cha, Brandon Ho, Vriksha Srihari, Karmesh Yadav, Zsolt Kira

ICLR 2025 Contextual Self-Paced Learning for Weakly Supervised Spatio-Temporal Video Grounding Akash Kumar, Zsolt Kira, Yogesh S Rawat

ICLR 2025 Directional Gradient Projection for Robust Fine-Tuning of Foundation Models Chengyue Huang, Junjiao Tian, Brisa Maneechotesuwan, Shivang Chopra, Zsolt Kira

ICCV 2025 EmbodiedSplat: Personalized Real-to-Sim-to-Real Navigation with Gaussian Splats from a Mobile Device Gunjan Chhablani, Xiaomeng Ye, Muhammad Zubair Irshad, Zsolt Kira

CVPR 2025 FRAMES-VQA: Benchmarking Fine-Tuning Robustness Across Multi-Modal Shifts in Visual Question Answering Chengyue Huang, Brisa Maneechotesuwan, Shivang Chopra, Zsolt Kira

CVPR 2025 From Multimodal LLMs to Generalist Embodied Agents: Methods and Lessons Andrew Szot, Bogdan Mazoure, Omar Attia, Aleksei Timofeev, Harsh Agrawal, Devon Hjelm, Zhe Gan, Zsolt Kira, Alexander Toshev

NeurIPS 2025 Memo: Training Memory-Efficient Embodied Agents with Reinforcement Learning Gunshi Gupta, Karmesh Yadav, Zsolt Kira, Yarin Gal, Rahaf Aljundi

IJCAI 2025 RenderBender: A Survey on Adversarial Attacks Using Differentiable Rendering Matthew Hull, Haoran Wang, Matthew Lau, Alec Helbling, Mansi Phute, Chao Zhang, Zsolt Kira, Willian T. Lunardi, Martin Andreoni, Wenke Lee, Duen Horng Chau

CVPR 2025 When Domain Generalization Meets Generalized Category Discovery: An Adaptive Task-Arithmetic Driven Approach Vaibhav Rathore, Shubhranil B, Saikat Dutta, Sarthak Mehrotra, Zsolt Kira, Biplab Banerjee

CVPRW 2024 Adaptive Memory Replay for Continual Learning James Seale Smith, Lazar Valkov, Shaunak Halbe, Vyshnavi Gutta, Rogério Feris, Zsolt Kira, Leonid Karlinsky

TMLR 2024 Continual Adaptation of Vision Transformers for Federated Learning Shaunak Halbe, James Seale Smith, Junjiao Tian, Zsolt Kira

CVPRW 2024 Continual Diffusion with STAMINA: STack-and-Mask INcremental Adapters James Seale Smith, Yen-Chang Hsu, Zsolt Kira, Yilin Shen, Hongxia Jin

TMLR 2024 Continual Diffusion: Continual Customization of Text-to-Image Diffusion with C-LoRA James Seale Smith, Yen-Chang Hsu, Lingyu Zhang, Ting Hua, Zsolt Kira, Yilin Shen, Hongxia Jin

CVPR 2024 Diffuse Attend and Segment: Unsupervised Zero-Shot Segmentation Using Stable Diffusion Junjiao Tian, Lavisha Aggarwal, Andrea Colaco, Zsolt Kira, Mar Gonzalez-Franco

CVPR 2024 GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigation Mukul Khanna, Ram Ramrakhya, Gunjan Chhablani, Sriram Yenamandra, Theophile Gervet, Matthew Chang, Zsolt Kira, Devendra Singh Chaplot, Dhruv Batra, Roozbeh Mottaghi

NeurIPS 2024 Grounding Multimodal Large Language Models in Actions Andrew Szot, Bogdan Mazoure, Harsh Agrawal, Devon Hjelm, Zsolt Kira, Alexander Toshev

ICLR 2024 Habitat 3.0: A Co-Habitat for Humans, Avatars, and Robots Xavier Puig, Eric Undersander, Andrew Szot, Mikael Dallaire Cote, Tsung-Yen Yang, Ruslan Partsey, Ruta Desai, Alexander Clegg, Michal Hlavac, So Yeon Min, Vladimír Vondruš, Theophile Gervet, Vincent-Pierre Berges, John M Turner, Oleksandr Maksymets, Zsolt Kira, Mrinal Kalakrishnan, Jitendra Malik, Devendra Singh Chaplot, Unnat Jain, Dhruv Batra, Akshara Rai, Roozbeh Mottaghi

WACV 2024 LatentDR: Improving Model Generalization Through Sample-Aware Latent Degradation and Restoration Ran Liu, Sahil Khose, Jingyun Xiao, Lakshmi Sathidevi, Keerthan Ramnath, Zsolt Kira, Eva L. Dyer

WACV 2024 Missing Modality Robustness in Semi-Supervised Multi-Modal Semantic Segmentation Harsh Maheshwari, Yen-Cheng Liu, Zsolt Kira

ECCV 2024 NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields Muhammad Zubair Irshad, Sergey Zakharov, Vitor Guizilini, Adrien Gaidon, Zsolt Kira, Rares Ambrus

NeurIPS 2024 Pre-Trained Text-to-Image Diffusion Models Are Versatile Representation Learners for Control Gunshi Gupta, Karmesh Yadav, Yarin Gal, Zsolt Kira, Dhruv Batra, Cong Lu, Tim G. J. Rudner

ICLRW 2024 Pre-Trained Text-to-Image Diffusion Models Are Versatile Representation Learners for Control Gunshi Gupta, Karmesh Yadav, Yarin Gal, Dhruv Batra, Zsolt Kira, Cong Lu, Tim G. J. Rudner

ECCV 2024 Reinforcement Learning via Auxillary Task Distillation Abhinav N Harish, Larry Heck, Josiah P Hanna, Zsolt Kira, Andrew Szot

NeurIPS 2024 Rethinking Weight Decay for Robust Fine-Tuning of Foundation Models Junjiao Tian, Chengyue Huang, Zsolt Kira

CVPR 2024 Seeing the Unseen: Visual Common Sense for Semantic Placement Ram Ramrakhya, Aniruddha Kembhavi, Dhruv Batra, Zsolt Kira, Kuo-Hao Zeng, Luca Weihs

CVPRW 2023 A Closer Look at Rehearsal-Free Continual Learning James Seale Smith, Junjiao Tian, Shaunak Halbe, Yen-Chang Hsu, Zsolt Kira

ICML 2023 Adaptive Coordination in Social Embodied Rearrangement Andrew Szot, Unnat Jain, Dhruv Batra, Zsolt Kira, Ruta Desai, Akshara Rai

ICLR 2023 BC-IRL: Learning Generalizable Reward Functions from Demonstrations Andrew Szot, Amy Zhang, Dhruv Batra, Zsolt Kira, Franziska Meier

CVPR 2023 CODA-Prompt: COntinual Decomposed Attention-Based Prompting for Rehearsal-Free Continual Learning James Seale Smith, Leonid Karlinsky, Vyshnavi Gutta, Paola Cascante-Bonilla, Donghyun Kim, Assaf Arbelle, Rameswar Panda, Rogerio Feris, Zsolt Kira

CVPR 2023 ConStruct-VL: Data-Free Continual Structured VL Concepts Learning James Seale Smith, Paola Cascante-Bonilla, Assaf Arbelle, Donghyun Kim, Rameswar Panda, David Cox, Diyi Yang, Zsolt Kira, Rogerio Feris, Leonid Karlinsky

NeurIPS 2023 DAMEX: Dataset-Aware Mixture-of-Experts for Visual Understanding of Mixture-of-Datasets Yash Jain, Harkirat Behl, Zsolt Kira, Vibhav Vineet

NeurIPS 2023 Fast Trainable Projection for Robust Fine-Tuning Junjiao Tian, Yen-Cheng Liu, James S Smith, Zsolt Kira

CVPR 2023 HAAV: Hierarchical Aggregation of Augmented Views for Image Captioning Chia-Wen Kuo, Zsolt Kira

NeurIPSW 2023 HePCo: Data-Free Heterogeneous Prompt Consolidation for Continual Federated Learning Shaunak Halbe, James Seale Smith, Junjiao Tian, Zsolt Kira

NeurIPSW 2023 HePCo: Data-Free Heterogeneous Prompt Consolidation for Continual Federated Learning Shaunak Halbe, James Seale Smith, Junjiao Tian, Zsolt Kira

NeurIPSW 2023 HePCo: Data-Free Heterogeneous Prompt Consolidation for Continual Federated Learning Shaunak Halbe, James Smith, Junjiao Tian, Zsolt Kira

CoRL 2023 HomeRobot: Open-Vocabulary Mobile Manipulation Sriram Yenamandra, Arun Ramachandran, Karmesh Yadav, Austin S. Wang, Mukul Khanna, Theophile Gervet, Tsung-Yen Yang, Vidhi Jain, Alexander Clegg, John M. Turner, Zsolt Kira, Manolis Savva, Angel X. Chang, Devendra Singh Chaplot, Dhruv Batra, Roozbeh Mottaghi, Yonatan Bisk, Chris Paxton

NeurIPSW 2023 HomeRobot: Open-Vocabulary Mobile Manipulation Sriram Yenamandra, Arun Ramachandran, Karmesh Yadav, Austin S Wang, Mukul Khanna, Theophile Gervet, Tsung-Yen Yang, Vidhi Jain, Alexander Clegg, John M Turner, Zsolt Kira, Manolis Savva, Angel X Chang, Devendra Singh Chaplot, Dhruv Batra, Roozbeh Mottaghi, Yonatan Bisk, Chris Paxton

NeurIPSW 2023 Memory in Plain Sight: A Survey of the Uncanny Resemblances Between Diffusion Models and Associative Memories Benjamin Hoover, Hendrik Strobelt, Dmitry Krotov, Judy Hoffman, Zsolt Kira, Duen Horng Chau

ICCV 2023 NeO 360: Neural Fields for Sparse View Synthesis of Outdoor Scenes Muhammad Zubair Irshad, Sergey Zakharov, Katherine Liu, Vitor Guizilini, Thomas Kollar, Adrien Gaidon, Zsolt Kira, Rares Ambrus

WACV 2023 Structure-Encoding Auxiliary Tasks for Improved Visual Representation in Vision-and-Language Navigation Chia-Wen Kuo, Chih-Yao Ma, Judy Hoffman, Zsolt Kira

CVPR 2023 Trainable Projected Gradient Method for Robust Fine-Tuning Junjiao Tian, Zecheng He, Xiaoliang Dai, Chih-Yao Ma, Yen-Cheng Liu, Zsolt Kira

NeurIPS 2023 Training Energy-Based Normalizing Flow with Score-Matching Objectives Chen-Hao Chao, Wei-Fang Sun, Yen-Chang Hsu, Zsolt Kira, Chun-Yi Lee

CVPR 2022 Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for Image Captioning Chia-Wen Kuo, Zsolt Kira

CoLLAs 2022 Model-Free Generative Replay for Lifelong Reinforcement Learning: Application to Starcraft-2 Zachary Alan Daniels, Aswin Raghavan, Jesse Hostetler, Abrar Rahman, Indranil Sur, Michael Piacentino, Ajay Divakaran, Roberto Corizzo, Kamil Faber, Nathalie Japkowicz, Michael Baron, James Smith, Sahana Pramod Joshi, Zsolt Kira, Cameron Ethan Taylor, Mustafa Burak Gurbuz, Constantine Dovrolis, Tyler L. Hayes, Christopher Kanan, Jhair Gallardo

ECCV 2022 Open-Set Semi-Supervised Object Detection Yen-Cheng Liu, Chih-Yao Ma, Xiaoliang Dai, Junjiao Tian, Peter Vajda, Zijian He, Zsolt Kira

NeurIPS 2022 Polyhistor: Parameter-Efficient Multi-Task Adaptation for Dense Vision Tasks Yen-Cheng Liu, Chih-Yao Ma, Junjiao Tian, Zijian He, Zsolt Kira

ECCV 2022 ShAPO: Implicit Representations for Multi-Object Shape, Appearance, and Pose Optimization Muhammad Zubair Irshad, Sergey Zakharov, Rareș Ambruș, Thomas Kollar, Zsolt Kira, Adrien Gaidon

CVPR 2022 Unbiased Teacher V2: Semi-Supervised Object Detection for Anchor-Free and Anchor-Based Detectors Yen-Cheng Liu, Chih-Yao Ma, Zsolt Kira

NeurIPS 2021 A Geometric Perspective Towards Neural Calibration via Sensitivity Decomposition Junjiao Tian, Dylan Yung, Yen-Chang Hsu, Zsolt Kira

ICCV 2021 Always Be Dreaming: A New Approach for Data-Free Class-Incremental Learning James Smith, Yen-Chang Hsu, Jonathan Balloch, Yilin Shen, Hongxia Jin, Zsolt Kira

NeurIPSW 2021 Exploring Covariate and Concept Shift for Out-of-Distribution Detection Junjiao Tian, Yen-Chang Hsu, Yilin Shen, Hongxia Jin, Zsolt Kira

NeurIPS 2021 Habitat 2.0: Training Home Assistants to Rearrange Their Habitat Andrew Szot, Alexander Clegg, Eric Undersander, Erik Wijmans, Yili Zhao, John Turner, Noah Maestre, Mustafa Mukadam, Devendra Singh Chaplot, Oleksandr Maksymets, Aaron Gokaslan, Vladimír Vondruš, Sameer Dharur, Franziska Meier, Wojciech Galuba, Angel Chang, Zsolt Kira, Vladlen Koltun, Jitendra Malik, Manolis Savva, Dhruv Batra

ICLR 2021 Unbiased Teacher for Semi-Supervised Object Detection Yen-Cheng Liu, Chih-Yao Ma, Zijian He, Chia-Wen Kuo, Kan Chen, Peizhao Zhang, Bichen Wu, Zsolt Kira, Peter Vajda

CVPR 2020 Action Segmentation with Joint Self-Supervised Temporal Domain Adaptation Min-Hung Chen, Baopu Li, Yingze Bao, Ghassan AlRegib, Zsolt Kira

ECCV 2020 FeatMatch: Feature-Based Augmentation for Semi-Supervised Learning Chia-Wen Kuo, Chih-Yao Ma, Jia-Bin Huang, Zsolt Kira

CVPR 2020 Generalized ODIN: Detecting Out-of-Distribution Image Without Learning from Out-of-Distribution Data Yen-Chang Hsu, Yilin Shen, Hongxia Jin, Zsolt Kira

ECCV 2020 Learning to Generate Grounded Visual Captions Without Localization Supervision Chih-Yao Ma, Yannis Kalantidis, Ghassan AlRegib, Peter Vajda, Marcus Rohrbach, Zsolt Kira

AAAI 2020 Path Ranking with Attention to Type Hierarchies Weiyu Liu, Angel Andres Daruna, Zsolt Kira, Sonia Chernova

NeurIPS 2020 Posterior Re-Calibration for Imbalanced Datasets Junjiao Tian, Yen-Cheng Liu, Nathaniel Glaser, Yen-Chang Hsu, Zsolt Kira

CVPR 2020 When2com: Multi-Agent Perception via Communication Graph Grouping Yen-Cheng Liu, Junjiao Tian, Nathaniel Glaser, Zsolt Kira

ICLR 2019 A Closer Look at Few-Shot Classification Wei-Yu Chen, Yen-Cheng Liu, Zsolt Kira, Yu-Chiang Frank Wang, Jia-Bin Huang

WACV 2019 Data-Efficient Graph Embedding Learning for PCB Component Detection Chia-Wen Kuo, Jacob Ashmore, David Huggins, Zsolt Kira

ICLR 2019 Multi-Class Classification Without Multi-Class Labels Yen-Chang Hsu, Zhaoyang Lv, Joel Schlosser, Phillip Odom, Zsolt Kira

ICLR 2019 Self-Monitoring Navigation Agent via Auxiliary Progress Estimation Chih-Yao Ma, Jiasen Lu, Zuxuan Wu, Ghassan AlRegib, Zsolt Kira, Richard Socher, Caiming Xiong

ICLRW 2019 Sub-Task Discovery with Limited Supervision: A Constrained Clustering Approach Phillip Odom, Aaron Keech, Zsolt Kira

ICCV 2019 Temporal Attentive Alignment for Large-Scale Video Domain Adaptation Min-Hung Chen, Zsolt Kira, Ghassan AlRegib, Jaekwon Yoo, Ruxin Chen, Jian Zheng

CVPR 2019 The Regretful Agent: Heuristic-Aided Navigation Through Progress Estimation Chih-Yao Ma, Zuxuan Wu, Ghassan AlRegib, Caiming Xiong, Zsolt Kira

ICLRW 2019 Unsupervised Continual Learning and Self-Taught Associative Memory Hierarchies James Smith, Seth Baer, Zsolt Kira, Constantine Dovrolis

CVPR 2018 Attend and Interact: Higher-Order Object Interactions for Video Understanding Chih-Yao Ma, Asim Kadav, Iain Melvin, Zsolt Kira, Ghassan AlRegib, Hans Peter Graf

ICLR 2018 Learning to Cluster in Order to Transfer Across Domains and Tasks Yen-Chang Hsu, Zhaoyang Lv, Zsolt Kira

ECCV 2016 A Continuous Optimization Approach for Efficient and Accurate Scene Flow Zhaoyang Lv, Chris Beall, Pablo F. Alcantarilla, Fuxin Li, Zsolt Kira, Frank Dellaert