Li, Chunyuan

80 publications

CVPRW 2025 Beyond Raw Videos: Understanding Edited Videos with Large Multimodal Model Lu Xu, Sijie Zhu, Chunyuan Li, Chia-Wen Kuo, Fan Chen, Xinyao Wang, Guang Chen, Dawei Du, Ye Yuan, Longyin Wen

AAAI 2025 Graphic Design with Large Multimodal Model Yutao Cheng, Zhao Zhang, Maoke Yang, Hui Nie, Chunyuan Li, Xinglong Wu, Jie Shao

CVPR 2025 LLaVA-Critic: Learning to Evaluate Multimodal Models Tianyi Xiong, Xiyao Wang, Dong Guo, Qinghao Ye, Haoqi Fan, Quanquan Gu, Heng Huang, Chunyuan Li

ICLR 2025 LLaVA-Interleave: Tackling Multi-Image, Video, and 3D in Large Multimodal Models Feng Li, Renrui Zhang, Hao Zhang, Yuanhan Zhang, Bo Li, Wei Li, Zejun Ma, Chunyuan Li

TMLR 2025 LLaVA-OneVision: Easy Visual Task Transfer Bo Li, Yuanhan Zhang, Dong Guo, Renrui Zhang, Feng Li, Hao Zhang, Kaichen Zhang, Peiyuan Zhang, Yanwei Li, Ziwei Liu, Chunyuan Li

TMLR 2025 LLaVA-Video: Video Instruction Tuning with Synthetic Data Yuanhan Zhang, Jinming Wu, Wei Li, Bo Li, Zejun Ma, Ziwei Liu, Chunyuan Li

TMLR 2025 Long Context Transfer from Language to Vision Peiyuan Zhang, Kaichen Zhang, Bo Li, Guangtao Zeng, Jingkang Yang, Yuanhan Zhang, Ziyue Wang, Haoran Tan, Chunyuan Li, Ziwei Liu

ICLR 2025 MMSearch: Unveiling the Potential of Large Models as Multi-Modal Search Engines Dongzhi Jiang, Renrui Zhang, Ziyu Guo, Yanmin Wu, Jiayi Lei, Pengshuo Qiu, Pan Lu, Zehui Chen, Guanglu Song, Peng Gao, Yu Liu, Chunyuan Li, Hongsheng Li

ICLR 2025 MuirBench: A Comprehensive Benchmark for Robust Multi-Image Understanding Fei Wang, Xingyu Fu, James Y. Huang, Zekun Li, Qin Liu, Xiaogeng Liu, Mingyu Derek Ma, Nan Xu, Wenxuan Zhou, Kai Zhang, Tianyi Lorena Yan, Wenjie Jacky Mo, Hsiang-Hui Liu, Pan Lu, Chunyuan Li, Chaowei Xiao, Kai-Wei Chang, Dan Roth, Sheng Zhang, Hoifung Poon, Muhao Chen

ICLR 2025 Painting with Words: Elevating Detailed Image Captioning with Benchmark and Alignment Learning Qinghao Ye, Xianhan Zeng, Fu Li, Chunyuan Li, Haoqi Fan

ECCV 2024 Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection Shilong Liu, Zhaoyang Zeng, Tianhe Ren, Feng Li, Hao Zhang, Jie Yang, Qing Jiang, Chunyuan Li, Jianwei Yang, Hang Su, Jun Zhu, Lei Zhang

CVPR 2024 Improved Baselines with Visual Instruction Tuning Haotian Liu, Chunyuan Li, Yuheng Li, Yong Jae Lee

ECCV 2024 LLaVA-Grounding: Grounded Visual Chat with Large Multimodal Models Hao Zhang, Hongyang Li, Feng Li, Tianhe Ren, Xueyan Zou, Shilong Liu, Shijia Huang, Jianfeng Gao, Lei Zhang, Chunyuan Li, Jianwei Yang

ECCV 2024 LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agents Shilong Liu, Hao Cheng, Haotian Liu, Hao Zhang, Feng Li, Tianhe Ren, Xueyan Zou, Jianwei Yang, Hang Su, Jun Zhu, Lei Zhang, Jianfeng Gao, Chunyuan Li

ICLR 2024 MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chunyuan Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao

ICML 2024 Position: TrustLLM: Trustworthiness in Large Language Models Yue Huang, Lichao Sun, Haoran Wang, Siyuan Wu, Qihui Zhang, Yuan Li, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Hanchi Sun, Zhengliang Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, Bertie Vidgen, Bhavya Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Hao Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, Manolis Kellis, Marinka Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, Joaquin Vanschoren, John Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, Michael Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, Suman Jana, Tianlong Chen, Tianming Liu, Tianyi Zhou, William Yang Wang, Xiang Li, Xiangliang Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yong Chen, Yue Zhao

NeurIPS 2024 Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment Xin Xiao, Bohong Wu, Jiacong Wang, Chunyuan Li, Xun Zhou, Haoyuan Guo

ECCV 2024 Segment and Recognize Anything at Any Granularity Feng Li, Hao Zhang, Peize Sun, Xueyan Zou, Shilong Liu, Chunyuan Li, Jianwei Yang, Lei Zhang, Jianfeng Gao

CVPR 2024 Visual In-Context Prompting Feng Li, Qing Jiang, Hao Zhang, Tianhe Ren, Shilong Liu, Xueyan Zou, Huaizhe Xu, Hongyang Li, Jianwei Yang, Chunyuan Li, Lei Zhang, Jianfeng Gao

ICCV 2023 A Simple Framework for Open-Vocabulary Segmentation and Detection Hao Zhang, Feng Li, Xueyan Zou, Shilong Liu, Chunyuan Li, Jianwei Yang, Lei Zhang

NeurIPSW 2023 An Empirical Study of Scaling Instruct-Tuned Large Multimodal Models Yadong Lu, Chunyuan Li, Haotian Liu, Jianwei Yang, Jianfeng Gao, Yelong Shen

TMLR 2023 Contrastive Attraction and Contrastive Repulsion for Representation Learning Huangjie Zheng, Xu Chen, Jiangchao Yao, Hongxia Yang, Chunyuan Li, Ya Zhang, Hao Zhang, Ivor Tsang, Jingren Zhou, Mingyuan Zhou

CVPR 2023 GLIGEN: Open-Set Grounded Text-to-Image Generation Yuheng Li, Haotian Liu, Qingyang Wu, Fangzhou Mu, Jianwei Yang, Jianfeng Gao, Chunyuan Li, Yong Jae Lee

CVPR 2023 Generalized Decoding for Pixel, Image, and Language Xueyan Zou, Zi-Yi Dou, Jianwei Yang, Zhe Gan, Linjie Li, Chunyuan Li, Xiyang Dai, Harkirat Behl, Jianfeng Wang, Lu Yuan, Nanyun Peng, Lijuan Wang, Yong Jae Lee, Jianfeng Gao

NeurIPSW 2023 Improved Baselines with Visual Instruction Tuning Haotian Liu, Chunyuan Li, Yuheng Li, Yong Jae Lee

NeurIPSW 2023 Knowledge Augmented Instruction Tuning for Zero-Shot Animal Species Recognition Zalan Fabian, Zhongqi Miao, Chunyuan Li, Yuanhan Zhang, Ziwei Liu, Andres Hernandez, Pablo Arbelaez, Andrés Link, Andrés Montes-Rojas, Rafael Escucha, Laura Siabatto, Rahul Dodhia, Juan Lavista Ferres

NeurIPS 2023 LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day Chunyuan Li, Cliff Wong, Sheng Zhang, Naoto Usuyama, Haotian Liu, Jianwei Yang, Tristan Naumann, Hoifung Poon, Jianfeng Gao

ICLRW 2023 Language Models Are Visual Reasoning Coordinators Liangyu Chen, Bo Li, Sheng Shen, Jingkang Yang, Chunyuan Li, Kurt Keutzer, Trevor Darrell, Ziwei Liu

NeurIPS 2023 Large Language Models Are Visual Reasoning Coordinators Liangyu Chen, Bo Li, Sheng Shen, Jingkang Yang, Chunyuan Li, Kurt Keutzer, Trevor Darrell, Ziwei Liu

CVPR 2023 Learning Customized Visual Models with Retrieval-Augmented Knowledge Haotian Liu, Kilho Son, Jianwei Yang, Ce Liu, Jianfeng Gao, Yong Jae Lee, Chunyuan Li

NeurIPSW 2023 MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chunyuan Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao

AAAI 2023 Parameter-Efficient Model Adaptation for Vision Transformers Xuehai He, Chunyuan Li, Pengchuan Zhang, Jianwei Yang, Xin Eric Wang

NeurIPSW 2023 Towards Building the FederatedGPT: Federated Instruction Tuning Jianyi Zhang, Saeed Vahidian, Martin Kuo, Chunyuan Li, Ruiyi Zhang, Tong Yu, Guoyin Wang, Yiran Chen

NeurIPS 2023 Visual Instruction Tuning Haotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae Lee

NeurIPS 2022 ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models Chunyuan Li, Haotian Liu, Liunian Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Houdong Hu, Zicheng Liu, Yong Jae Lee, Jianfeng Gao

ICLR 2022 Efficient Self-Supervised Vision Transformers for Representation Learning Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao

NeurIPS 2022 Focal Modulation Networks Jianwei Yang, Chunyuan Li, Xiyang Dai, Jianfeng Gao

CVPR 2022 Grounded Language-Image Pre-Training Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao

NeurIPS 2022 K-LITE: Learning Transferable Visual Models with External Knowledge Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao

CVPR 2022 RegionCLIP: Region-Based Language-Image Pretraining Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao

CVPR 2022 Towards Language-Free Training for Text-to-Image Generation Yufan Zhou, Ruiyi Zhang, Changyou Chen, Chunyuan Li, Chris Tensmeyer, Tong Yu, Jiuxiang Gu, Jinhui Xu, Tong Sun

CVPR 2022 Unified Contrastive Learning in Image-Text-Label Space Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao

ICCV 2021 Exploring Robustness of Unsupervised Domain Adaptation in Semantic Segmentation Jinyu Yang, Chunyuan Li, Weizhi An, Hehuan Ma, Yuzhi Guo, Yu Rong, Peilin Zhao, Junzhou Huang

NeurIPS 2021 Focal Attention for Long-Range Interactions in Vision Transformers Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao

AAAI 2021 Hierarchical Graph Capsule Network Jinyu Yang, Peilin Zhao, Yu Rong, Chaochao Yan, Chunyuan Li, Hehuan Ma, Junzhou Huang

CVPR 2021 Partition-Guided GANs Mohammadreza Armandpour, Ali Sadeghian, Chunyuan Li, Mingyuan Zhou

CVPRW 2021 ReMP: Rectified Metric Propagation for Few-Shot Learning Yang Zhao, Chunyuan Li, Ping Yu, Changyou Chen

AAAI 2020 Complementary Auxiliary Classifiers for Label-Conditional Text Generation Yuan Li, Chunyuan Li, Yizhe Zhang, Xiujun Li, Guoqing Zheng, Lawrence Carin, Jianfeng Gao

ICLR 2020 Cyclical Stochastic Gradient MCMC for Bayesian Deep Learning Ruqi Zhang, Chunyuan Li, Jianyi Zhang, Changyou Chen, Andrew Gordon Wilson

ICML 2020 Feature Quantization Improves GAN Training Yang Zhao, Chunyuan Li, Ping Yu, Jianfeng Gao, Changyou Chen

ECCV 2020 Oscar: Object-Semantics Aligned Pre-Training for Vision-Language Tasks Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao

ICLR 2020 RaCT: Toward Amortized Ranking-Critical Training for Collaborative Filtering Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin

ECCV 2020 Structure-Aware Human-Action Generation Ping Yu, Yang Zhao, Chunyuan Li, Junsong Yuan, Changyou Chen

AISTATS 2019 Adversarial Learning of a Sampler Based on an Unnormalized Distribution Chunyuan Li, Ke Bai, Jianqiao Li, Guoyin Wang, Changyou Chen, Lawrence Carin

AAAI 2019 Communication-Efficient Stochastic Gradient MCMC for Neural Networks Chunyuan Li, Changyou Chen, Yunchen Pu, Ricardo Henao, Lawrence Carin

NeurIPS 2019 Twin Auxilary Classifiers GAN Mingming Gong, Yanwu Xu, Chunyuan Li, Kun Zhang, Kayhan Batmanghelich

ICML 2018 Adversarial Time-to-Event Modeling Paidamoyo Chapfuwa, Chenyang Tao, Chunyuan Li, Courtney Page, Benjamin Goldstein, Lawrence Carin Duke, Ricardo Henao

ICML 2018 Continuous-Time Flows for Efficient Inference and Density Estimation Changyou Chen, Chunyuan Li, Liqun Chen, Wenlin Wang, Yunchen Pu, Lawrence Carin Duke

AISTATS 2018 Learning Structural Weight Uncertainty for Sequential Decision-Making Ruiyi Zhang, Chunyuan Li, Changyou Chen, Lawrence Carin

ICLR 2018 Measuring the Intrinsic Dimension of Objective Landscapes Chunyuan Li, Heerad Farkhoor, Rosanne Liu, Jason Yosinski

ICML 2018 Policy Optimization as Wasserstein Gradient Flows Ruiyi Zhang, Changyou Chen, Chunyuan Li, Lawrence Carin

AISTATS 2018 Symmetric Variational Autoencoder and Connections to Adversarial Learning Liqun Chen, Shuyang Dai, Yunchen Pu, Erjin Zhou, Chunyuan Li, Qinliang Su, Changyou Chen, Lawrence Carin

NeurIPS 2017 ALICE: Towards Understanding Adversarial Learning for Joint Distribution Matching Chunyuan Li, Hao Liu, Changyou Chen, Yuchen Pu, Liqun Chen, Ricardo Henao, Lawrence Carin

NeurIPS 2017 Adversarial Symmetric Variational Autoencoder Yuchen Pu, Weiyao Wang, Ricardo Henao, Liqun Chen, Zhe Gan, Chunyuan Li, Lawrence Carin

NeurIPS 2017 Triangle Generative Adversarial Networks Zhe Gan, Liqun Chen, Weiyao Wang, Yuchen Pu, Yizhe Zhang, Hao Liu, Chunyuan Li, Lawrence Carin

AAAI 2017 Unsupervised Learning with Truncated Gaussian Graphical Models Qinliang Su, Xuejun Liao, Chunyuan Li, Zhe Gan, Lawrence Carin

NeurIPS 2017 VAE Learning via Stein Variational Gradient Descent Yuchen Pu, Zhe Gan, Ricardo Henao, Chunyuan Li, Shaobo Han, Lawrence Carin

AISTATS 2016 A Deep Generative Deconvolutional Image Model Yunchen Pu, Xin Yuan, Andrew Stevens, Chunyuan Li, Lawrence Carin

AAAI 2016 A Unifying Variational Inference Framework for Hierarchical Graph-Coupled HMM with an Application to Influenza Infection Kai Fan, Chunyuan Li, Katherine A. Heller

IJCAI 2016 Bayesian Dictionary Learning with Gaussian Processes and Sigmoid Belief Networks Yizhe Zhang, Ricardo Henao, Chunyuan Li, Lawrence Carin

AISTATS 2016 Bridging the Gap Between Stochastic Gradient MCMC and Stochastic Optimization Changyou Chen, David E. Carlson, Zhe Gan, Chunyuan Li, Lawrence Carin

AAAI 2016 High-Order Stochastic Gradient Thermostats for Bayesian Learning of Deep Models Chunyuan Li, Changyou Chen, Kai Fan, Lawrence Carin

CVPR 2016 Learning Weight Uncertainty with Stochastic Gradient MCMC for Shape Classification Chunyuan Li, Andrew Stevens, Changyou Chen, Yunchen Pu, Zhe Gan, Lawrence Carin

AAAI 2016 Preconditioned Stochastic Gradient Langevin Dynamics for Deep Neural Networks Chunyuan Li, Changyou Chen, David E. Carlson, Lawrence Carin

NeurIPS 2016 Stochastic Gradient MCMC with Stale Gradients Changyou Chen, Nan Ding, Chunyuan Li, Yizhe Zhang, Lawrence Carin

NeurIPS 2016 Variational Autoencoder for Deep Learning of Images, Labels and Captions Yunchen Pu, Zhe Gan, Ricardo Henao, Xin Yuan, Chunyuan Li, Andrew Stevens, Lawrence Carin

NeurIPS 2015 Deep Temporal Sigmoid Belief Networks for Sequence Modeling Zhe Gan, Chunyuan Li, Ricardo Henao, David E Carlson, Lawrence Carin

CVPR 2014 Persistence-Based Structural Recognition Chunyuan Li, Maks Ovsjanikov, Frederic Chazal

ICCV 2011 Minimum Near-Convex Decomposition for Robust Shape Representation Zhou Ren, Junsong Yuan, Chunyuan Li, Wenyu Liu