Wang, William Yang

93 publications

CVPR 2025 BlobGEN-Vid: Compositional Text-to-Video Generation with Blob Video Representations Weixi Feng, Chao Liu, Sifei Liu, William Yang Wang, Arash Vahdat, Weili Nie

AAAI 2025 Combating Multimodal LLM Hallucination via Bottom-up Holistic Reasoning Shengqiong Wu, Hao Fei, Liangming Pan, William Yang Wang, Shuicheng Yan, Tat-Seng Chua

ICLR 2025 Generalization V.s. Memorization: Tracing Language Models’ Capabilities Back to Pretraining Data Xinyi Wang, Antonis Antoniades, Yanai Elazar, Alfonso Amayuelas, Alon Albalak, Kexun Zhang, William Yang Wang

ICLRW 2025 InductionBench: LLMs Fail in the Simplest Complexity Class Wenyue Hua, Fei Sun, Liangming Pan, Adam Jardine, William Yang Wang

ICML 2025 MELON: Provable Defense Against Indirect Prompt Injection Attacks in AI Agents Kaijie Zhu, Xianjun Yang, Jindong Wang, Wenbo Guo, William Yang Wang

ICLR 2025 MMWorld: Towards Multi-Discipline Multi-Faceted World Model Evaluation in Videos Xuehai He, Weixi Feng, Kaizhi Zheng, Yujie Lu, Wanrong Zhu, Jiachen Li, Yue Fan, Jianfeng Wang, Linjie Li, Zhengyuan Yang, Kevin Lin, William Yang Wang, Lijuan Wang, Xin Eric Wang

NeurIPS 2025 MuSLR: Multimodal Symbolic Logical Reasoning Jundong Xu, Hao Fei, Yuhui Zhang, Liangming Pan, Qijun Huang, Qian Liu, Preslav Nakov, Min-Yen Kan, William Yang Wang, Mong-Li Lee, Wynne Hsu

ICLRW 2025 RuleArena: A Benchmark for LLM Rule-Guided Reasoning in Real-World Scenarios Ruiwen Zhou, Wenyue Hua, Liangming Pan, Sitao Cheng, Xiaobao Wu, En Yu, William Yang Wang

ICLR 2025 SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinement Antonis Antoniades, Albert Örwall, Kexun Zhang, Yuxi Xie, Anirudh Goyal, William Yang Wang

ICLR 2025 Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Sampling Wenda Xu, Rujun Han, Zifeng Wang, Long Le, Dhruv Madeka, Lei Li, William Yang Wang, Rishabh Agarwal, Chen-Yu Lee, Tomas Pfister

ICLR 2025 T2V-Turbo-V2: Enhancing Video Model Post-Training Through Data, Reward, and Conditional Guidance Design Jiachen Li, Qian Long, Jian Zheng, Xiaofeng Gao, Robinson Piramuthu, Wenhu Chen, William Yang Wang

AAAI 2025 Unveiling the Impact of Coding Data Instruction Fine-Tuning on Large Language Models Reasoning Xinlu Zhang, Zhiyu Zoey Chen, Xi Ye, Xianjun Yang, Lichang Chen, William Yang Wang, Linda Ruth Petzold

ICCV 2025 VSP: Diagnosing the Dual Challenges of Perception and Reasoning in Spatial Planning Tasks for MLLMs Qiucheng Wu, Handong Zhao, Michael Saxon, Trung Bui, William Yang Wang, Yang Zhang, Shiyu Chang

ICML 2025 Weak-to-Strong Jailbreaking on Large Language Models Xuandong Zhao, Xianjun Yang, Tianyu Pang, Chao Du, Lei Li, Yu-Xiang Wang, William Yang Wang

TMLR 2024 A Survey on Data Selection for Language Models Alon Albalak, Yanai Elazar, Sang Michael Xie, Shayne Longpre, Nathan Lambert, Xinyi Wang, Niklas Muennighoff, Bairu Hou, Liangming Pan, Haewon Jeong, Colin Raffel, Shiyu Chang, Tatsunori Hashimoto, William Yang Wang

TMLR 2024 A Survey on Large Language Models for Critical Societal Domains: Finance, Healthcare, and Law Zhiyu Chen, Jing Ma, Xinlu Zhang, Nan Hao, An Yan, Armineh Nourbakhsh, Xianjun Yang, Julian McAuley, Linda Ruth Petzold, William Yang Wang

NeurIPSW 2024 COrAL: Order-Agnostic Language Modeling for Efficient Iterative Refinement Yuxi Xie, Anirudh Goyal, Xiaobao Wu, Xunjian Yin, Xiao Xu, Min-Yen Kan, Liangming Pan, William Yang Wang

ICMLW 2024 Can Editing LLMs Inject Harm? Canyu Chen, Baixiang Huang, Zekun Li, Zhaorun Chen, Shiyang Lai, Xiongxiao Xu, Jia-Chen Gu, Jindong Gu, Huaxiu Yao, Chaowei Xiao, Xifeng Yan, William Yang Wang, Philip Torr, Dawn Song, Kai Shu

NeurIPSW 2024 Can Editing LLMs Inject Harm? Canyu Chen, Baixiang Huang, Zekun Li, Zhaorun Chen, Shiyang Lai, Xiongxiao Xu, Jia-Chen Gu, Jindong Gu, Huaxiu Yao, Chaowei Xiao, Xifeng Yan, William Yang Wang, Philip Torr, Dawn Song, Kai Shu

ICLR 2024 DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Text Xianjun Yang, Wei Cheng, Yue Wu, Linda Ruth Petzold, William Yang Wang, Haifeng Chen

TMLR 2024 Discffusion: Discriminative Diffusion Models as Few-Shot Vision and Language Learners Xuehai He, Weixi Feng, Tsu-Jui Fu, Varun Jampani, Arjun Reddy Akula, Pradyumna Narayana, S Basu, William Yang Wang, Xin Eric Wang

NeurIPS 2024 FASTopic: Pretrained Transformer Is a Fast, Adaptive, Stable, and Transferable Topic Model Xiaobao Wu, Thong Nguyen, Delvin Ce Zhang, William Yang Wang, Anh Tuan Luu

ICMLW 2024 From Text to Pixel: Advancing Long-Context Understanding in MLLMs Yujie Lu, Xiujun Li, Tsu-Jui Fu, Miguel Eckstein, William Yang Wang

ICMLW 2024 Generalization vs. Memorization: Tracing Language Models' Capabilities Back to Pretraining Data Antonis Antoniades, Xinyi Wang, Yanai Elazar, Alfonso Amayuelas, Alon Albalak, Kexun Zhang, William Yang Wang

ICLR 2024 Guiding Instruction-Based Image Editing via Multimodal Large Language Models Tsu-Jui Fu, Wenze Hu, Xianzhi Du, William Yang Wang, Yinfei Yang, Zhe Gan

ICLR 2024 Language Control Diffusion: Efficiently Scaling Through Space, Time, and Tasks Edwin Zhang, Yujie Lu, Shinda Huang, William Yang Wang, Amy Zhang

NeurIPSW 2024 MMWorld: Towards Multi-Discipline Multi-Faceted World Model Evaluation in Videos Xuehai He, Weixi Feng, Kaizhi Zheng, Yujie Lu, Wanrong Zhu, Jiachen Li, Yue Fan, Jianfeng Wang, Linjie Li, Zhengyuan Yang, Kevin Lin, William Yang Wang, Lijuan Wang, Xin Eric Wang

ICML 2024 Mastering Robot Manipulation with Multimodal Prompts Through Pretraining and Multi-Task Fine-Tuning Jiachen Li, Qiaozi Gao, Michael Johnston, Xiaofeng Gao, Xuehai He, Hangjie Shi, Suhaila Shakiah, Reza Ghanadan, William Yang Wang

ICLR 2024 Neuroformer: Multimodal and Multitask Generative Pretraining for Brain Data Antonis Antoniades, Yiyi Yu, Joe S Canzano, William Yang Wang, Spencer Smith

ICML 2024 Position: AI/ML Influencers Have a Place in the Academic Process Iain Weissburg, Mehir Arora, Xinyi Wang, Liangming Pan, William Yang Wang

ICML 2024 Position: TrustLLM: Trustworthiness in Large Language Models Yue Huang, Lichao Sun, Haoran Wang, Siyuan Wu, Qihui Zhang, Yuan Li, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Hanchi Sun, Zhengliang Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, Bertie Vidgen, Bhavya Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Hao Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, Manolis Kellis, Marinka Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, Joaquin Vanschoren, John Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, Michael Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, Suman Jana, Tianlong Chen, Tianming Liu, Tianyi Zhou, William Yang Wang, Xiang Li, Xiangliang Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yong Chen, Yue Zhao

TMLR 2024 Reward Guided Latent Consistency Distillation Jiachen Li, Weixi Feng, Wenhu Chen, William Yang Wang

ICLRW 2024 Shadow Alignment: The Ease of Subverting Safely-Aligned Language Models Xianjun Yang, Xiao Wang, Qi Zhang, Linda Ruth Petzold, William Yang Wang, Xun Zhao, Dahua Lin

NeurIPS 2024 T2V-Turbo: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedback Jiachen Li, Weixi Feng, Tsu-Jui Fu, Xinyi Wang, Sugato Basu, Wenhu Chen, William Yang Wang

NeurIPSW 2024 Text as Images: Can Multimodal Large Language Models Follow Printed Instructions in Pixels? Xiujun Li, Yujie Lu, William Yang Wang, Yejin Choi

ICML 2024 Understanding Reasoning Ability of Language Models from the Perspective of Reasoning Paths Aggregation Xinyi Wang, Alfonso Amayuelas, Kexun Zhang, Liangming Pan, Wenhu Chen, William Yang Wang

ICLRW 2024 Understanding the Reasoning Ability of Language Models from the Perspective of Reasoning Paths Aggregation Xinyi Wang, Alfonso Amayuelas, Kexun Zhang, Liangming Pan, Wenhu Chen, William Yang Wang

AAAI 2024 VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street View Raphael Schumann, Wanrong Zhu, Weixi Feng, Tsu-Jui Fu, Stefan Riezler, William Yang Wang

ICMLW 2024 Weak-to-Strong Jailbreaking on Large Language Models Xuandong Zhao, Xianjun Yang, Tianyu Pang, Chao Du, Lei Li, Yu-Xiang Wang, William Yang Wang

NeurIPS 2024 Who Evaluates the Evaluations? Objectively Scoring Text-to-Image Prompt Coherence Metrics with T2IScoreScore (TS2) Michael Saxon, Fatima Jahara, Mahsa Khoshnoodi, Yujie Lu, Aditya Sharma, William Yang Wang

NeurIPS 2024 WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences Yujie Lu, Dongfu Jiang, Wenhu Chen, William Yang Wang, Yejin Choi, Bill Yuchen Lin

NeurIPS 2023 ALGO: Synthesizing Algorithmic Programs with Generated Oracle Verifiers Kexun Zhang, Danqing Wang, Jingtao Xia, William Yang Wang, Lei Li

CVPR 2023 An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modeling Tsu-Jui Fu, Linjie Li, Zhe Gan, Kevin Lin, William Yang Wang, Lijuan Wang, Zicheng Liu

ICLR 2023 Causal Balancing for Domain Generalization Xinyi Wang, Michael Saxon, Jiachen Li, Hongyang Zhang, Kun Zhang, William Yang Wang

ICLR 2023 DecAF: Joint Decoding of Answers and Logical Forms for Question Answering over Knowledge Bases Donghan Yu, Sheng Zhang, Patrick Ng, Henghui Zhu, Alexander Hanbo Li, Jun Wang, Yiqun Hu, William Yang Wang, Zhiguo Wang, Bing Xiang

ICLR 2023 Dr.Spider: A Diagnostic Evaluation Benchmark Towards Text-to-SQL Robustness Shuaichen Chang, Jun Wang, Mingwen Dong, Lin Pan, Henghui Zhu, Alexander Hanbo Li, Wuwei Lan, Sheng Zhang, Jiarong Jiang, Joseph Lilien, Steve Ash, William Yang Wang, Zhiguo Wang, Vittorio Castelli, Patrick Ng, Bing Xiang

NeurIPSW 2023 Efficient Online Data Mixing for Language Model Pre-Training Alon Albalak, Liangming Pan, Colin Raffel, William Yang Wang

NeurIPS 2023 Flexible Attention-Based Multi-Policy Fusion for Efficient Deep Reinforcement Learning Zih-Yun Chiu, Yi-Lin Tuan, William Yang Wang, Michael Yip

NeurIPS 2023 Improving Few-Shot Generalization by Exploring and Exploiting Auxiliary Data Alon Albalak, Colin A Raffel, William Yang Wang

NeurIPSW 2023 Improving Few-Shot Generalization by Exploring and Exploiting Auxiliary Data Alon Albalak, Colin Raffel, William Yang Wang

NeurIPS 2023 LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation Yujie Lu, Xianjun Yang, Xiujun Li, Xin Eric Wang, William Yang Wang

ICMLW 2023 Large Language Models Are Implicitly Topic Models: Explaining and Finding Good Demonstrations for In-Context Learning Xinyi Wang, Wanrong Zhu, Michael Saxon, Mark Steyvers, William Yang Wang

NeurIPS 2023 Large Language Models Are Latent Variable Models: Explaining and Finding Good Demonstrations for In-Context Learning Xinyi Wang, Wanrong Zhu, Michael Saxon, Mark Steyvers, William Yang Wang

NeurIPS 2023 LayoutGPT: Compositional Visual Planning and Generation with Large Language Models Weixi Feng, Wanrong Zhu, Tsu-Jui Fu, Varun Jampani, Arjun Akula, Xuehai He, S Basu, Xin Eric Wang, William Yang Wang

ICCV 2023 Learning Concise and Descriptive Attributes for Visual Recognition An Yan, Yu Wang, Yiwu Zhong, Chengyu Dong, Zexue He, Yujie Lu, William Yang Wang, Jingbo Shang, Julian McAuley

NeurIPS 2023 Multimodal C4: An Open, Billion-Scale Corpus of Images Interleaved with Text Wanrong Zhu, Jack Hessel, Anas Awadalla, Samir Yitzhak Gadre, Jesse Dodge, Alex Fang, Youngjae Yu, Ludwig Schmidt, William Yang Wang, Yejin Choi

IJCAI 2023 NeuPSL: Neural Probabilistic Soft Logic Connor Pryor, Charles Dickens, Eriq Augustine, Alon Albalak, William Yang Wang, Lise Getoor

ICLR 2023 Neuro-Symbolic Procedural Planning with Commonsense Prompting Yujie Lu, Weixi Feng, Wanrong Zhu, Wenda Xu, Xin Eric Wang, Miguel Eckstein, William Yang Wang

ICML 2023 Offline Reinforcement Learning with Closed-Form Policy Improvement Operators Jiachen Li, Edwin Zhang, Ming Yin, Qinxun Bai, Yu-Xiang Wang, William Yang Wang

ICML 2023 ReDi: Efficient Learning-Free Diffusion Inference via Trajectory Retrieval Kexun Zhang, Xianjun Yang, William Yang Wang, Lei Li

ICMLW 2023 Reasoning Ability Emerges in Large Language Models as Aggregation of Reasoning Paths: A Case Study with Knowledge Graphs Xinyi Wang, William Yang Wang

ICLR 2023 Street: A Multi-Task Structured Reasoning and Explanation Benchmark Danilo Neves Ribeiro, Shen Wang, Xiaofei Ma, Henghui Zhu, Rui Dong, Deguang Kong, Juliette Burger, Anjelica Ramos, Zhiheng Huang, William Yang Wang, George Karypis, Bing Xiang, Dan Roth

CVPR 2023 Tell Me What Happened: Unifying Text-Guided Video Completion via Multimodal Masked Video Generation Tsu-Jui Fu, Licheng Yu, Ning Zhang, Cheng-Yang Fu, Jong-Chyi Su, William Yang Wang, Sean Bell

NeurIPSW 2023 ToolDec: Syntax Error-Free and Generalizable Tool Use for LLMs via Finite-State Decoding Hongqiao Chen, Kexun Zhang, Lei Li, William Yang Wang

ICLR 2023 Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis Weixi Feng, Xuehai He, Tsu-Jui Fu, Varun Jampani, Arjun Reddy Akula, Pradyumna Narayana, Sugato Basu, Xin Eric Wang, William Yang Wang

NeurIPSW 2023 VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street View Raphael Schumann, Wanrong Zhu, Weixi Feng, Tsu-Jui Fu, Stefan Riezler, William Yang Wang

ICLR 2023 WikiWhy: Answering and Explaining Cause-and-Effect Questions Matthew Ho, Aditya Sharma, Justin Chang, Michael Saxon, Sharon Levy, Yujie Lu, William Yang Wang

ICMLW 2022 Bridging the Training-Inference Gap for Dense Phrase Retrieval Gyuwan Kim, Jinhyuk Lee, Barlas Oguz, Wenhan Xiong, Yizhe Zhang, Yashar Mehdad, William Yang Wang

ICMLW 2022 Causal Balancing for Domain Generalization Xinyi Wang, Michael Saxon, Jiachen Li, Hongyang Zhang, Kun Zhang, William Yang Wang

AAAI 2022 DOC2PPT: Automatic Presentation Slides Generation from Scientific Documents Tsu-Jui Fu, William Yang Wang, Daniel McDuff, Yale Song

NeurIPSW 2022 LAD: Language Augmented Diffusion for Reinforcement Learning Edwin Zhang, Yujie Lu, William Yang Wang, Amy Zhang

ECCV 2022 Language-Driven Artistic Style Transfer Tsu-Jui Fu, Xin Eric Wang, William Yang Wang

CVPR 2022 M3L: Language-Based Video Editing via Multi-Modal Multi-Level Transformers Tsu-Jui Fu, Xin Eric Wang, Scott T. Grafton, Miguel P. Eckstein, William Yang Wang

NeurIPSW 2022 Off-Policy Reinforcement Learning with Optimistic Exploration and Distribution Correction Jiachen Li, Shuo Cheng, Zhenyu Liao, Huayan Wang, William Yang Wang, Qinxun Bai

NeurIPSW 2022 Offline Reinforcement Learning with Closed-Form Policy Improvement Operators Jiachen Li, Edwin Zhang, Ming Yin, Qinxun Bai, Yu-Xiang Wang, William Yang Wang

AAAI 2022 Self-Supervised Knowledge Assimilation for Expert-Layman Text Style Transfer Wenda Xu, Michael Saxon, Misha Sra, William Yang Wang

ICLR 2021 Answering Complex Open-Domain Questions with Multi-Hop Dense Retrieval Wenhan Xiong, Xiang Li, Srini Iyer, Jingfei Du, Patrick Lewis, William Yang Wang, Yashar Mehdad, Scott Yih, Sebastian Riedel, Douwe Kiela, Barlas Oguz

NeurIPS 2021 Counterfactual Maximum Likelihood Estimation for Training Deep Networks Xinyi Wang, Wenhu Chen, Michael Saxon, William Yang Wang

NeurIPS 2021 Local Explanation of Dialogue Response Generation Yi-Lin Tuan, Connor Pryor, Wenhu Chen, Lise Getoor, William Yang Wang

ICLR 2021 Open Question Answering over Tables and Text Wenhu Chen, Ming-Wei Chang, Eva Schlinger, William Yang Wang, William W. Cohen

ECCV 2020 Counterfactual Vision-and-Language Navigation via Adversarial Path Sampler Tsu-Jui Fu, Xin Eric Wang, Matthew F. Peterson, Scott T. Grafton, Miguel P. Eckstein, William Yang Wang

ECCV 2020 Environment-Agnostic Multitask Learning for Natural Language Grounded Navigation Xin Eric Wang, Vihan Jain, Eugene Ie, William Yang Wang, Zornitsa Kozareva, Sujith Ravi[2]

AAAI 2020 Generative Adversarial Zero-Shot Relational Learning for Knowledge Graphs Pengda Qin, Xin Wang, Wenhu Chen, Chunyun Zhang, Weiran Xu, William Yang Wang

AAAI 2020 Multi-Task Self-Supervised Learning for Disfluency Detection Shaolei Wang, Wanxiang Che, Qi Liu, Pengda Qin, Ting Liu, William Yang Wang

ICLR 2020 Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model Wenhan Xiong, Jingfei Du, William Yang Wang, Veselin Stoyanov

ICLR 2020 TabFact: A Large-Scale Dataset for Table-Based Fact Verification Wenhu Chen, Hongmin Wang, Jianshu Chen, Yunkai Zhang, Hong Wang, Shiyang Li, Xiyou Zhou, William Yang Wang

AAAI 2019 Learning to Compose Topic-Aware Mixture of Experts for Zero-Shot Video Captioning Xin Wang, Jiawei Wu, Da Zhang, Yu Su, William Yang Wang

AAAI 2019 Quantifying Uncertainties in Natural Language Processing Tasks Yijun Xiao, William Yang Wang

IJCAI 2018 Scheduled Policy Optimization for Natural Language Communication with Intelligent Agents Wenhan Xiong, Xiaoxiao Guo, Mo Yu, Shiyu Chang, Bowen Zhou, William Yang Wang

IJCAI 2016 Learning First-Order Logic Embeddings via Matrix Factorization William Yang Wang, William W. Cohen

IJCAI 2015 A Soft Version of Predicate Invention Based on Structured Sparsity William Yang Wang, Kathryn Mazaitis, William W. Cohen

MLJ 2015 Efficient Inference and Learning in a Large Knowledge Base - Reasoning with Extracted Information Using a Locally Groundable First-Order Probabilistic Logic William Yang Wang, Kathryn Mazaitis, Ni Lao, William W. Cohen