CPAL 2024

30 papers

Algorithm Design for Online Meta-Learning with Task Boundary Detection Daouda Sow, Sen Lin, Yingbin Liang, Junshan Zhang

PDF OpenReview

An Adaptive Tangent Feature Perspective of Neural Networks Daniel LeJeune, Sina Alemohammad

PDF OpenReview

Balance Is Essence: Accelerating Sparse Training via Adaptive Gradient Correction Bowen Lei, Dongkuan Xu, Ruqi Zhang, Shuren He, Bani Mallick

PDF OpenReview

Closed-Loop Transcription via Convolutional Sparse Coding Xili Dai, Ke Chen, Shengbang Tong, Jingyuan Zhang, Xingjian Gao, Mingyang Li, Druv Pai, Yuexiang Zhai, Xiaojun Yuan, Heung-Yeung Shum, Lionel Ni, Yi Ma

PDF OpenReview

Continual Learning with Dynamic Sparse Training: Exploring Algorithms for Effective Model Updates Murat Onur Yildirim, Elif Ceren Gok, Ghada Sokar, Decebal Constantin Mocanu, Joaquin Vanschoren

PDF OpenReview

Cross-Quality Few-Shot Transfer for Alloy Yield Strength Prediction: A New Materials Science Benchmark and a Sparsity-Oriented Optimization Framework Xuxi Chen, Tianlong Chen, Everardo Yeriel Olivares, Kate Elder, Scott McCall, Aurelien Perron, Joseph McKeown, Bhavya Kailkhura, Zhangyang Wang, Brian Gallagher

PDF OpenReview

Decoding Micromotion in Low-Dimensional Latent Spaces from StyleGAN Qiucheng Wu, Yifan Jiang, Junru Wu, Kai Wang, Eric Zhang, Humphrey Shi, Zhangyang Wang, Shiyu Chang

PDF OpenReview

Deep Leakage from Model in Federated Learning Zihao Zhao, Mengen Luo, Wenbo Ding

PDF OpenReview

Deep Self-Expressive Learning Chen Zhao, Chun-Guang Li, Wei He, Chong You

PDF OpenReview

Domain Generalization via Nuclear Norm Regularization Zhenmei Shi, Yifei Ming, Ying Fan, Frederic Sala, Yingyu Liang

PDF OpenReview

Efficiently Disentangle Causal Representations Yuanpeng Li, Joel Hestness, Mohamed Elhoseiny, Liang Zhao, Kenneth Church

PDF OpenReview

Emergence of Segmentation with Minimalistic White-Box Transformers Yaodong Yu, Tianzhe Chu, Shengbang Tong, Ziyang Wu, Druv Pai, Sam Buchanan, Yi Ma

PDF OpenReview

Exploring Minimally Sufficient Representation in Active Learning Through Label-Irrelevant Patch Augmentation Zhiyu Xue, Yinlong Dai, Qi Lei

PDF OpenReview

FIXED: Frustratingly Easy Domain Generalization with Mixup Wang Lu, Jindong Wang, Han Yu, Lei Huang, Xiang Zhang, Yiqiang Chen, Xing Xie

PDF OpenReview

HARD: Hyperplane ARrangement Descent Tianjiao Ding, Liangzu Peng, Rene Vidal

PDF OpenReview

How to Prune Your Language Model: Recovering Accuracy on the “Sparsity May Cry” Benchmark Eldar Kurtic, Torsten Hoefler, Dan Alistarh

PDF OpenReview

HRBP: Hardware-Friendly Regrouping Towards Block-Based Pruning for Sparse CNN Training Haoyu Ma, Chengming Zhang, Lizhi Xiang, Xiaolong Ma, Geng Yuan, Wenkai Zhang, Shiwei Liu, Tianlong Chen, Dingwen Tao, Yanzhi Wang, Zhangyang Wang, Xiaohui Xie

PDF OpenReview

Image Quality Assessment: Integrating Model-Centric and Data-Centric Approaches Peibei Cao, Dingquan Li, Kede Ma

PDF OpenReview

Investigating the Catastrophic Forgetting in Multimodal Large Language Model Fine-Tuning Yuexiang Zhai, Shengbang Tong, Xiao Li, Mu Cai, Qing Qu, Yong Jae Lee, Yi Ma

PDF OpenReview

Jaxpruner: A Concise Library for Sparsity Research Joo Hyung Lee, Wonpyo Park, Nicole Elyse Mitchell, Jonathan Pilault, Johan Samir Obando Ceron, Han-Byul Kim, Namhoon Lee, Elias Frantar, Yun Long, Amir Yazdanbakhsh, Woohyun Han, Shivani Agrawal, Suvinay Subramanian, Xin Wang, Sheng-Chun Kao, Xingyao Zhang, Trevor Gale, Aart J.C. Bik, Milen Ferev, Zhonglin Han, Hong-Seok Kim, Yann Dauphin, Gintare Karolina Dziugaite, Pablo Samuel Castro, Utku Evci

PDF OpenReview

Less Is More – Towards Parsimonious Multi-Task Models Using Structured Sparsity Richa Upadhyay, Ronald Phlypo, Rajkumar Saini, Marcus Liwicki

PDF OpenReview

Leveraging Sparse Input and Sparse Models: Efficient Distributed Learning in Resource-Constrained Environments Emmanouil Kariotakis, Grigorios Tsagkatakis, Panagiotis Tsakalides, Anastasios Kyrillidis

PDF OpenReview

NeuroMixGDP: A Neural Collapse-Inspired Random Mixup for Private Data Release Donghao Li, Yang Cao, Yuan Yao

PDF OpenReview

PC-X: Profound Clustering via Slow Exemplars Yuangang Pan, Yinghua Yao, Ivor Tsang

PDF OpenReview

Piecewise-Linear Manifolds for Deep Metric Learning Shubhang Bhatnagar, Narendra Ahuja

PDF OpenReview

Probing Biological and Artificial Neural Networks with Task-Dependent Neural Manifolds Michael Kuoch, Chi-Ning Chou, Nikhil Parthasarathy, Joel Dapello, James J. DiCarlo, Haim Sompolinsky, SueYeon Chung

PDF OpenReview

Sparse Activations with Correlated Weights in Cortex-Inspired Neural Networks Chanwoo Chun, Daniel Lee

PDF OpenReview

Sparse Fréchet Sufficient Dimension Reduction via Nonconvex Optimization Jiaying Weng, Chenlu Ke, Pei Wang

PDF OpenReview

Unsupervised Learning of Structured Representation via Closed-Loop Transcription Shengbang Tong, Xili Dai, Yubei Chen, Mingyang Li, Zengyi Li, Brent Yi, Yann LeCun, Yi Ma

PDF OpenReview

WS-iFSD: Weakly Supervised Incremental Few-Shot Object Detection Without Forgetting Xinyu Gong, Li Yin, Juan-Manuel Perez-Rua, Zhangyang Wang, Zhicheng Yan

PDF OpenReview