Bridge-if: Learning Inverse Protein Folding with Markov Bridges

Abstract

Inverse protein folding is a fundamental task in computational protein design, which aims to design protein sequences that fold into the desired backbone structures. While the development of machine learning algorithms for this task has seen significant success, the prevailing approaches, which predominantly employ a discriminative formulation, frequently encounter the error accumulation issue and often fail to capture the extensive variety of plausible sequences. To fill these gaps, we propose Bridge-IF, a generative diffusion bridge model for inverse folding, which is designed to learn the probabilistic dependency between the distributions of backbone structures and protein sequences. Specifically, we harness an expressive structure encoder to propose a discrete, informative prior derived from structures, and establish a Markov bridge to connect this prior with native sequences. During the inference stage, Bridge-IF progressively refines the prior sequence, culminating in a more plausible design. Moreover, we introduce a reparameterization perspective on Markov bridge models, from which we derive a simplified loss function that facilitates more effective training. We also modulate protein language models (PLMs) with structural conditions to precisely approximate the Markov bridge process, thereby significantly enhancing generation performance while maintaining parameter-efficient training. Extensive experiments on well-established benchmarks demonstrate that Bridge-IF predominantly surpasses existing baselines in sequence recovery and excels in the design of plausible proteins with high foldability. The code is available at https://github.com/violet-sto/Bridge-IF.

Cite

Text

Zhu et al. "Bridge-if: Learning Inverse Protein Folding with Markov Bridges." Neural Information Processing Systems, 2024. doi:10.52202/079017-1260

Markdown

[Zhu et al. "Bridge-if: Learning Inverse Protein Folding with Markov Bridges." Neural Information Processing Systems, 2024.](https://mlanthology.org/neurips/2024/zhu2024neurips-bridgeif/) doi:10.52202/079017-1260

BibTeX

@inproceedings{zhu2024neurips-bridgeif,
  title     = {{Bridge-if: Learning Inverse Protein Folding with Markov Bridges}},
  author    = {Zhu, Yiheng and Wu, Jialu and Li, Qiuyi and Yan, Jiahuan and Yin, Mingze and Wu, Wei and Li, Mingyang and Ye, Jieping and Wang, Zheng and Wu, Jian},
  booktitle = {Neural Information Processing Systems},
  year      = {2024},
  doi       = {10.52202/079017-1260},
  url       = {https://mlanthology.org/neurips/2024/zhu2024neurips-bridgeif/}
}