Estimation of Orientation and Camera Parameters from Cryo-Electron Microscopy Images with Variational Autoencoders and Generative Adversarial Networks

Nina Miolane, Frédéric Poitevin, Yee-Ting Li, Susan P. Holmes

CVPRW 2020 pp. 4174-4183

doi:10.1109/CVPRW50498.2020.00493 /cvprw/2020/miolane2020cvprw-estimation/

Abstract

Cryo-electron microscopy (cryo-EM) is capable of producing reconstructed 3D images of biomolecules at near-atomic resolution. However, raw cryo-EM images are only highly corrupted - noisy and band-pass filtered - 2D projections of the target 3D biomolecules. Reconstructing the 3D molecular shape requires the estimation of the orientation of the biomolecule that has produced the given 2D image, and the estimation of camera parameters to correct for intensity defects. Current techniques performing these tasks are often computationally expensive, while the dataset sizes keep growing. There is a need for next-generation algorithms that preserve accuracy while improving speed and scalability. In this paper, we combine variational autoencoders (VAEs) and generative adversarial networks (GANs) to learn a low-dimensional latent representation of cryoEM images. This analysis leads us to design an estimation method for orientation and camera parameters of single-particle cryo-EM images, which opens the door to faster cryo-EM biomolecule reconstruction.

PDF CVPRW Semantic Scholar

Cite

Text

Miolane et al. "Estimation of Orientation and Camera Parameters from Cryo-Electron Microscopy Images with Variational Autoencoders and Generative Adversarial Networks." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020. doi:10.1109/CVPRW50498.2020.00493

Markdown

[Miolane et al. "Estimation of Orientation and Camera Parameters from Cryo-Electron Microscopy Images with Variational Autoencoders and Generative Adversarial Networks." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020.](https://mlanthology.org/cvprw/2020/miolane2020cvprw-estimation/) doi:10.1109/CVPRW50498.2020.00493

BibTeX

@inproceedings{miolane2020cvprw-estimation,
  title     = {{Estimation of Orientation and Camera Parameters from Cryo-Electron Microscopy Images with Variational Autoencoders and Generative Adversarial Networks}},
  author    = {Miolane, Nina and Poitevin, Frédéric and Li, Yee-Ting and Holmes, Susan P.},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  year      = {2020},
  pages     = {4174-4183},
  doi       = {10.1109/CVPRW50498.2020.00493},
  url       = {https://mlanthology.org/cvprw/2020/miolane2020cvprw-estimation/}
}