DemoFusion: Democratising High-Resolution Image Generation with No $$$
Abstract
High-resolution image generation with Generative Artificial Intelligence (GenAI) has immense potential but due to the enormous capital investment required for training it is increasingly centralised to a few large corporations and hidden behind paywalls. This paper aims to democratise high-resolution GenAI by advancing the frontier of high-resolution generation while remaining accessible to a broad audience. We demonstrate that existing Latent Diffusion Models (LDMs) possess untapped potential for higher-resolution image generation. Our novel DemoFusion framework seamlessly extends open-source GenAI models employing Progressive Upscaling Skip Residual and Dilated Sampling mechanisms to achieve higher-resolution image generation. The progressive nature of DemoFusion requires more passes but the intermediate results can serve as "previews" facilitating rapid prompt iteration.
Cite
Text
Du et al. "DemoFusion: Democratising High-Resolution Image Generation with No $$$." Conference on Computer Vision and Pattern Recognition, 2024. doi:10.1109/CVPR52733.2024.00589Markdown
[Du et al. "DemoFusion: Democratising High-Resolution Image Generation with No $$$." Conference on Computer Vision and Pattern Recognition, 2024.](https://mlanthology.org/cvpr/2024/du2024cvpr-demofusion/) doi:10.1109/CVPR52733.2024.00589BibTeX
@inproceedings{du2024cvpr-demofusion,
title = {{DemoFusion: Democratising High-Resolution Image Generation with No $$$}},
author = {Du, Ruoyi and Chang, Dongliang and Hospedales, Timothy and Song, Yi-Zhe and Ma, Zhanyu},
booktitle = {Conference on Computer Vision and Pattern Recognition},
year = {2024},
pages = {6159-6168},
doi = {10.1109/CVPR52733.2024.00589},
url = {https://mlanthology.org/cvpr/2024/du2024cvpr-demofusion/}
}