A Disentangled Approach to Predict the Aesthetic Outcomes of Breast Cancer Treatment

Abstract

Breast cancer locoregional treatment can cause significant and long-lasting alterations to a patient’s body. As various surgical options may be available to a patient and considering the impact that the aesthetic outcome may have on the patient’s self-esteem, it is critical for the patient to be adequately informed of the possible outcomes of each treatment when deciding on the treatment plan. With the purpose of simulating how a patient may look like after treatment, we propose a deep generative model to transfer asymmetries caused by treatment from post-operative breast patients into pre-operative images, taking advantage of the inherent symmetry of breast images. Furthermore, we disentangle asymmetries related with the breast shape from the nipple within the latent space of the network, enabling higher control over the alterations to the breasts. Finally, we show the proposed model’s wide applicability in medical imaging, by applying it to generate counterfactual explanations for cardiomegaly and pleural effusion prediction in chest radiographs.