HDR Recovery Under Rolling Shutter Distortions

Abstract

Preserving the high dynamic irradiance of a scene is essential for many computer vision algorithms. In this paper, we develop a technique for high dynamic range (HDR) reconstruction from differently exposed frames captured with CMOS cameras which use a rolling shutter (RS) to good effect for reducing power consumption. However, because these sensors are exposed to the scene row-wise, any unintentional handshake poses a challenge for HDR reconstruction since each row experiences a different motion. We account for this motion in the irradiance domain by picking the correct warp for each row within a predefined search space. The RS effect is rectified and a clean frame is propagated from one exposure to another until we obtain rectified irradiance corresponding to all the exposures. The rectified irradiances are finally fused to yield an HDR map that is free from RS distortions.