Detecting Illumination in Images
Abstract
Inthispaperwepresentasurprisinglysimpleyetpowerfulmethodfordetectingillumination—determiningwhich pixels are lit by different lights—in images. Our method isbasedonthechromageniccamera, whichtakestwopicturesofeachscene:oneiscapturedasnormalandtheother throughacolouredfilter. Previousresearchhasshownthat therelationshipbetweenthecolours, theRGBs, inthefilteredandunfilteredimagesdependsstronglyonthecolour ofthelightandthiscanbeusedtoestimatethecolourofthe illuminant. Whilechromagenicilluminantestimationoften workswellitcananddoesfailandsoisnotitselfadirect solutiontotheilluminantdetectionproblem. Inthispaper wedispensewiththegoalofilluminationestimationand seekonlytousethechromageniceffecttofindoutwhich partsofasceneareilluminatedbythesamelights. Thesimplestimplementationofourideainvolvesacombinatorial search. We precompute a dictionary of possibleilluminantrelations—thatmightmapRGBstofiltered counterparts—fromwhichweselectasmallnumber mcorrespondingtothenumberofdistinctlightswethinkmight bepresent. Eachpixel, orregion, isassignedtherelation fromthis m-setthatbestmapsfilteredtounfilteredRGB.All m-setsaretriedinturnandtheonethathastheminimum predictionerroroverallisfound. Attheendofthissearch processeachpixelorregionisassignedanintegerbetween 1and mindicatingwhichofthe mlightsarethoughtto haveilluminatedtheregion. Oursimplesearchalgorithmispossiblewhen m = 2 (and m = 3)andforthiscasewepresentexperimentsthat showourmethoddoesaremarkablejobindetectingilluminationinimages: ifthe2lightsareshadowandnonshadow, wefindtheshadowsalmosteffortlessly. Compared togroundtruthdata, ourmethoddeliversclosetooptimal performance.
Cite
Text
Finlayson et al. "Detecting Illumination in Images." IEEE/CVF International Conference on Computer Vision, 2007. doi:10.1109/ICCV.2007.4409089Markdown
[Finlayson et al. "Detecting Illumination in Images." IEEE/CVF International Conference on Computer Vision, 2007.](https://mlanthology.org/iccv/2007/finlayson2007iccv-detecting/) doi:10.1109/ICCV.2007.4409089BibTeX
@inproceedings{finlayson2007iccv-detecting,
title = {{Detecting Illumination in Images}},
author = {Finlayson, Graham D. and Fredembach, Clément and Drew, Mark S.},
booktitle = {IEEE/CVF International Conference on Computer Vision},
year = {2007},
pages = {1-8},
doi = {10.1109/ICCV.2007.4409089},
url = {https://mlanthology.org/iccv/2007/finlayson2007iccv-detecting/}
}