Abstract

This paper presents an introduction to novel saliency-aware weighting and edge-aware weighting for HDR images. These techniques are incorporated into an existing guided image filter to form a perceptually guided image filter. The saliency-aware weighting and the new filter are applied to design a new local tone-mapping algorithm for HDR images such that both extreme light and shadow regions can be reproduced on conventional low dynamic range displays. The Visual-Salience-Based Tone Mapping (VSBTM) filter preserves sharp edges in the base layer better than the existing guided filter. Halo artifacts are thus significantly reduced in the tone-mapped image. Moreover, the visual quality of the tone-mapped image, especially attention-salient regions, is improved by the saliency-aware weighting. Pseudo-Multiple-Exposure-Based Tone Fusion (PMEBTF) gives a region-based enhancement on the pseudo-exposures to boost details in the most distinct region. Thereby the region-enhanced pseudo-exposures are fused into an HDR image. The fused image thus enhances details in the bright region of the dark image and the dark region of the bright image.

References

• P. E. Debevec and J. Malik, Aug. 1997, “Rendering high dynamic range radiance maps from photographs,” in Proc. SIGGRAPH, Los Angeles, CA, USA.
• J. Li, Y. H. Tian, T. J. Huang, and W. Gao, Nov. 2010, “Probabilistic multi-task learning for visual saliency estimation in video,” Int. J. Comput. Vis., vol. 90, no. 2, pp. 150–165.
• E. Reinhard, G. Ward, S. Pattanaik, and P. E. Debevec, 2005, High Dynamic Range Imaging: Acquisition, Display and Image-Based Lighting. San Mateo, CA, USA: Morgan Kaufmann.
• R. Fattal, D. Lischinski, and M.Werman, Jul. 2002, “Gradient domain high dynamic range compression,” ACMTrans. Graphics, vol. 27, no. 3, pp. 67:1–67:10.
• Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski, Aug. 2008, “Edge-preserving decompositions for multi-scale tone and detail manipulation,” ACM Trans. Graphics, vol. 21, no. 3, pp. 249–256.
• K. He, J. Sun, and X. Tang, Jun. 2013, “Guided image filtering,” IEEE Trans. Pattern Anal. Mach. Learn., vol. 35, no. 6, pp. 1397–1409.
• L. Itti, C. Koch, and E. Niebur, Nov. 1998 , “Amodel of saliency-based visual attention for rapid scene analysis,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254–1259.
• F. Perazzi, P. Krahenbuhl, Y. Pritch, and A. Hornung, Jun. 2012 , “Saliency filters: Contrast based filtering for salient region detection,” in Proc. IEEE Int. Conf. Comput. Vis., Providence, RI, USA, pp. 733–740.
• S. Lu and J. H. Lim, Oct. 2012 , “Saliency modeling from image histograms,” in Proc. 12th Eur. Conf. Comput. Vis., Florence, Italy, pp. 321–332.
• S. Lu, C. Tan, and J. H. Lim, Jan. 2014, “Robust and efficient saliency modeling from image co-occurrence histograms,” IEEE Trans. Pattern Anal. Mach. Learn., vol. 36, no. 1, pp. 195–201.
• R. Shen, I. Cheng, and A. Basu, Jun. 2013, “QoE-based multi-exposure fusion in hierarchical multivariate Gaussian CRF,” IEEE Trans. Image Process., vol. 22, no. 6, pp. 2469–2478.
• E. Reinhard, Nov. 2003, “Parameter estimation for photographic tone reproduction,” J. Graphics Tools, vol. 7, no. 1, pp. 45–51.
• J. Kuang, H. Yamaguchi, C. Liu, G. M. Johnson, and M. D. Fairchild, Jul. 2007, “Evaluating HDR rendering algorithms,” ACM Trans. Appl. Perception, vol. 2, no. 4, pp. 9:1–9:27.
• Zhengguo Li and Jinghong Zheng, Dec. 2014, “Visual-Salience-Based Tone Mapping for High Dynamic Range Images” IEEE Transactions On Industrial Electronics, Vol. 61, No. 12.
• Tsun-Hsien Wang, Cheng-Wen Chiu, Wei-Chen Wu, Jen-Wen Wang, Chun-Yi Lin, Ching-Te Chiu, and Jing-Jia Liou, April 2015, “Pseudo-Multiple-Exposure-Based Tone Fusion with Local Region Adjustment” IEEE Transactions On Multimedia, Vol. 17, No. 4.
• E. Reinhard, T. Kunkel, Y. Marion, J. Brouillat, R. Cozot, and K. Bouatouch, Dec. 2007, “Image display algorithms for high and low dynamic range display devices,” J. Soc. Inf. Display, vol. 15, no. 12, pp. 997–1014.
• F. Banterle, A. Artusi, K. Debattista, and A. Chalmers, 2011, “Advanced High Dynamic Range Imaging: Theory and Practic”. Natick, MA, USA.
• P. Didyk, R. Mantiuk, M. Hein, and H.-P. Seidel, 2008, “Enhancement of bright video features for HDR displays,” in Comput. Graphics Forum (Proc. Eurograph. Symp. Rendering 2008 Sarajevo, Bosnia, Herzegovina), vol. 27, no. 4, pp. 1265–1274.
• L. Meylan, S. Daly, and S. Süsstrunk, 2006, “The reproduction of specular highlights on high dynamic range displays,” in Proc. IS&T/SID 14th Color Imaging Conf., 2006, pp. 333–338.
• L. Meylan, S. Daly, and S. Susstrunk, 2007, “Tone mapping for high dynamic range displays,” in Proc. IS&T/SPIE Electron. Imaging: Human Vis. Electron. Imaging XII, vol. 6492, pp. 649210–1–649210–12.
• F. Banterle, P. Ledda, K. Debattista, and A. Chalmers, 2006, “Inverse tone mapping,” in Proc. GRAPHITE, pp. 349–356.
• L. Wang, L.-Y. Wei, K. Zhou, B. Guo, and H.-Y. Shum, 2007, “High dynamic range image hallucination,” in Proc. ACM SIGGRAPH 2007.
• E. Reinhard, M. Stark, P. Shirley, and J. Ferwerda, 2002, “Photographic tone reproduction for digital images,” ACM Trans. Graph., vol. 21, no. 3, pp. 267–276.
• K. K. Biswas and S. N. Pattanaik, 2005, “A simple spatial tone mapping operator for high dynamic range images operator for high dynamic range images,” in Proc. IS&T/SID 13th Color Imaging Conf., pp. 291–296.
• G. Messina, A. Catorina, S. Battiato, and A. Bosco, Jul. 2003, “Image quality improvement by adaptive exposure correction techniques,” in Proc. IEEE Int. Conf. Multimedia Expo, vol. 1, pp. I-549–I-552.