Abstract

Shadow detection and removal has had great interest in computer vision especially in outdoor environments. It is an important task for visual tracking, object recognition, and many other important applications. One of the fundamental challenges for accurate tracking is achieving invariance to shadows. Two or more separate objects can appear to be connected through shadows. Many algorithms have been proposed in the literature that deal with shadows. However, the problem remains largely unsolved and needs further research effort. This paper proposes a method for removing cast shadows from vehicles in outdoor environments. The proposed method employs the estimated background model of the video sequence and applies a Gamma decoding followed by a thresholding operation. Experimental results show the success of the proposed method in detecting and removing shadows robustly and leads to considerable improvements in multiple object tracking.

References

• Francesc Serratosa, René Alquézar, and Nicolás Amézquita, "A Probabilistic Integrated Object Recognition and Tracking Framework," In the International Journal of Expert Systems with Applications, Volume 39, Issue 8, pp. 7302-7318, June 2012.
• Zhongna Zhou, T. X. Han, and Zhihai He, "Semi-Supervised Learning for Robust Car Windshield Tracking and Monitoring in Live Traffic Videos," In Proceedings of the 19th IEEE International Conference on Image Processing (ICIP), Orlando, Florida, USA, pp. 489-492, September 2012.
• Kostia Robert, "Video-Based Traffic Monitoring at Day and Night Vehicle Features Detection Tracking," In Proceedings of the 12th International IEEE Conference on Intelligent Transportation Systems (ITSC'09), St. Louis, USA, pp. 1-6, October 2009.
• King-Wah Pang, "An Adaptive Parallel Route Construction Heuristic for the Vehicle Routing Problem with Time Windows Constraints," In the International Journal of Expert Systems with Applications, Volume 38, Issue 9, pp. 11939-11946, September 2011.
• Bin Chen, QingYao Wei, Cao He, and JianBo Wang, "Study of Expressway Traffic Simulations System Influence of Accident," In Proceedings of the 2010 International Conference on Optoelectronics and Image Processing (ICOIP'10), Volume 02, pp. 411-415, November 2010.
• Ryan P. Avery, Guohui Zhang, Yinhai Wang, and Nancy L. Nihan, "Investigation into Shadow Removal from Traffic Images," In the International Journal of Transportation Research Record, pp. 70-77, 2007.
• S. A. Lakhotiya, M. D. Ingole, and M. S. Joshi "Human Object Tracking using Background Subtraction and Shadow Removal Technique," In the International Journal of Computer Science and Applications, Volume 6, Number 2, pp. 117-121, April 2013.
• Nijad Al-Najdawi, Helmut E. Bez, Jyoti Singhai , and Eran. A. Edirisinghe, "A Survey of Cast Shadow Detection Algorithms," In the Journal of Pattern Recognition Letters, Volume 33, Issue 6, pp. 752–764, April 2012.
• Ye-Peng Guan, "Texture and Space-Time Based Moving Objects Segmentation and Shadow Removing," In Proceedings of the Third International Conference on Advances in Swarm Intelligence (ICSI'12), Shenzhen, China, Volume Part II, pp. 244-253, June 2012.
• Andres Sanin, Conrad Sanderson, and Brian C. Lovell, "Shadow Detection: A Survey and Comparative Evaluation of Recent Methods," In the Journal of Pattern Recognition, Volume 45, Issue 4, pp. 1684-1695, April 2012.
• Andrea Prati, Ivana Miki, Mohan M. Trivedi, Rita Cucchiara, "Detecting Moving Shadows: Algorithms and Evaluation," In IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume: 25, Issue: 7, pp. 918 - 923, July 2003.
• Qiang He, and Chee-Hung Henry Chu, "A New Shadow Removal Method for Color Images," In the Journal of Advances in Remote Sensing, Volume 2, Number 2, pp. 77-84, June 2013.
• Shen-Chi Tien, and Tsorng-Lin Chia, "Positioning a Point Target in an Aerial Image," In Digital Signal Processing Journal, Volume 19, Issue 5, pp. 874-889, September 2009.
• Kartik Chandra, Neeharika Adabala, and Kentaro Toyama, "Aerial Image Relighting: Simulating Time of Day Variations," In Proceedings of the 24th International Conference on Advances in Computer Graphics (CGI 2006), Hangzhou, China, pp. 594-605, June 2006.
• Hiroshi Kawasaki, and Ryo Furukawa, "Shape Reconstruction and Camera Self-Calibration Using Cast Shadows and Scene Geometries," In the International Journal of Computer Vision, Volume 83, Issue 2, pp. 135-148, June 2009.
• Christian Wöhler, Kia Hafezi, "A General Framework for Three-Dimensional Surface Reconstruction by Self-Consistent Fusion of Shading and Shadow Features," In Pattern Recognition Journal, Volume 38, Issue 7, pp. 965-983, July 2005.
• Mark S. Drew, Yacov Hel-Or, Tom Malzbender, Nasim Hajari, "Robust Estimation of Surface Properties and Interpolation of Shadow/Specularity Components" In Image and Vision Computing Journal, Volume 30, Issue 4-5, pp. 317-331, May 2012.
• James P. O'Shea, Martin S. Banks, and Maneesh Agrawala, "The Assumed Light Direction for Perceiving Shape from Shading," In Proceedings of the 5th Symposium on Applied Perception in Graphics and Visualization (APGV '08), Los Angeles, California, USA, pp. 135-142, August 2008.
• R. Girisha, and S. Murali, "Self Shadow Elimination Algorithm for Surveillance Videos Using ANOVA F Test," In Proceedings of the Third Annual ACM Bangalore Conference (COMPUTE '10), Bangalore, India, Article No. 12, January 2010.
• M. Xiao, C. Z. Han, L. Zhang, "Moving Shadow Detection and Removal for Traffic Sequences," In the International Journal of Automation and Computing, Volume 4, Issue 1, pp. 38-46, January 2007.
• Pankaj Kumar, "Intrinsic Image Based Moving Object Cast Shadow Removal in Image Sequences," In Proceedings of the 2011 International Conference on Digital Image Computing: Techniques and Applications (DICTA '11), pp. 410-415, December 2011.
• Xue Li, Yu-Jin Zhang, and Bao-Di Liu, "Robust Moving Cast Shadows Detection and Removal with Reliability Checking of the Color Property," In Proceedings of the Sixth International Conference on Image and Graphics (icig'11), Hefei, Anhui, China, pp. 440-445, August 2011.
• Y. Matsushita, K. Nishino, K. Ikeuchi, and M. Sakauchi, "Illumination Normalization with Time-Dependent Intrinsic Images for Video Surveillance," In IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Volume 26, Issue 10, pp. 1336-1347, October 2004.
• Yang Wang, "Real-Time Moving Vehicle Detection with Cast Shadow Removal in Video Based on Conditional Random Field," In IEEE Transactions on Circuits and Systems for Video Technology, Volume 19, Issue 3, pp. 437-441, March 2009.
• Chin-Teng Lin, Chien-Ting Yang, Yu-Wen Shou, Tzu-Kuei Shen "An Efficient and Robust Moving Shadow Removal Algorithm and its Applications in ITS," In EURASIP Journal on Advances in Signal Processing, Volume 2010, Article No. 39, February 2010.
• A. J. Joshi, S. Atev, O. Masoud, N. Papanikolopoulos, "Moving Shadow Detection with Low- and Mid-Level Reasoning," In Proceedings of the IEEE International Conference on Robotics and Automation, Roma, Italy, pp. 4827-4832, April 2007.
• Chen Wei-Gang, Xu Bin, "Detecting Moving Shadows in Video Sequences Using Region Level Evaluation for Vision-Based Vehicle Detection," In Proceedings of the 2010 Fifth International Conference on Frontier of Computer Science and Technology (FCST '10), pp. 142-146, August 2010.
• Vikas Reddy, Conrad Sanderson, and BrianC Lovell, "A Low-Complexity Algorithm for Static Background Estimation from Cluttered Image Sequences in Surveillance Contexts," In EURASIP Journal on Image and Video Processing, Special issue on advanced video-based surveillance archive, Volume 2011, Article No. 1, January 2011.
• Mehmet Sezgin,and Bulent Sankur, "Survey Over Image Thresholding Techniques and Quantitative Performance Evaluation," In the Journal of Electronic Imaging, Volume 13, Issue 1, pp. 146-168, Jan 2004.
• Kuo-Liang Chung, Wan-Yu Chen, "Fast Adaptive PNN-based Thresholding Algorithms," In Pattern Recognition Journal, Volume 36, Issue 12, pp. 2793 – 2804, December 2003.
• N. Goyette, P. -M. Jodoin, F. Porikli, J. Konrad, and P. Ishwar, "Changedetection. net: A New Change Detection Benchmark Dataset," In Proceedings of the IEEE Workshop on Change Detection (CDW-12), Providence, Rhode Island, USA, pp. 1-8, June 2012.
• Jia-Bin Huang, and Chu-Song Chen, "Moving Cast Shadow Detection Using Physics-Based Features," In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, Florida, USA, pp. 2310–2317, June 2009.
• Yuhong Jia, Xiaoxi Yu, Jiangyan Dai, Wanjun Hu, Jun Kong, and Miao Qi, "A Novel Moving Cast Shadow Detection of Vehicles in Traffic Scene," Intelligent Science and Intelligent Data Engineering Lecture Notes in Computer Science, Springer, Volume 7751, pp. 115-124, 2013.
• Bangyu Sun, Shutao Li, "Moving Cast Shadow Detection of Vehicle Using Combined Color Models," In the Proceedings of the Chinese Conference on Pattern Recognition (CCPR), China, pp. 1–5, October 2010.
• Andres Sanin, Conrad Sanderson, and Brian C. Lovell, "Improved Shadow Removal for Robust Person Tracking in Surveillance Scenarios," In Proceedings of the International Conference on Pattern Recognition, Istanbul, Turkey, pp. 141–144, August 2010.
• JinMin Choi, Yung Jun Yoo, Jin Young Choi, "Adaptive Shadow Estimator for Removing Shadow of Moving Object," In the Journal of Computer Vision and Image Understanding, Volume 114, Issue 9, pp. 1017-1029, September 2010.