Abstract

Person tracking using facial recognition has emerged as a crucial technology in surveillance, security, and human-computer interaction applications. This paper presents a comprehensive framework that integrates advanced facial detection, feature extraction, and tracking methodologies to robustly identify and monitor individuals in video streams. The approach in this paper combines stateof- the-art computer vision techniques with deep learning-based facial recognition to achieve real-time performance while maintaining high accuracy. The system integrates YOLO for object detection and DeepFace for facial recognition, offering an efficient solution for real-time person tracking. Additionally, the framework extends beyond individual tracking by incorporating intelligent analysis for detecting traffic violations, monitoring criminal activities, and identifying civic issues such as unauthorized encroachments or safety hazards. By leveraging existing surveillance infrastructure, this system enhances preventive policing and response times, making urban spaces safer and more efficient. The system is built using widely available open-source libraries and is designed for scalability across various camera setups. Experimental results demonstrate that this framework provides effective tracking and identification even under challenging conditions such as occlusions, varied lighting, and rapid movements.

References

• Vipin Gautam, Shitala Prasad, Sharad Sinha, “YOLORe-IDNet: An Efficient Multi-Camera System for Person-Tracking”. arXiv:2309.13387, https://doi.org/10.48550/arXiv.2309.13387
• Divya Nimma, Omaia Al-Omari, Rahul Pradhan, Zoirov Ulmas, R.V.V. Krishna, Ts. Yousef A.Baker El-Ebiary, Vuda Sreenivasa Rao, “Object detection in real-time video surveillance using attention based transformer-YOLOv8 model”. https://doi.org/10.1016/j.aej.2025.01.032
• Yaniv Taigman, Ming Yang, Marc’Aurelio Ranzato, Lior Wolf, “DeepFace: Closing the Gap to Human-Level Performance in Face Verification”. https://doi.org/10.1109/CVPR.2014.220
• Hardie Cate, Fahim Dalvi, Zeshan Hussain, “Deep- Face: Face Generation using Deep Learning”. https://doi.org/10.48550/arXiv.1701.01876
• Samay Durgadas Sawal, Shailendra Singh Kathait, Ashish Kumar, Ram Patidar, Khushi Agrawal, “Computer Vision and Deep Learning based Approach for Traffic Violations due to Over-speeding and Wrong Direction Detection”. doi: 10.5120/ijca2025924477
• Samay Durgadas Sawal, Shailendra Singh Kathait, Ashish Kumar, Ram Patidar, Khushi Agrawal, “Computer Vision and Deep Learning based Approach for Violations due to Illegal Parking Detection ”. doi: 10.5120/ijca2025924506
• Qiang Li, Li Ranyang, Kaifan Ji,Wei Dai, “Kalman Filter and Its Application”. doi: 10.1109/ICINIS.2015.35
• Redmon et al., “You Only Look Once: Unified, Real-Time Object Detection,” CVPR, 2016
• Evgeniy Bart, Shimon Ullman. ”Image normalization by mutual information”, DOI:10.5244/C.18.35
• Alfirna Rizqi Lahitani, Adhistya Erna Permanasari, Noor Akhmad Setiawan. ”Cosine similarity to determine similarity measure: Study case in online essay assessment”. DOI: 10.1109/CITSM.2016.7577578
• Shailendra Singh Kathait, Ashish Kumar, Ram Patidar, Khushi Agrawal, Samay Sawal (2024). Deep Learning-based Approach for Detecting Traffic Violations Involving No Helmet Use and Wrong Cycle Lane Usage. International Journal of Computer Applications, DOI: 10.5120/ijca2025924714
• Shailendra Singh Kathait, Ashish Kumar, Ram Patidar, Khushi Agrawal, Samay Sawal (2024). Deep Learning-Based Person Tracking: A Smart Approach to Security and Civic Monitoring. International Journal of Computer Applications, Paper ID: 29a9ea08-9445-44d3-afc7-78ebb9b39247
• Shailendra Singh Kathait, Ashish Kumar, Ram Patidar, Khushi Agrawal, Samay Sawal (2024). Computer Vision and Deep Learning based Approach for Traffic Violations due to Over-speeding and Wrong Direction Detection. International Journal of Computer Applications, paper-id: 6e503f15-f6c9- 4ee2-9212-4db588484729, DOI: 10.5120/ijca2025924477
• Shailendra Singh Kathait, Ashish Kumar, Ram Patidar, Khushi Agrawal, Samay Sawal (2024). Computer Vision and Deep Learning based Approach for Violations due to Illegal Parking Detection. International Journal of Computer Applications, DOI: 10.5120/ijca2025924506