Abstract

Retrieval of multimedia has become a requirement for many contemporary information systems. These systems need to provide browsing, querying, navigation, and, sometimes, composition capabilities involving various forms of media. In this survey, we review techniques for text, image, audio and video retrieval. We first look at indexing and retrieval techniques for text, audio, image and video. We also discuss features visual features for video retrieval such as colour, texture, shape. The indexing techniques are discussed for these features. We also compare most popular techniques used for indexing and retrieval.

References

• Dufour, Y. Estève, P. Deléglise, and F. Béchet, "Local and global models for spontaneous speech segment detection andcharacterization," in ASRU 2009, Merano, Italy, 2009.
• Bazillon, Y. Estève, and D. Luzzati, "Manual vs assisted transcription of prepared and spontaneous speech," in LREC 2008, Marrakech, Morroco, 2008.
• S. Kankanhalli and Y. Rui, "Application Potential of Multimedia Information Retrieval", Proc. IEE, April 2008.
• Datta, D Joshi, J Li, and J. Wang, "Image Retrieval: Ideas, Influences, and Trends of the New Age", ACM Computing Surveys, VOl 40, No. 2, April 2008.
• P. Sinha and Ramesh Jain, "Concept Annotation and Search Space Decrement of Digital Photos using Optical Context Information", In Proceedings of SPIE, Multimedia content Access: Algorithms and System, January 2008.
• C. F. Wong and C. H. C. Leung. Automatic semantic annotation of real-world web images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(11):1933{1944, November 2008.
• Utz Westermann and Ramesh Jain," Towards a Common Event Model for Multimedia Applications", in IEEE Multimedia, January 2007.
• A. Scherp and R. Jain, "Towards an ecosystem for semantics", In Proceedings of Workshop on Many faces of Multimedia Semantics, at ACM Multimedia 2007, pp. 3-12, Sept. 2007. H. Yang, A. Dasdan, R. -L. Hsiao, and D. S. Parker. Map-Reduce-Merge: Simpli_ed relational data processing on large clusters. SIGMOD, 2007.
• Hampapur, A. Borger, S. Brown, L. Carlson, C. Connell, J. Lu, M. Senior, A. Reddy, V. Shu, C. Tian, Y. " S3: The IBM Smart Surveillance System: From Transactional Systems to Observational Systems," in Proc. Acoustics, Speech and Signal Processing, 2007. ICASSP April 2007.
• V. Patel, B. B. Meshram, "Retrieving and Summarizing Images from PDF Documents", International Conference on Soft computing and Intelligent Systems(ICSCSI-07), Jabalpur, India, 27-29 December 2007.
• B Liu, A. Gupta, and R. Jain, "MEDSMAN: a live multimedia stream querying system", Int. Journal of Multimedia Tools and Applications, 2007.
• S. Datta, C. Giannella, and H. Kargupta, " K-means clustering over a large, dynamic network", In Siam Conference of Data Mining, 2006. M. Lew, N. Sebe, C Djerba, and R. Jain, "Content-based Multimedia Information Retrieval: State of the Art and Challenges", ACM TOMCAPP vol. 2, No. 1, pp. 1-19, 2006.
• Milind Naphade , John R. Smith , Jelena Tesic , Shih-Fu Chang , Winston Hsu , Lyndon Kennedy , Alexander Hauptmann , Jon Curtis, "Large-Scale Concept Ontology for Multimedia," IEEE Multimedia, April 2006.
• Keiji Yanai, Kobus Barnard, "Finding Visual Concepts by Web Image Mining", in proc. Of WWW 2006, May 23–26, 2006, Edinburgh, Scotland.
• M. Flickher, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovicand D. Steele, and P. Yanker. "Query by image and video content: The QBIC system" In IEEE Computer, volume 38, pages 23-31, 1995.
• A. Pentland, R. W. Picard and S. Sclaroff," Photobook: Content-based manipulation of image databases",SPIE storage and Retrieval Image and video database II,No. 2185,Feb 6-10,1994,San Jose.
• R. Smith and S. -F. Chang, "VisualSEEk: a Fully Automated Content-Based Image Query System, Proceedings", ACM Multimedia '96 Conference, Boston, MA, November 1996.
• Avi Rappoport URL http://searchtools. com/tools/ retrievalware. html The report is availableonhttp:// www. dtic. mil/cgi-bin/GetTRDoc?AD=ADA252509& Location= U2&doc=GetTRDoc. pdf
• Stringa, Elena, Paul Meylemans, et al, "Image Retrieval byExample:Techniques and Demonstrations. " proceedings of ESARDA (European Safeguards Research and Development Association) Symposium on Safeguards and Nuclear Material Management, Bruges (Belgium). 2001.
• Shengjiu Wang, "A Robust CBIR Approach Using Local Color Histograms", technical report ,department of computer science, University of Alberta, Canada , 2001.
• M. Bressan D. Guillamet J. Vitrià, " Using an ICA representation of local color Histograms for object recognition, Pattern Recognition ,Volume 36, Issue 3, March 2003, Pages 691-701
• J. Han and K. Ma, "Fuzzy Color Histogram and Its Use in Color Image Retrieval",IEEE Trans. On Image Processing, vol. 11, pp. 944 – 952, Aug. 2002.
• Y. Rui, T. S. Huang and S. Chang, "Image Retrieval: Current Techniques, Promising Directions and Open Issues ", Journal of Visual Communication and Image Representation, vol. 10, pp. 39?62, March 1999.
• A. Bovik, Handbook of Image and Video Processing, 2nd Edition, Elsevier Academic Press, ISBN 0?12?119792?1, pp. 993?1013, 2005.
• Robert M Haralick, K Shanmugam, Its'hak Dinstein (1973). "Textural Features for Image Classification". IEEE Transactions on Systems, Man, and Cybernetics SMC-3 (6): 610–621.
• B. Jähne, H. Scharr, and S. Körkel. Principles of filter design. In Handbook of Computer Vision and Applications. Academic Press, 1999.
• H. Farid and E. P. Simoncelli, Optimally Rotation-Equivariant Directional Derivative Kernels, Int'l Conf Computer Analysis of Images and Patterns, pp. 207--214, Sep 1997.
• H. Farid and E. P. Simoncelli, Differentiation of discrete multi-dimensional signals, IEEE Trans Image Processing, vol. 13(4), pp. 496--508, Apr 2004.
• R. C. Gonzalez and R. E. Woods. Digital Image Processing. Addison-Wesley, Reading, MA, USA, 3rd edition, 1992.
• J. Smith and S. Chang. Tools and techniques for color image retrieval. In Proc. of the SPIE conference on the Storage and Retrieval for Image and Video Databases IV, pages 426–437, San Jose,CA, USA, 1996.
• M. A. Stricker and A. Dimai. Color indexing with weak spatial constraints. In Proc. of the SPIE conference on the Storage and Retrieval for Image and Video Databases IV, pages 29–40, San Diego,CA, USA, February 1996.
• W. Hsu, T. S. Chua, and H. K. Pung. An integrated color-spatial approach to content-based imageretrieval. In Proc. of the ACM Multimedia 95, pages 305–313, 1995.
• J. Li, Y. Tian, and W. Gao, "Exploring inter-frame correlation analysis and wavelet-domain modeling for real-time caption detection in streaming video," San Jose, CA, United states, 2008, p. The Society for Imaging Science and Technology (IS and T); The International Society for Optical Engineering (SPIE).