Abstract

Data warehousing technology has made a huge impact in the world of business; it helps to turn data into information that helps analysts to make strategic decisions. Currently most data warehouse approaches employ static refresh mechanisms. But for various business requirements this is not an appropriate solution. Some critical data need to be refreshed in real time. We propose an approach to identify critical data by considering two factors, namely: a) impact from one update, b) number of records affected. The identified critical data will be stored in the temporary tables, these temporary tables will be refreshed in real time and remaining data will be refreshed in conventional way

References

• Youchan Zhu, Lei An, Shuangxi Liu, "Data Updating and Query in Real-time Data Warehouse System", International Conference on Computer Science and Software Engineering, 2008, pp. 1295-1297
• Li Chen and Wenny Rahayu,David Taniar, "Towards Near Real-Time Data Warehousing", 24th IEEE International Conference on Advanced Information Networking and Applications, 2010, pp. 1150-1157
• JinGang Shi, YuBin Bao, FangLing Leng, Ge Yu, "Study on Log-Based Change Data Capture and Handling Mechanism in Real-Time Data Warehouse", International Conference on Computer Science and Software Engineering, 2008, pp. 478-481
• Dr. Muhammad Younus Javed, Asim Nawaz, "Data Load Distribution by Semi Real Time Data Warehouse", Second International Conference on Computer and Network Technology, 2010, pp. 556-560
• Paul Raj Poonia, "Fundamentals of Data Warehousing", John Wiley & Sons, 2003.
• Lukasz Golab, Theodore Johnson, and Vladislav Shkapenyuk, "Scheduling Updates in a Real-Time Stream Warehouse", IEEE International Conference on Data Engineering, 2009, pp. 1207-1210
• Kamber and Han, "Data Mining Concepts and Techniques", Hartcourt India P. Ltd. , 2001
• Xiaoliang Li, Fang Deng, Wensheng Li, "The Research and Application of an ETL Model Based on Task", The 1st International Conference on Information Science and Engineering, 2009, pp. 1006-1010
• Li Jian, Xu Bihua, "ETL Tool Research and Implementation Based on Drilling Data Warehouse", Seventh International Conference on Fuzzy Systems and Knowledge Discovery, 2010, pp. 2567-2569
• Michael J. Donahoo, Gregory D. Speegle,"SQL practical guide for developers", Elsevier Inc. , 2005
• Darshan M. Tank, Amit Ganatra, Y P Kosta, C K. Bhensdadia, "Speeding ETL Processing in Data Warehouses Using High-Performance Joins For Changed Data Capture (CDC)", International Conference on Advances in Recent Technologies in Communication and Computing, 2010, pp. 365-368
• Ricardo Jorge Santos, Jorge Bernardino, "Real-Time Data Warehouse Loading Methodology", IDEAS'08, Coimbra, Portugal Editor: Bipin C. DESAI, September 10–12, 2008, pp. 49-58
• Oracle Xi Reference Manual
• Sam Anahony, "Data Warehousing in the real world: A practical guide for building decision support systems", John Wiley, 2004
• W. H. Inmon, "Building the operational data store", 2nd Ed. , John Wiley, 1999.