Abstract

The paper presents a new Cyber Physical Stream algorithm for selecting a predominant item from very large collections of data. The algorithm effectively works for frequencies of the predominant items starting from about 2%. The algorithm is focused on querying massive data in Software-Defined Storage combined with Fuzzy indexing method. Experiment results show that Cyber Physical Stream algorithm improves the accuracy and efficiency over previous efforts.

References

• "Understanding the DNA of Software Defined Storage", http://www. vmware. com/files/pdf/solutions/Understanding-the-DNA-of-Software-Defined-Storage-Tech-trends.
• "IBM software defined storage," http://www-03. ibm. com/systems/storage/software-defined-storage
• Moore, John. "Software-defined Storage Aims for Ease of Management. " Software-defined Storage Aims for Ease of Management -- FCW. May 23, 2014. Accessed October 12, 2014.
• "Australia : SOFTWARE Defined Storage Introduced by CloudCentral. " 2014. MENA Report. http://search. proquest. com/docview/1516630033?accountid=11243
• Simon Berkovich, "Intelligent Software Defined Storage", in Proceedings of the 5th international Conference on Computing for Geospatial Research & Application, Washington, D. C. , 2014. COM. Geo
• Adi Alhudhaif, Tong Yan and Simon Berkovich. "On the organization of cluster voting with massive distributed streams", in Proceedings of the 5th international Conference on Computing for Geospatial Research & Application, Washington, D. C. , 2014. COM. Geo
• Simon Berkovich, Duoduo Liao, "On clusterization of big data streams", COM. Geo '12 Proc. of the 3rd International Conference on Computing for Geospatial Research and Applications, ACM, New York, 2012
• Simon Berkovich, ""Organization of the Brain in Light of the Big Data Philosophy", COM. BigData' 14 Proc. of the 1st International Summits on Big Data Computing, IEEE, Washington DC, 2014.
• M. Yammahi, K. Kowsari, Chen. Shen and Simon Berkovich, "An efficient technique for searching very large files with fuzzy criteria using the Pigeonhole Principle", COM. BigData' 14 Proc. of the 1st International Summits on Big Data Computing, IEEE, Washington DC, 2014.
• H. Thomason, " Consciousness on-off switch discovered deep in brain", New Scientist. Retrieved from http://www. newscientist. com/article/mg22329762. 700-consciousness-onoff-switch-discovered-deep-inbrain. html#. U80nJBbZXdl
• Alon, Noga, Yossi Matias, and Mario Szegedy. "The space complexityof approximating the frequency moments. " Proceedings of the 28thannual ACM symposium on Theory of computing. ACM, 1996
• Babcock, Brian; Babu, Shivnath; Datar, Mayur; Motwani, Rajeev;Widom, Jennifer (2002), "Models and issues in data stream systems",Proceedings of the 21st ACM SIGMOD-SIGACT-SIGART Symposiumon Principles of Database Systems (PODS 2002), pp. 1–16,doi:10. 1145/543613. 543615
• Abadi, Daniel J. , et al. "The Design of the Borealis Stream Processing Engine. " CIDR. Vol. 5. 2005.
• Rosten, Edward, and Tom Drummond. "Machine learning for highspeed corner detection. " Computer Vision–ECCV 2006. Springer Berlin Heidelberg, 2006. 430-443.
• N. Gruschka, M. Jensen, L. Iacono, and N. Luttenberger, "Server-side streaming processing of WS-Security," IEEE Transactions on Services Computing, vol. 4, no. 4, pp. 272–285, 2011.
• D. Terry, D. Goldberg, D. Nichols, and B. Oki. Continuous queries over append-only databases. In Proc. of the 1992 ACM SIGMOD Intl. Conf. on Management of Data, pages 321–330, June 1992.
• Boyer, R. S. , Moore, J. S. A fast majority vote algorithm. Technical Report ICSCA-CMP-32, Institute for Computer Science, University ofTexas (Feb. 1981)
• Noga Alon, Yossi Matias, and Mario Szegedy. The space complexity of approximating the frequency moments. Journal of Computer and System Sciences, 58(1):137–147, 1999.
• Monika Henzinger, Prabhakar Raghavan, and Sridhar Rajagopalan. Computing on data streams. Technical Report SRC TR 1998-011, DEC, 1998.
• M. Fang, N. Shivakumar, H. Garcia-Molina,R. Motwani, and J. D. Ullman. Computing icebergqueries efficiently. In Proc. of VLDB, 1998.
• R. Agrawal and R. Srikant. Fast algorithms for mining association rules. In Proc. of VLDB, 1994.
• C. Estan and G. Varghese. New directions in trafficmeasurement and accounting. In Proc. of ACMSIGCOMM, 2002.
• Richard Durstenfeld, Algorithm 235: Random permutation, Communications of the ACM, v. 7 n. 7, p. 420, July 1964.
• Fisher, Ronald A. ; Yates, Frank (1948)
• . Statistical tables for biological, agricultural and medical research (3rd ed. ). London: Oliver & Boyd. pp. 26–27.