Research Article
Scheduling for Energy Efficiency with Hadoop
|
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
|
| Volume 186 - Issue 23 |
| Published: May 2024 |
| Authors: Sebagenzi Jason |
10.5120/ijca2024923678
|
Sebagenzi Jason . Scheduling for Energy Efficiency with Hadoop. International Journal of Computer Applications. 186, 23 (May 2024), 22-34. DOI=10.5120/ijca2024923678
@article{ 10.5120/ijca2024923678,
author = { Sebagenzi Jason },
title = { Scheduling for Energy Efficiency with Hadoop },
journal = { International Journal of Computer Applications },
year = { 2024 },
volume = { 186 },
number = { 23 },
pages = { 22-34 },
doi = { 10.5120/ijca2024923678 },
publisher = { Foundation of Computer Science (FCS), NY, USA }
}
%0 Journal Article
%D 2024
%A Sebagenzi Jason
%T Scheduling for Energy Efficiency with Hadoop%T
%J International Journal of Computer Applications
%V 186
%N 23
%P 22-34
%R 10.5120/ijca2024923678
%I Foundation of Computer Science (FCS), NY, USA
Abstract
The main topic of this chapter is Hadoop energy efficiency scheduling, which includes an overview of the system, scheduling techniques, and the creation and application of a Hadoop energy control system. Additionally, testing, analysis, and introduction are provided for energy-efficient scheduling for multiple users.
References
- Leverich J, Kozyrakis C. On the energy (in)efficiency of Hadoop clusters. SIGOPS Oper Syst Rev. 2010;44(1):61–65.
- Chen Y, Ganapathi AS, Fox A, Katz RH, Patterson DA. Statistical workloads for energy efficient MapReduce : Technical Report Berkeley: UCB/EECS; 2010.
- Chen Y, Keys L, Katz. RH. Towards energy efficient MapReduce: Technical Report Berkeley: UCB/EECS; 2009.
- Nedevschi S, Popa L, Iannaccone G, et al. Reducing network energy consumption via rate-adaption and sleeping: Technical Report Berkeley: UCB/EECS; 2007.
- Polo J, Carrera D, Becerra Y, Beltran V, Torres J, Ayguad E. Performance management of accelerated MapReduce workloads in heterogeneous clusters. ICPP2010 2010:653–62.
- Xie J, Yin S, Ruan X, Ding Z, Tian Y, Majors J, et al. Improving MapReduce performance through data placement in heterogeneous Hadoop clusters. IPDPSW 2010:1–9.
- Polo J, Carrera D, Becerra Y, Beltran V, Torres J, Ayguadé E. Performance management of accelerated MapReduce workloads in heterogeneous clusters. Proceedings of the ICPP San Diego, CA: IEEE Press; 2010; p. 653–62.
- Kim KH, Buyya R, Kim J. Power aware scheduling of bag-of-tasks applications with deadline constraints on DVS-enabled clusters. CCGRID. 2007;85(10):541–548.
- Lee YC, Zomaya AY. Minimizing energy consumption for precedence-constrained applications using dynamic voltage scaling. CCGRID. 2009;9:92–99.
- Cooper BF, Sillberstein A, Tam E, et al. Benchmarking cloud serving systems with YCSB, SoCC’10 2010;10:143–54.
- Bryhni H, Klovning E, Kurc O. A comparison of load balancing techniques for scalable web server. IEEE Newt. 2000;7/8:58–63.
- Verma A, Cherkasova L, Campbell RH. Orchestrating an ensemble of MapReduce jobs for minimizing their makespan. IEEE Trans Dependable Sec Comput. 2013; April [online version].
- Verma A, Cherkasova L, Campbell RH. Two sides of a coin: optimizing the schedule of MapReduce jobs to minimize their makespan and improve cluster performance. p. 11–18 MASCOTS Washington, DC: IEEE Computer Society; 2012.
- Verma A, Cherkasova L, Campbell RH. ARIA: automatic resource inference and allocation for MapReduce environments. In: Proc. of ICAC; 2011.
- .
- Johnson S. Optimal two-and three-stage production schedules with setup times included. Naval Res Log Quart. 1954;1(1):61–68.
- 17.WordCount,.
- Beloglazov A, Abawajy J, Buyya R. Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Future Generation Comput Syst. 2012;28(5):755–7
Index Terms
Keywords