Please use this identifier to cite or link to this item: http://idr.nitk.ac.in/jspui/handle/123456789/11589
Full metadata record
DC FieldValueLanguage
dc.contributor.authorJeyaraj, R.
dc.contributor.authorAnanthanarayana, V.S.
dc.contributor.authorPaul, A.
dc.date.accessioned2020-03-31T08:35:20Z-
dc.date.available2020-03-31T08:35:20Z-
dc.date.issued2020
dc.identifier.citationConcurrency Computation , 2020, Vol.32, 7, pp.-en_US
dc.identifier.urihttp://idr.nitk.ac.in/jspui/handle/123456789/11589-
dc.description.abstractBig data is largely influencing business entities and research sectors to be more data-driven. Hadoop MapReduce is one of the cost-effective ways to process large scale datasets and offered as a service over the Internet. Even though cloud service providers promise an infinite amount of resources available on-demand, it is inevitable that some of the hired virtual resources for MapReduce are left unutilized and makespan is limited due to various heterogeneities that exist while offering MapReduce as a service. As MapReduce v2 allows users to define the size of containers for the map and reduce tasks, jobs in a batch become heterogeneous and behave differently. Also, the different capacity of virtual machines in the MapReduce virtual cluster accommodate a varying number of map/reduce tasks. These factors highly affect resource utilization in the virtual cluster and the makespan for a batch of MapReduce jobs. Default MapReduce job schedulers do not consider these heterogeneities that exist in a cloud environment. Moreover, virtual machines in MapReduce virtual cluster process an equal number of blocks regardless of their capacity, which affects the makespan. Therefore, we devised a heuristic-based MapReduce job scheduler that exploits virtual machine and MapReduce workload level heterogeneities to improve resource utilization and makespan. We proposed two methods to achieve this: (i) roulette wheel scheme based data block placement in heterogeneous virtual machines, and (ii) a constrained 2-dimensional bin packing to place heterogeneous map/reduce tasks. We compared heuristic-based MapReduce job scheduler against the classical fair scheduler in MapReduce v2. Experimental results showed that our proposed scheduler improved makespan and resource utilization by 45.6% and 47.9% over classical fair scheduler. 2019 John Wiley & Sons, Ltd.en_US
dc.titleImproving MapReduce scheduler for heterogeneous workloads in a heterogeneous environmenten_US
dc.typeArticleen_US
Appears in Collections:1. Journal Articles

Files in This Item:
There are no files associated with this item.


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.