This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License
|
||||||||
|
Paper Details
Paper Title
Scheduling Techniques for Workload Distribution in YARN Containers
Authors
  Rajneesh Kumar,  Dr. S.Govindarajan
Abstract
Big Data, the analysis of large quantities of data to gain new insight has become a ubiquitous phrase in recent years. Day by day the data is growing at a staggering rate. One of the efficient technologies that deal with the Big Data is Hadoop, which will be discussed in this paper. Hadoop, for processing large data volume jobs uses MapReduce programming model. Hadoop makes use of different schedulers for executing the jobs in parallel. The default scheduler is FIFO (First In First Out) Scheduler. Other schedulers with priority, pre-emption and non-pre-emption options have also been developed. As the time has passed the MapReduce has reached few of its limitations. So in order to overcome the limitations of MapReduce, the next generation of MapReduce has been developed called as YARN (Yet Another Resource Negotiator). So, this paper provides a survey on Hadoop, few scheduling methods it uses and a brief introduction to YARN.
Keywords- Hadoop, HDFS, MapReduce, Schedulers, YARN
Publication Details
Unique Identification Number - IJEDR1502013Page Number(s) - 66-70Pubished in - Volume 3 | Issue 2 | May 2015DOI (Digital Object Identifier) -    Publisher - IJEDR (ISSN - 2321-9939)
Cite this Article
  Rajneesh Kumar,  Dr. S.Govindarajan,   "Scheduling Techniques for Workload Distribution in YARN Containers", International Journal of Engineering Development and Research (IJEDR), ISSN:2321-9939, Volume.3, Issue 2, pp.66-70, May 2015, Available at :http://www.ijedr.org/papers/IJEDR1502013.pdf
Article Preview
|
|
||||||
|