Friday "Term of the week" Series

Term of the Week : YARN

Apache Hadoop YARN (Yet Another Resource Negotiator) is a cluster management technology. ItĀ decouples MapReduce’s resource management and scheduling capabilities from the data processing component, enabling Hadoop to support more varied processing approaches and a broader array of applications. YARN, (or sometimes called as MR2), is an extended and an improved version of MR1. It was… Continue reading Term of the Week : YARN

Tuesday Big Data Series

What is a Fair Scheduler in Hadoop?

Fair Scheduler isĀ a pluggable scheduler for Hadoop that allows YARN applications to share resources in large clusters fairly. As the name suggests, it allocates resources such that all applications get an equal share. By default, this is done on the basis of the memory. But, i t can be configured to schedule with both memory… Continue reading What is a Fair Scheduler in Hadoop?