The Apache Tez project is an extensible framework built on top of Apache Hadoop YARN. It is used to process data, that earlier took multiple MR jobs, now in a single Tez job which uses Directed Acyclic Graph (DAG) for data processing. It is used for building high performance batch and interactive data processing applications. It drastically improves… Continue reading What is Apache Tez?
The term Apache Pig refers to an open source scripting platform by Apache used for analyzing and processing large data sets. It allows users to write complex map reduce problems using a simple scripting language called Pig Latin. Pig translates the Pig Latin script into MapReduce so that it can be executed within YARN for access to a… Continue reading Term of the Week : Apache Pig
Micromanagement has a negative connotation associated with it and everyone fears it, rather hates it. It is a management style where a manager closely monitors the employees, observes or maybe even controls their work. Sometimes it is needed to ensure that tasks are performed in an expected and a precise manner. But, it might not just be… Continue reading Micromanagement and dangers associated with it
We know that marketing is important for any business. And, the success of any business or product relies heavily upon how well it is marketed. The marketing scene has changed tremendously over the past few years and with the advancement in technology, new ways are introduced for better and effective marketing. Outbound Marketing Do you… Continue reading Inbound Marketing vs. Outbound Marketing
Which one of them is your favorite – Hive or Pig? What do you prefer to work with? People often confuse as to when to use Hive and when to use Pig. And, while in most of the cases, either of it can be used, the question that arises is why both of them exist in… Continue reading Hive or Pig?
Apache Hive is a data warehouse infrastructure built on top of Hadoop which allows querying and managing large datasets residing in distributed storage. It provides an SQL-like language called as HiveQL with schema on read and transparently converts queries to map reduce, tez or spark jobs. All these execution engines run on Hadoop YARN. The HiveQL language also… Continue reading What is Apache Hive?
Image Source HDFS or the Hadoop Distributed File System, is a Java-based filesystem for storing large volumes of data in the Hadoop framework. It solves the problem of storing and managing enormous amounts of data with it’s high scalability, fault-tolerance, high availability and cost efficiency that make it so popular. Related Posts: HDFS and it’s features that make… Continue reading Term of the Week : HDFS
Emails are an important way to exchange messages, especially, in the professional scenario. An incorrect tone or irrelevant message can lead to a wrong message being conveyed to the recipient. There are times when the email is being skipped or ignored by the recipient because the message was not conveyed effectively. Hence, here are a… Continue reading 6 Tips to write an effective email
What is List Segmentation? List Segmentation is the process of dividing the list of users into sub groups based on certain parameters. It basically involves creating smaller lists from larger lists after applying some criteria. And, this can be done in many ways. As an example, I have created four segments in the picture above – People… Continue reading What is List Segmentation and why do we need it?
Pig has a simple yet rich data model which consists the following four types: Atom An atom consists of a single atomic value which can be a string or a number. Examples – ‘tom’ or 2 Tuple A tuple is a sequence of fields each of which can be of any datatype. Examples – (‘tom’, ‘california’) or… Continue reading Understanding Pig Data Model
MarketEng 