Pig has a simple yet rich data model which consists the following four types: Atom An atom consists of a single atomic value which can be a string or a number. Examples – ‘tom’ or 2 Tuple A tuple is a sequence of fields each of which can be of any datatype. Examples – (‘tom’, ‘california’) or… Continue reading Understanding Pig Data Model
Pig is an open source scripting platform by Apache used for analyzing and processing large data sets. It allows users to write complex map reduce problems using a simple scripting language called Pig Latin. Pig translates the Pig Latin script into MapReduce so that it can be executed within YARN for access to a single dataset stored… Continue reading Apache Pig and it’s awesome features!
Image Source An email is said to have bounced when it fails to reach the recipient’s mailbox and is left undelivered. It is quite common and can happen because of a number of reasons. Based on these reasons they can be divided into two categories Hard Bounce and Soft Bounce. In the world of email marketing, not all emails… Continue reading Term of the Week : Bounce
Whether one admits or not, everyone dreads the situation of giving or receiving a negative feedback. While being on the receiving end is sometimes painful and heart-breaking, giving one is no less. If you have been in a managerial role for quite some time now, or if this is your first time, take a deep… Continue reading The art of giving a negative feedback
Every Hadoop system has an Hadoop Administrator and Hadoop users/developers. The Administrator is responsible for deployment and maintenance of the entire infrastructure. He is responsible for cluster availability, file system management, security, installation of latest updates, and all other things that need to keep the system up and running. The administrator is also responsible for… Continue reading Understanding HDFS quotas
Why do we need Oozie? The Hadoop stack consists of a variety of tools like Pig, Map Reduce, Hive, HBase, Sqoop etc. At times, when dealing with large data sets, we might have to use a combination of either of these technologies along with plain old Java, Python, Perl or shell scripts to get work done… Continue reading What is Oozie?
People outside of project management think that, all a project manager does is write emails, conducts meetings and that’s it. But, the role of a project manager is really not what it looks like from the outside. He has many challenges to face on a daily basis. Some of the challenges or obstacles need to… Continue reading Challenges faced while managing a team
In post that explains the HDFS architecture, we saw that HDFS namespace is stored and maintained by NameNode. What is HDFS Namespace? Namespace is a hierarchy of directories, files and blocks in HDFS. It supports file system operations such as creation, modification, deletion and listing of files and directories. One of the important features of HDFS is… Continue reading HDFS: Filesystem Metadata and how it persists
A bounced email means that the email was never delivered to the recipient. Does it happen? Yes! Does it happen often? Yes, can happen often! Why does it happen? Well, let’s see the reasons- 1. Recipient mailbox is full or has exceeded his quota- An email will bounce until there is space for it in the… Continue reading 7 Reasons why your email may have bounced
Scrum is a framework to implement agile methodology for product development. Scrum projects develop the product in iterations. These iterations are fixed-length and are called Sprints. The sprint could last a week, or two weeks or even a month. This can be decided by studying the nature of the project. Every sprint has an end that is called… Continue reading Term of the Week : Scrum
MarketEng 