Tags » Hadoop

GlusterFS 3.3: A scale-out data store for Apache Hadoop!

Recently an announcement is floating all over about GlusterFS 3.3. If you are keeping pace with the industrial news you must have heard about this latest development. 26 more words

Inside Yellow Pages’ SQL-on-Hadoop Journey

Like many national companies, scale is important for Yellow Pages, or YP as the company is now known. So when the Georgia-based local marketing firm set out to find a suitable SQL engine to deliver real-time analytics atop its 1,000-node Hadoop cluster, performance at scale was a prime directive. 59 more words

Business Intelligence

The YARN Revolution

YARN—the data operating system for Hadoop.  Bored yet? They should call it YAWN, right?

Not really—YARN is turning out be the biggest thing to hit big-data since Hadoop itself, despite the fact that it runs down in the plumbing of somewhere, and even some Hadoop users aren’t 100% clear on exactly what it does. 1,696 more words


Spark: Custom UDF Example

UDF (User defined functions) and UDAF (User defined aggregate functions) are key components of big data languages such as Pig and Hive. They allow to extend the language constructs to do adhoc processing on distributed dataset.  533 more words


Hive Dynamic Partion on stock data

HI ,

In this blog i will explain how can we do dynamic partiton .

Aim :- to create a table in which we dont want to define our partition column iin the end . 426 more words


Installing Hadoop on OSX El-Capitan

1. First Install HomeBrew, download it from http://brew.sh

$ ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"

2. Now Install Hadoop

$ brew install hadoop

Hadoop will be installed at path  1,006 more words


Hortonworks Acquires Onyara, Early Startup With Roots In NSA

Hortonworks, the big data company built on Hadoop, bought early-stage startup Onyara today. The company, which launched at the end of last year, has its roots in the NSA — yes that NSA. 6 more words