Tags » Hadoop

Hadoop 1.21 Name node startup issue

While I was trying to poke around in hadoop environment I noticed that namenode wouldn’t start up. After doing some research I found that its the IPv6 issue. 98 more words

Hadoop

Operation not permitted error while bringing up the start-all service -Hadoop Startup

I followed  Michael Knoll blog to configure the hadoop on my Ubuntu 14.04

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/

these are the two information I felt was required for my set up to be right and up and running… 127 more words

Hadoop

HDFS viewing the block size

You view the block size of the data using this. Usually hadoop will run one mapper per block.

hadoop fsck  

hadoop fsck /user/root/identity/input/qa  -files -blocks… 46 more words

Hadoop

Open Source Cloud Formation with Minotaur for Mesos, Kafka and Hadoop

Today I am happy to announce “Minotaur” which is our Open Source AWS based infrastructure for managing big data open source projects including (but not limited too): … 1,038 more words

Open Source Projects

Ideas and goals behind the Go Kafka Client

I think a bunch of folks have heard already that B.D.O.S.S. was working on a new Apache Kafka Client For Go. Go Kafka Client was open sourced last Friday. 755 more words

Open Source Projects

Run a simple map reduce job in hadoop pseudo distributed setup.

“In this blog I will describe, how you can run a simple map reduce job in a single-node Hadoop cluster. for this i am going to use a WordCountexample which reads text files and counts how often words occur.

684 more words
Map-reduce