Tags » SPARK

Creating multiple spark sessions in kerberos enabled cluster throws error

ISSUE:Creating multiple spark sessions in kerberos enabled cluster throws below error

Py4JJavaError: An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext.

: org.apache.hadoop.ipc.RemoteException(java.io.IOException): Delegation Token can be issued only with kerberos or web authentication… 53 more words


Spark History Server

Spark application Web UI is short-lived, only available for the duration of the job. Once the application is done, you won’t be able to access it anymore. 850 more words


Last Week in Stream Processing & Analytics – 15.1.2018

This is the 98th edition of my blog series blog series around Stream Processing and Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week: 390 more words


S3 and Data Transfer issue from Spark

Spark is a general purpose distributed high performance computation engine that has APIs in many major languages like Java, Scala, Python.

S3 is Amazon Simple Storage Service for storing objects in high durable and reliable manner at very low cost. 185 more words


Tiny Little Flames

I’m greeted with enormous smiles, twinkling eyes, and expectant faces every time I enter a class. In front of me are 50 odd students waiting to listen to their weekly lecture. 694 more words



They all say, we need spark.
Spark to get things done. To move on.
To take the next step. The ignition.

What they don’t say is, the spark… 32 more words


Let Your Word And Spirit Ignite Me

To spread like fire the works of your great majesty
You can bring light like the fire in the night
To do away with the darkness in life… 45 more words