Tags » SPARK

Do You Believe God Will Find You in the Dark?

#JustBelieve #HopeLives #YouMatter



spark 2.0 dataframe read multi csv files with spark SQL save text files

If there is no header in the csv files, create shema first

–First import sql. type

import org.apache.spark.sql.types.{StructType, StructField, StringType,DateType, IntegerType};

–Second define the schema, I find it’s hard to DateType, so I use StringType which works well too. 307 more words

Spark's Start-up Competition: A chance to win 10k & start your business

Do you live in a conflict-affected country or a fragile state? Do you have a business idea or an existing business under 1 year old that can contribute to rebuilding or supporting your local community? 202 more words



and what are we
but receptacles
for the passions of those
who strike us as knowing?
we overflow
spraying what we say
out of our mouths… 67 more words


Court of Broken Knives

I am an on-off reader of fantasy, partially due to the lack of time I have for reading, which means I really have to focus my decisions to the currently relevant. 688 more words


Breaking Down Hadoop, Spark, Cassandra Silos - DriveScale Briefing Note

The storage architecture of most next generation applications, like Hadoop, Spark and Cassandra, leverage local, direct attached storage to avoid excessive storage traffic on the network and keep costs down. 820 more words

Briefing Note