Tags » Big Data

Combating High Cardinality Features in Supervised Machine Learning

Typical training data set for real world machine learning problems has mixture of different types of data including numerical and categorical. Many machine learning algorithms can not handle categorical variables. 1,381 more words

Big Data

Exam 70-776: Perform Big Data Engineering on Microsoft Cloud Services

Design and Implement Complex Event Processing By Using Azure Stream Analytics (15-20%)

  • Ingest data for real-time processing
    • Select appropriate data ingestion technology based on specific constraints; design partitioning scheme and select mechanism for partitioning; ingest and process data from a Twitter stream; connect to stream processing entities; estimate throughput, latency needs, and job footprint; design reference data streams…
  • 843 more words
Hadoop

Monetizing Big Data in Next-Generation Mobility

In my book and previous posts I build a broad case for the importance of big data and AI in next-generation mobility, and provide several examples of data that is being collected, or can be collected, in a variety of transportation and logistics situations. 3,286 more words

Big Data

Hands-on training for an evolving graph database world

The recent acquisition of OrientDB by Callidus Cloud has the potential to transform the graph and multi model database landscape – more on that soon. For now, I’m happy to announce that WiseClouds will continue to provide training and consulting services for modeling, designing, developing, and administering these next-generation applications. 58 more words

Big Data

Deep Dive into Spark Cluster Managers

This blog aims to dig into the different Cluster Management modes in which you can run your spark application.

Spark applications run as independent sets of processes on a cluster, coordinated by the SparkContext object in your main program which is called the… 919 more words

Scala

THE BEADY EYE SAYS: ARTIFICIAL INTELLIGENCE IS OUT OF CONTROL AND WILL IF LEFT TO ITS SELF DESTROY WHAT IS LEFT.

(If you want a future worth living here is a crucial half an hour read)

Most of us know that we are in the middle of a technological upheaval that will transform the way society is organized and the beast we are unleashing can be used for good and bad. 2,158 more words

Unanswered Questions.

Schema On Read?

I saw “create external table ” first in Oracle DBMS 11G.

It was created for the purpose of loading data.

When Hive was introduced, a lot of data were already created in HDFS. 133 more words

Oracle