Logging in Apache Spark comes very easy since Spark offers access to a log object out of the box. Only some configuration setups need to be done. In a previous post we have looked at how to do this wh...

SlideShare Explore You Public clipboards featuring this slideNo public clipboards found for this slideSelect another clipboard×Looks like you’ve clipped this slide to already.Create a clipboardYo...

Related Articles:A simple classification problem: Will the Monolith react? Is it safe?!Maybe a cautious approach to a bigger version of the Monolith (2km long) in a POD that is only 2m in diameter is...

Kafkaesque: \ käf-kə-ˈesk \Marked by a senseless, disorienting, menacing, nightmarishly complexity.One morning when I woke from troubled dreams, I decided to blog about something potentially Kafkaesqu...

Leaderboard @Dream11Scale to serve 100+ million reads/writes using Spark and CassandraBy Bharat Vishwakarma, Amit Mirchandani, Amit SharmaDream11 — Leading the Pack in Fantasy SportsDream11 is India’s...

SETUP LAMBDA ARCHITECTURE EXAMPLE 1. Introduction - Setup lambda architecture example 24 March 2016Let’s see how to build a lambda architecture example (LAE) for processing huge log data.What...

Spark SQL is awesome.  It allows you to query any Resilient Distributed Dataset (RDD) using SQL (including data stored in Cassandra!).First thing to do is to create a SQLContext from your SparkContext...

tl;drusing the cassandra connector in the spark-shell is fairly straightforward setting up the connection in a way that doens’t break the existing sc is not documented anywhere the correct solution is...