This Dockerfile sets up a complete streaming environment for experimenting with Kafka, Spark streaming (PySpark), and Cassandra. It installs Kafka 0.10.2.1 Spark 2.1.1 for Scala 2.11 Cassandra 3.7 It...

Accenture had the opportunity to stand-up such a streaming analytics platform that delivers insights in near-real time meaning that the time from when sensor data arrives in the system until when insi...

The Fortis project is a social data ingestion, analysis, and visualization platform. Originally developed in collaboration with the United Nations Office for the Coordination of Humanitarian Affairs (...

Realtime Data Pipeline with Spark Streaming and Cassandra with Mesos … SlideShare Explore You Successfully reported this slideshow.Realtime Data Pipeline with Spark Streaming...

In this blog post we will see how to setup a simple search and anlytics pipeline on streaming data in scala.For sample timeseries data, we will use twitter stream. For data pipelining, we will use kaf...

This guest post is written by Andrew Stevenson, CTO at DataMountaineer. Andrew focuses on providing real-time data pipelines allowing reactive decision making, streaming analytics and big data integra...

Over the past year or so, I’ve met a handful of software companies to discuss dealing with the data that pours out of their software (typically in the form of logs and metrics). In these discussions, ...