Saving nature using Big Data Analytics is a very noble goal. Using New York taxi rides data, we decided to learn how many rides could be consolidated. It was a journey we would like to share. First, ...

This paper focuses on real-time cloud based analytics of live video feeds from the cameras of self-driven autonomous vehicles using the Spark framework on Amazon's Elastic Mapreduce (EMR). We use deep ...

We use an open source tool Flintrock to launch our EC2 based Apache Spark cluster. Flintrock provides a quick way to launch an Apache Spark cluster on EC2 using command line. 4. Run aws configure to ...

Of course, some people have already been running Spark on AWS’ EMR for some time, but doing so was always a far more difficult proposition without Amazon’s integrated support. Now, it’s far ...

Virtual Environment Variables To have a working application that interacts with EMR correctly we need to set the following Environment Variables.