Introduction

90% of the world's data was generated in just the last two years. Google developed an algorithm that allowed for their large data calculations to be chopped up into smaller chunks and mapped to many computers. They called this algorithm MapReduce. This algorithm was later used to develop an open source project called Hadoop which allows applications to run using the MapReduce algorithm. There are really two ingredients that are driving organizations into investigating Hadoop. The other is high calculation complexity like statistical simulations. Any combination of these two ingredients with the need to get results faster and cheaper will drive your return on investment. We will start to see Hadoop playing a central role in statistical analysis, ET