Dive into A Data Deluge » online aggregation http://diveintodata.org Discussion about Newly Emerging Issues on Database Tue, 01 Jun 2010 08:15:52 +0000 en hourly 1 http://wordpress.org/?v=3.0.1 MapReduce Online Comes Out! http://diveintodata.org/2009/10/mapreduce-onlie-comes-out/ http://diveintodata.org/2009/10/mapreduce-onlie-comes-out/#comments Mon, 19 Oct 2009 15:49:37 +0000 Hyunsik Choi http://diveintodata.org/?p=461 MapReduce has been gaining much attention in data intensive computing field. As you know, it is well known as a very popular framework for batch-processing.

Recently, however, Tyson Condie who is a Ph.D student in UC Berkeley accomplishes MapReduce Online. Today, I heard this news from Data Beta. Actually, It is amazing works since the original MapReduce is specialized and designed for only batch-processing. In addition, most people believe that MapReduce will remain a batch-processing.

The essential of MapReduce online is that it tries to hold the fault-tolerance model of the original MapReduce, whereas it provides the the pipelining of results across tasks and jobs instead of materializing the output of each MapReduce task and job into disk. Consequently, MapReduce online enables the program to return the result earlier from a big job.

You can get further information from MapReduce Online.

]]> http://diveintodata.org/2009/10/mapreduce-onlie-comes-out/feed/ 3