The art of Information Engineering » Scalability http://www.grok.in (ignorance killed the cat, curiosity was framed) Tue, 11 Aug 2009 06:30:18 +0000 en hourly 1 MapReduce and Scale http://www.grok.in/blog/2008/02/05/mapreduce-and-scale/ http://www.grok.in/blog/2008/02/05/mapreduce-and-scale/#comments Mon, 04 Feb 2008 18:44:07 +0000 Siddhartha Reddy http://www.grok.in/blog/2008/02/05/mapreduce-and-scale/ Lately, I have become extremely interested in MapReduce, specifically the open source implementation of this in Hadoop.

From Wikipedia (MapReduce):

MapReduce is a software framework implemented by Google to support parallel computations over large (greater than 100 terabyte) data sets on unreliable clusters of computers. This framework is largely taken from map and reduce functions commonly used in functional programming.

That description, though quite accurate, does not do justice to MapReduce.

Read on…

]]> http://www.grok.in/blog/2008/02/05/mapreduce-and-scale/feed/ 2