For the last year or so, my team at Berkeley — in collaboration with Yahoo Research — has been undertaking an aggressive experiment in programming. The challenge is to design a radically… more →
Data Betajmh wrote 6 days ago: For the last year or so, my team at Berkeley — in collaboration with Yahoo Research — h … more →
jmh wrote 1 week ago: I just heard through the Berkeley grapevine about the BashReduce effort at Last.fm: MapReduce in … more →
ashalam wrote 2 weeks ago: In regards to the paper (http://database.cs.brown.edu/sigmod09/) critiquing MapReduce framework, som … more →
erikeldridge wrote 1 month ago: ref: http://www.cloudera.com/sites/default/files/2-MapReduceAndHDFS.pdf - borrows from functional pr … more →
jmh wrote 2 months ago: Was intrigued last week by the confluence of two posts: Owen O’Malley and Arun Murthy of Yaho … more →
neilconway wrote 2 months ago: “A Comparison of Approaches to Large-Scale Data Analysis” in SIGMOD 2009 is a followup t … more →
Brad Chapman wrote 3 months ago: I previously wrote up details about starting a GFF parser for Biopython. In addition to incorporati … more →
jmh wrote 4 months ago: It’s been a busy month pushing out papers. I’ll cover some of them here over the next da … more →
brightsparc wrote 4 months ago: The heavy hitting ex-executives behind start up CloudEra are banking on a business based around Hado … more →
jmh wrote 5 months ago: At HPTS 2001 I gave a quick seat-of-the-pants talk called We Lose, which argued that database sof … more →
squarecog wrote 6 months ago: Pig is a system for processing very large datasets, developed mostly at Yahoo and now an Apache Hado … more →
squarecog wrote 6 months ago: Anand Rajaraman has a great post on Datawocky with an overview of the various approaches to data ana … more →
mascha wrote 7 months ago: Some slides about tuning and debugging hadoop map-reduce. It gives good tuning starting points. … more →
jmh wrote 8 months ago: The first of two invited posts at GigaOm are up. These are not researchy, they’re intended to … more →
solrhack wrote 8 months ago: Basic stuff like sorting a list can help to get your head around map reduce. Here’s an example … more →
solrhack wrote 9 months ago: i was hard pressed to find any examples of map reduce in action outside of the archetypal word count … more →
mainichipress wrote 1 year ago: Mapreduce is a process to find out number of similar banana in Iraq and Afganistan. For example, you … more →
Tom Gleeson wrote 1 year ago: I’ve said it before and I’m going to repeat myself; learning Ruby has proven to be a gre … more →