ApacheConNA: Hadoop metrics

May 14, 2013

ApacheConNA: Hadoop metrics # Have you ever measured the general behaviour of your Hadoop jobs? Have you sized your cluster accordingly? Do you know whether your work load really is IO bound or CPU bound? Legend has it noone expecpt Allen Wittenauer over at Linked.In, formerly Y! ever did this analysis for his clusters. Steve Watt gave a pitch for actually going out into your datacenter measuring what is going on there and adjusting the deployment accordingly: In small ...