Hadoop
I'm perplexed.
I have 14 machines, with 24 cores each. Each has 12 Drives for a total of 168 drives and around 500Gbps of io. This is HADOOP so we are mostly streaming files in and streaming them back out (relatively low iops).
And yet processing a 1TB dataset is a multi hour affair.
I have 14 machines, with 24 cores each. Each has 12 Drives for a total of 168 drives and around 500Gbps of io. This is HADOOP so we are mostly streaming files in and streaming them back out (relatively low iops).
And yet processing a 1TB dataset is a multi hour affair.
posted by jerdavis at 9:57 AM
0 Comments:
Post a Comment
<< Home