SGI teams with Cloudera for Hadoop clusters

Stephen Withers
Wednesday, 19 October 2011 07:25

 

SGI will ship server clusters with Cloudera's distribution of Apache Hadoop preinstalled.

 

Apache Hadoop is an open-source project for the distributed processing of Big Data, delivering high availability (HA) at the application layer instead of relying on hardware for HA. The project is led by Yahoo!, and Hadoop is used by Facebook, LinkedIn and Twitter, among others.

 

Cloudera's Distribution including Apache Hadoop (CDH) is a widely-used, prepackaged Hadoop stack that runs on common Linux distributions (CentOS, Red Hat, SUSE and Ubuntu) and the Amazon EC2, Rackspace and SoftLayer public clouds.

SGI was an early adopter of Hadoop, and recently set a world record for the Terasort data processing and analysis benchmark using CDH. SGI and Cloudera have now signed a deal that will see SGI pre-install CDH on its Hadoop Clusters, and the two companies will jointly build, sell and deploy Hadoop-based commercial systems.

"We understand the power of Hadoop. Since the technology's inception, we have successfully deployed tens of thousands of Hadoop servers to our customers," said Bill Mannel, vice president of product marketing at SGI. "Leveraging Cloudera's Distribution including Apache Hadoop together with our SGI Hadoop Cluster, we achieved a world record Hadoop benchmark for data processing and analysis - 81% faster than the competition. CDH, combined with Cloudera's management suite, puts the promise and potential of Hadoop - and the complete Hadoop stack - within reach."

Ed Albanese, head of business development at Cloudera, said "The combination of Cloudera's market-leading software with SGI's first-class products and reputation in the HPC market enables global access and delivery capacity for Apache Hadoop in stalwart HPC verticals, including defence, intelligence, research and telecommunications."

"This partnership enables Cloudera to better serve a segment of customers accustomed to factory-installed products and solution-oriented delivery," he added.