Wednesday, 09 July 2014 01:49

EMC pushes 'data lake' with Isilon update


Storage vendor EMC reckons its latest Isilon systems - "the workhorse for the file environment" - are the world's fastest scale-out NAS units, and the place to locate your organisation's 'data lake'.

One problem with using siloed storage, according to EMC Information Infrastructure president of products Jeremy Burton, is that it results in "hot spots" where part of the infrastructure is overloaded while resources are left idle elsewhere.

So EMC advocates the use of a 'data lake' that can support a wide range of applications and access methods.

Familiar methods include SMB, FTP and NFS, he said, but that's not enough for today's IT environment. For example, access to the same set of data may be required by sharing systems such as EMC's Syncplicity offering, by cloud applications via OpenStack or EMC's ViPR, or by Hadoop-based analytics, Mr Burton said.

But it could take days to copy a large data set - such as clickstream data and other log information for a web site - from a NAS to a Hadoop system, he said.

So EMC will provide additional access methods including HDFS, REST and SWIFT so that a greater number of systems can directly process data stored on Isilon. SMB multichannel (required to support 4K video streams) has already been added, and others are on their way.

The latest version (7.1.1) of the OneFS operating system for Isilon features SmartFlash, a flash-based cache for faster access that can scale up to one petabyte in a single cluster. According to Mr Burton it is the first and only globally coherent scale-out flash-based cache.

EMC announced new Isilon hardware based on Intel's Ivy Bridge.

The S210 is designed for performance, and delivers twice the IOPS of its predecessor (up to 3.75 million IIOPS per cluster) yet halves the total cost of ownership.

The X410 is aimed at situations requiring maximum throughput - 70% more than its predecessor - but at the same time reduces the total cost of ownership by 33%. Up to 200GBps per cluster is achievable.

Two new packaged Isolon solutions were announced: one for scale-out VDI, the other for Hadoop analytics. "We're really trying to accelerate the time to value," said Mr Burton, observing that EMC is the market leader in Hadoop shared storage.

According to EMC officials, Isilon OneFS 7.1.1 and the S210 and X410 storage platforms and the packaged solutions will be generally available this month. Support for enhanced HDFS and OpenStack SWIFT Object protocols are expected by the end of 2014.

In related news, EMC announced that its new Elastic Cloud Storage units are now generally available, and that the first one off the production line - a full 3PB rack - has been shipped to the Vatican Archives.

Mr Burton said Elastic Cloud Storage arrays have been designed to be 23-28% cheaper than Amazon Web Services or Google storage. The comparison was based on the four-year total cost of ownership for 5PB (usable) of object storage.

Disclosure: The writer travelled to London as the guest of EMC.

WEBINAR event: IT Alerting Best Practices 27 MAY 2PM AEST

LogicMonitor, the cloud-based IT infrastructure monitoring and intelligence platform, is hosting an online event at 2PM on May 27th aimed at educating IT administrators, managers and leaders about IT and network alerts.

This free webinar will share best practices for setting network alerts, negating alert fatigue, optimising an alerting strategy and proactive monitoring.

The event will start at 2pm AEST. Topics will include:

- Setting alert routing and thresholds

- Avoiding alert and email overload

- Learning from missed alerts

- Managing downtime effectively

The webinar will run for approximately one hour. Recordings will be made available to anyone who registers but cannot make the live event.



Security requirements such as confidentiality, integrity and authentication have become mandatory in most industries.

Data encryption methods previously used only by military and intelligence services have become common practice in all data transfer networks across all platforms, in all industries where information is sensitive and vital (financial and government institutions, critical infrastructure, data centres, and service providers).

Get the full details on Layer-1 encryption solutions straight from PacketLight’s optical networks experts.

This white paper titled, “When 1% of the Light Equals 100% of the Information” is a must read for anyone within the fiber optics, cybersecurity or related industry sectors.

To access click Download here.


Stephen Withers

joomla visitors

Stephen Withers is one of Australia¹s most experienced IT journalists, having begun his career in the days of 8-bit 'microcomputers'. He covers the gamut from gadgets to enterprise systems. In previous lives he has been an academic, a systems programmer, an IT support manager, and an online services manager. Stephen holds an honours degree in Management Sciences and a PhD in Industrial and Business Studies.



Recent Comments