Thursday, 05 April 2018 16:31

'Tape is the new tape,' says Azure CTO – for now


A lot of attention is paid to making data accessible as quickly as possible, but that comes at a price. There are situations — typically driven by regulations — where it is necessary to store data beyond the period during which you expect to use it.

After evaluating various technologies including Blu-ray and magnetic disk, Microsoft came to the conclusion that tape was still the way to go for Azure's archival storage tier, said Microsoft Azure CTO Mark Russinovich.

"We believe tape is the new tape", so the company builds automated tape libraries with up to 72 tape drives and 12,000 tape cartridges, plus one to two robotic arms to load the required cartridges.

The downside is the resulting high latency: the robotics have to load a cartridge into an idle drive, and then the drive has to seek the right place on the tape to start reading the data, he explained.

This arrangement is economical at a reasonably large scale, but the entry point is somewhat expensive for a new Azure region. Over the last five or six years, Microsoft Azure has been working with Microsoft Research to create a smaller-scale archival storage solution. The first generation of the resulting Pelican system contained 1100 hard disks with a raw capacity of over 11PB in one rack. Two servers connect to these drives via a PCIe bus.

The problem is that the power required by so many spinning drives would normally greatly exceed the budget for a single rack. Microsoft overcame that limitation by spinning up drives only when they are actually needed. Having a just a subset of the drives online at any time keeps the rack within the power budget, Russinovich explained.

The price is higher latency. If the maximum number of drives is already active, there is an initial delay while one becomes idle and is spun down. Then the required disk must spin up before the data can be read.

"But what this gives is this intermediate price point between tapes and standard hard disk storage," he said.

Microsoft Azure CTO Mark Russinovich

Microsoft isn't resting on its laurels: it is working on two technologies that have the potential to provide archival storage at prices lower than that of tape.

Project Silica — a collaboration between Microsoft Research, Azure and the University of Southampton (UK) — aims to store data on glass.

The advantages of such a system is that once written, the data is truly permanent. Where SSDs, disks and tapes require data to be rewritten every few years or every decade to avoid bit rot, "if you can store data in glass there is no decay at all. It will literally last for the rest of the lifetime of the planet Earth", Russinovich said.

Furthermore, glass is extremely cheap as the main raw material is sand.

The stumbling block as been that it is very hard to etch data into glass without compromising the integrity of the medium. Using standard lasers to do the etching results in microscopic cracks that eventually make the data impossible to read.

Project Silica gets around this by using lasers that can produce pulses as short as a femtosecond – one quadrillionth of a second. It also encodes three bits of data into one voxel (a point in three-dimensional space), and writes the data in multiple layers inside one piece of glass.

"Another really cool characteristic of glass is you can always create a reader for it," he said. "For reading glass all you need is a light. You read the reflections coming out of it."

"But that's not the only promising technology for storing data in an archival way very efficiently, very low cost," said Russinovich.

Project Palix — a collaboration between Microsoft Research, Azure and the University of Washington (US) — aims to encode data into DNA strands.

DNA lasts for around 2000 years if stored at around 10 degrees centigrade, and can be read using existing gene sequencing technology.

The real promise is in the remarkable density: as much as one zettabyte could be stored in one rack. A zettabyte is 1000 exabytes; an exabyte is 1000 petabytes; and a petabyte is 1000 terabytes. Russinovich explained it another way: "To give you an idea how big it is, people are estimating by the year 2020 there will be about 20 zettabytes of digital data on the entire planet. So [the proposition is] one-twentieth of the planet's data stored on a single rack.

"We believe we are close to making this commercially viable in the very near future," he said. "This has huge potential... [for] providing extremely low-cost archival storage."

Russinovich was in Australia for the opening of Azure's Australia Central 1 and Australia Central 2 (Canberra) regions.

Read 8690 times

Please join our community here and become a VIP.

Subscribe to ITWIRE UPDATE Newsletter here
JOIN our iTWireTV our YouTube Community here


The past year has seen a meteoric rise in ransomware incidents worldwide.

Over the past 12 months, SonicWall Capture Labs threat researchers have diligently tracked the meteoric rise in cyberattacks, as well as trends and activity across all threat vectors, including:

Encrypted threats
IoT malware
Zero-day attacks and more

These exclusive findings are now available via the 2022 SonicWall Cyber Threat Report, which ensures SMBs, government agencies, enterprises and other organizations have the actionable threat intelligence needed to combat the rising tide of cybercrime.

Click the button below to get the report.



It's all about Webinars.

Marketing budgets are now focused on Webinars combined with Lead Generation.

If you wish to promote a Webinar we recommend at least a 3 to 4 week campaign prior to your event.

The iTWire campaign will include extensive adverts on our News Site and prominent Newsletter promotion and Promotional News & Editorial. Plus a video interview of the key speaker on iTWire TV which will be used in Promotional Posts on the iTWire Home Page.

Now we are coming out of Lockdown iTWire will be focussed to assisting with your webinars and campaigns and assistance via part payments and extended terms, a Webinar Business Booster Pack and other supportive programs. We can also create your adverts and written content plus coordinate your video interview.

We look forward to discussing your campaign goals with you. Please click the button below.


Stephen Withers

Stephen Withers is one of Australia¹s most experienced IT journalists, having begun his career in the days of 8-bit 'microcomputers'. He covers the gamut from gadgets to enterprise systems. In previous lives he has been an academic, a systems programmer, an IT support manager, and an online services manager. Stephen holds an honours degree in Management Sciences and a PhD in Industrial and Business Studies.

Share News tips for the iTWire Journalists? Your tip will be anonymous




Guest Opinion

Guest Interviews

Guest Reviews

Guest Research

Guest Research & Case Studies

Channel News