Wednesday, 29 August 2018 00:02

Garvan Institute upgrades HPC system


Medical research organisation Garvan Institute has expanded its HPC system

The institute's goal is to make precision medicine — the right treatment for the right patient at the right time — real, explained Garvan Institute head of infomatics Warren Kaplan.

This requires the study of disease at scale which, in turn, requires large amounts of computational power and data storage.

"The entire demographic has changed," said Kaplan, who joined the institute as its first and only bioinformatician. Now, 80 are on the payroll and the role has changed from being seen as a service provider to becoming an active part of research teams.

Advances in technology have reduced the time and money needed to sequence a human genome from 10 years and US$3 billion to 50 per day and US$1000, observed Kaplan. This has been "absolutely transformative".

Garvan's new Dell EMC HPC infrastructure features 14th generation PowerEdge servers with Nvidia GPUs and Intel Xeon processors and FPGAs (field-programmable gate arrays).

Specifications include:

• 47 Dell EMC PowerEdge servers with 1,632 Intel Xeon Scalable Processor cores
• 10 Intel Arria 10 GX FPGAs
• 122,880 Nvidia Tesla V100 CUDA cores
• 15,360 Nvidia Tensor cores
• 744TB of NVMe
• 530TB usable capacity CephFS storage
• 25GbE and 100GbE interconnects

The new equipment will support traditional computational analysis and simulation while adding extensive big data analytics and deep learning capabilities.

The FPGAs can be used to accelerate various functions. In particular, some parts of version 4 of the Genome Analytics Toolkit (GATK; one of the pieces of software used by the institute) includes FPGA support, said Kaplan.

Dell EMC ANZ high performance computing lead Andrew Underwood said most of GATK would take advantage of FPGAs by the end of 2018, and consequently a large proportion of genome sequencing could be done on FPGAs in future.

The new Garvan system is "the first of its kind in Australia," and is thought to be the first in the APAC region (Dell EMC is one of only two OEMs using Intel's FPGAs), he said.

Furthermore, Dell and Intel will connect Garvan Institute with relevant software developers in "a true partnership," he added.

In any case, Underwood said staff have other ideas about how FPGAs can be used in their work.

"There's so much opportunity" to explore possible applications of IT to medical research, even though not all of it will get as far as production," he said.

"We're as enthusiastic as everybody" when it comes to investigating use cases. For example, the upgrade includes a small number of GPU nodes, and "we'll see how this goes". Early enthusiasm for GPUs faded, but he expects the technology to become more pervasive.

The new additions to Garvan's infrastructure took about two months to install alongside the existing equipment (which remains in use, despite being up to six years old), largely because of the extra power and cooling required. But from a systems point of view, adding the new nodes was straightforward, said Kaplan.

Garvan's genome sequencing capability is used by the Kinghorn Centre for Clinical Genomics, the Garvan Weizmann Centre for Cellular Genomics, the Sydney Genomics Collaborative (including the Medical Genome Reference Bank, which contains 4000 whole genome sequences to use as controls in disease research), the Lions Kids Cancer Genome Project, and the Australian Genomic Cancer Medicine Program (which seeks to uncover new treatments for rare cancers).

"We want to change the direction of medicine and have a life-changing impact on people's health. We see genomics as the key to driving this transformative change, and we couldn't achieve this without the computing infrastructure to make it possible," said Kaplan.

Disclosure:The writer attended the Dell Technology Forum as a guest of the company.


You cannot afford to miss this Dell Webinar.

With Windows 7 support ending 14th January 2020, its time to start looking at your options.

This can have significant impacts on your organisation but also presents organisations with an opportunity to fundamentally rethink the way users work.

The Details

When: Thursday, September 26, 2019
Presenter: Dell Technologies
Location: Your Computer


QLD, VIC, NSW, ACT & TAS: 11:00 am
SA, NT: 10:30 am
WA: 9:00 am NZ: 1:00 pm

Register and find out all the details you need to know below.



iTWire can help you promote your company, services, and products.


Advertise on the iTWire News Site / Website

Advertise in the iTWire UPDATE / Newsletter

Promote your message via iTWire Sponsored Content/News

Guest Opinion for Home Page exposure

Contact Andrew on 0412 390 000 or email [email protected]


Stephen Withers

joomla visitors

Stephen Withers is one of Australia¹s most experienced IT journalists, having begun his career in the days of 8-bit 'microcomputers'. He covers the gamut from gadgets to enterprise systems. In previous lives he has been an academic, a systems programmer, an IT support manager, and an online services manager. Stephen holds an honours degree in Management Sciences and a PhD in Industrial and Business Studies.



Recent Comments