Big Data Market Segment LS
Big Data Market Segment RS
Tuesday, 19 November 2019 16:24

Nvidia Magnum IO speeds GPU access to data


Nvidia's new Magnum IO software helps data scientists and AI and high performance computing researchers process massive amounts of data in minutes instead of hours.

According to the company, Magnum IO delivers up to 20x faster data processing for multi-server, multi-GPU computing nodes when working with massive datasets to carry out complex financial analysis, climate modelling and other HPC workloads.

"Processing large amounts of collected or simulated data is at the heart of data-driven sciences like AI," said Nvidia founder and CEO Jensen Huang.

"As the scale and velocity of data grow exponentially, processing it has become one of data centres' great challenges and costs.

"Extreme compute needs extreme I/O. Magnum IO delivers this by bringing Nvidia GPU acceleration, which has revolutionised computing, to I/O and storage. Now, AI researchers and data scientists can stop waiting on data and focus on doing their life's work," he said.

The software was developed in collaboration with companies including DataDirect Networks, Excelero, IBM, Mellanox and WekaIO.

IBM vice president of storage offering management Sam Werner said "The amount of data that leading HPC and AI researchers now need to access continues to grow by leaps and bounds, making I/O a complex challenge for many to manage. IBM Spectrum Scale is designed to address the needs of any organisation looking to accelerate AI and run data-intensive workloads. The use of IBM Spectrum Scale and Nvidia GPU acceleration can help customers alleviate I/O bottlenecks and get the insights needed from their data faster."

A key part of Magnum IO is GPUDirect, which provides a path for data to bypass CPUs and travel between GPUs, storage and networking devices.

Its newest element is GPUDirect Storage, which enables researchers to bypass CPUs when accessing storage and quickly access data files for simulation, analysis or visualisation.

Nvidia Magnum IO software is available now, with the exception of GPUDirect Storage which allows GPUs to access storage devices without going through the CPU. GPUDirect Storage is currently available to select early-access customers, and will be more widely available in the first half of 2020.


26-27 February 2020 | Hilton Brisbane

Connecting the region’s leading data analytics professionals to drive and inspire your future strategy

Leading the data analytics division has never been easy, but now the challenge is on to remain ahead of the competition and reap the massive rewards as a strategic executive.

Do you want to leverage data governance as an enabler?Are you working at driving AI/ML implementation?

Want to stay abreast of data privacy and AI ethics requirements? Are you working hard to push predictive analytics to the limits?

With so much to keep on top of in such a rapidly changing technology space, collaboration is key to success. You don't need to struggle alone, network and share your struggles as well as your tips for success at CDAO Brisbane.

Discover how your peers have tackled the very same issues you face daily. Network with over 140 of your peers and hear from the leading professionals in your industry. Leverage this community of data and analytics enthusiasts to advance your strategy to the next level.

Download the Agenda to find out more


Stephen Withers

joomla visitors

Stephen Withers is one of Australia¹s most experienced IT journalists, having begun his career in the days of 8-bit 'microcomputers'. He covers the gamut from gadgets to enterprise systems. In previous lives he has been an academic, a systems programmer, an IT support manager, and an online services manager. Stephen holds an honours degree in Management Sciences and a PhD in Industrial and Business Studies.



Recent Comments