Sunday, 01 March 2020 22:26

HPE to deliver new processing system for the Murchison Widefield Array Featured

By

 

A new 78-node cluster will be delivered and installed at the Pawsey Supercomputing Centre in Perth in support of the Murchison Widefield Array (MWA) radio telescope. The MWA is one of the many precursor projects being developed as part of the Square Kilometre Array (SKA), a joint venture between Australia and South Africa with input from radio astronomers located around the world.

Located at Perth's Curtin University, The Pawsey Supercomputing Centre is growing to become Australia's pre-eminent supercomputing centre and has frequently been represented on the Top500 supercomputer list. This new system "will provide a dedicated system for astronomers to process in excess of 30 PB — equal to 399 years of high definition video — of MWA telescope data using Pawsey infrastructure". It is not clear at what rate this data will be delivered to the centre.

The $2 million computer cluster will support extended compute requirements as the precursors to the SKA grow.

As with most modern supercomputers, GPUs are included to handle much of the "grunt" work, providing capabilities to power AI, computational work, machine learning workflows and data analytics.

The MWA and another SKA precursor telescope — ASKAP — are located at the Murchison Radio-astronomy Observatory in remote Western Australia, which is owned and operated by Australia's national science agency, CSIRO. The MWA, along with the yet-to-be-delivered SKA infrastructure, is located in a legislated "radio quiet" zone in the Murchison region, located inland and south of Carnarvon.

Until now, processing of data collected by both the MWA and ASKAP telescopes has been done on Galaxy, Pawsey's real-time supercomputing system dedicated to radio astronomy. However, the data processing needs of both instruments has been growing: MWA has doubled the number of antennas available, and ASKAP will soon be ready to undertake full surveys of the sky.

To meet this growing demand, the new MWA cluster has been procured ahead of the main supercomputing system, as part of a $70 million Pawsey capital refresh project funded by the Australian Government.

According to Mark Stickells, Pawsey executive director, "the upgrade will allow Pawsey to deliver a service that is tailored to the Australian scientific landscape, and to keep pace with global advances in supercomputing technology. Procurement of the new MWA cluster was the result of a thorough consultation process with key stakeholders and will provide the best system possible to respond to the specific needs of MWA telescope users".

Stickells continued, "The new MWA cluster at Pawsey will feature 156 of the latest generation of Intel CPUs and 78 cutting-edge GPUs with more high-bandwidth memory, internal high-speed storage and more memory per node."

About the importance of this process and its results, Professor Melanie Johnston-Hollitt, MWA director, said "As the MWA director, I am delighted to see the conclusion of the procurement process, it was an outstanding example of collaboration between Pawsey and MWA and I am glad we had the opportunity to provide input into Australia's HPC future.

"As a researcher, I am excited that this new infrastructure will give us the chance to accelerate our workflows, leading to faster scientific discoveries and for providing the opportunity to continue to use the MWA as a scientific, technical, and operational testbed for the future Square Kilometre Array," she said. In conjunction with this upgrade, Pawsey is recruiting for a "Supercomputing Applications Specialist." 

The Pawsey Supercomputing Centre's 546 TeraFlops MWA cluster will comprise 78 nodes, each with two Intel Xeon Gold 6230 processors operating at 2.1 GHz and providing 40 compute cores in total, a single NVIDIA V100 with 32 GB of high-bandwidth memory, 960 GB of local NVMe storage and 384 GB of main memory. All this will be contained in just two racks, saving on floor space as well as power and cooling requirements. This performance is not sufficient to earn a place in the Top500 supercomputer list, where the current minimum entry requirement is PetaFlop performance.

Pawsey officials noted that HPE was chosen not only because they successfully meet MWA's technical requirements, but also their ability to leverage resources around the world to provide the highest level of support for the lifetime of the system, in addition to their local support. HPE has 70 machines in the Top500 list, half of which were constructed in co-operation with Cray.

Commissioning of the new MWA cluster system is expected to be finalised by Q2 2020.

WEBINAR event: IT Alerting Best Practices 27 MAY 2PM AEST

LogicMonitor, the cloud-based IT infrastructure monitoring and intelligence platform, is hosting an online event at 2PM on May 27th aimed at educating IT administrators, managers and leaders about IT and network alerts.

This free webinar will share best practices for setting network alerts, negating alert fatigue, optimising an alerting strategy and proactive monitoring.

The event will start at 2pm AEST. Topics will include:

- Setting alert routing and thresholds

- Avoiding alert and email overload

- Learning from missed alerts

- Managing downtime effectively

The webinar will run for approximately one hour. Recordings will be made available to anyone who registers but cannot make the live event.

REGISTER HERE!

LAYER 1 ENCRYPTION A KEY TO CYBER-SECURITY SOLUTION

Security requirements such as confidentiality, integrity and authentication have become mandatory in most industries.

Data encryption methods previously used only by military and intelligence services have become common practice in all data transfer networks across all platforms, in all industries where information is sensitive and vital (financial and government institutions, critical infrastructure, data centres, and service providers).

Get the full details on Layer-1 encryption solutions straight from PacketLight’s optical networks experts.

This white paper titled, “When 1% of the Light Equals 100% of the Information” is a must read for anyone within the fiber optics, cybersecurity or related industry sectors.

To access click Download here.

DOWNLOAD!

David Heath

David Heath has had a long and varied career in the IT industry having worked as a Pre-sales Network Engineer (remember Novell NetWare?), General Manager of IT&T for the TV Shopping Network, as a Technical manager in the Biometrics industry, and as a Technical Trainer and Instructional Designer in the industrial control sector. In all aspects, security has been a driving focus. Throughout his career, David has sought to inform and educate people and has done that through his writings and in more formal educational environments.

VENDOR NEWS & WEBINARS

REVIEWS

Recent Comments