Thursday, 20 September 2012 12:59

Big data not new, just more complex, says IDC


The “big data” phenomenon may seem to have appeared from nowhere, but many aspects of it are nothing new, says analyst company IDC.

For many years now IDC has published a biennial Digital Universe report, sponsored by EMC which has examined the exponential growth of digital data in the world. According to the most recent study, from June 2011, the amount of information created and replicated in the world surpassed 1.9 zettabytes (1.8 trillion gigabytes) last year, growing by almost nine times in just five years.

“Some aspects of big data are indeed new,” says IDC Australia’s Craig Stires. “And they are creating unprecedented levels of complexity for IT executives. As the variety of data sources increases rapidly, and the velocity at which data is generated also increases, IT executives are beginning to realise that these massive data sets cannot be processed, managed, and analysed using traditional databases and architectures.”

Stires says much data is structured, but that an increasing amount is unstructured, such as social media interactions, rich media files and geospatial information. “If your organisation is one of the growing number looking for deeper insight into customers and operations, then you understand that big data will be key.

“New possibilities are available for real-time analysis and response to customer interactions, whether through better customer service, or more targeted offers,” says Stires. “With technology barriers falling, organisations are given affordable access to infrastructure that scales up and out.

“They also now have access to software that offers high performance capabilities in traditional application, while extending its reach in video, voice, and social data insights. On top of this, services companies are providing roadmaps and best-practices to deliver business value from proven use cases.”

In line with this trend, IDC says CIOs and IT departments are looking at a major reassessment of both infrastructure, primarily leveraging high performance computing, in-memory technologies and massively parallel processing (MPP) architectures, and improved information management and business intelligence analytics.

“It's a great time to be mapping out how you can lead the transformation in your organisation. It's the right time to pay attention to the combination of increasing availability of experiences, end-user awareness, affordable technologies, and emerging vendor solutions. Making a critical, informed decision on your big data strategy today will be crucial to your organisations success and continued competitiveness tomorrow”.

IDC will discuss big data at a business analytics briefing in Sydney on Wednesday 26 September, at Sydney’s  Shangri-La Hotel.


26-27 February 2020 | Hilton Brisbane

Connecting the region’s leading data analytics professionals to drive and inspire your future strategy

Leading the data analytics division has never been easy, but now the challenge is on to remain ahead of the competition and reap the massive rewards as a strategic executive.

Do you want to leverage data governance as an enabler?Are you working at driving AI/ML implementation?

Want to stay abreast of data privacy and AI ethics requirements? Are you working hard to push predictive analytics to the limits?

With so much to keep on top of in such a rapidly changing technology space, collaboration is key to success. You don't need to struggle alone, network and share your struggles as well as your tips for success at CDAO Brisbane.

Discover how your peers have tackled the very same issues you face daily. Network with over 140 of your peers and hear from the leading professionals in your industry. Leverage this community of data and analytics enthusiasts to advance your strategy to the next level.

Download the Agenda to find out more


Graeme Philipson

Graeme Philipson is senior associate editor at iTWire. He is one of Australia’s longest serving and most experienced IT journalists. He is author of the only definitive history of the Australian IT industry, ‘A Vision Splendid: The History of Australian Computing.’

He has been in the high tech industry for more than 30 years, most of that time as a market researcher, analyst and journalist. He was founding editor of MIS magazine, and is a former editor of Computerworld Australia. He was a research director for Gartner Asia Pacific and research manager for the Yankee Group Australia. He was a long time weekly IT columnist in The Age and The Sydney Morning Herald, and is a recipient of the Kester Award for lifetime achievement in IT journalism.



Recent Comments