No. 1 Story

ACCC clears Optus to scrap HFC network and use NBN instead

The ACCC has cleared, provisionally, the proposed deal between Optus and NBN Co under which Optus is to be paid around $800m to shut down its HFC network and transfer customers onto the NBN. read more

The Telstra Outage - what do we know?

IT Industry - Market

For what was a relatively short outage, this has created a huge impact.  What can we interpret?

Firstly, in a somewhat round-about way, Telstra is admitting it stuffed up.  A change was made to the system and it back fired.  We don't yet know what the change was, nor how long the period was between making the change and the systems dying.

Secondly, Telstra has incredibly poor change management procedures.  Were this author in charge of the team responsible, there would have been extensive testing plans and fully formulated roll-back procedures.  It would appear that the team in charge of the change had spent the night committing the update then all gone home to a well-earned sleep, not bothering to advise the operational centre how to roll-back should things go wrong – how else can we explain the hour taken to fix the issue?  Waking someone up to dial-in and repair the damage?

Thirdly, service-level guarantees are generally expressed in uptime percentages.  For instance, if you were guaranteed 99% uptime, you could expect 3.65 days of outage per year (hopefully scattered across the entire year).  More common are guarantees of 99.99% uptime.  This equates to around 52 minutes and 34 seconds of downtime per year.  Anyone with such a guarantee provided by Telstra is now able to invoke non-performance clauses based on this incident alone.

As the spokesperson noted in the quote shown earlier, "A full investigation is being undertaken. We have commenced a detailed and thorough technical investigation into the incident. This may take some time to conduct to ensure we fully understand the issue and can put appropriate measures in place to maintain the integrity and operation of our network." 

Allow this writer to be totally astonished that such measures were not already in place.

Be assured, HEADS WILL ROLL.