Security Market Segment LS
Wednesday, 17 June 2020 09:31

Failed network configuration changes by T-Mobile caused outage: Cloudflare chief Featured

By
Matthew Prince: "...don’t worry, this is one thing that does not need to get added to the list of craziness that has been 2020." Matthew Prince: "...don’t worry, this is one thing that does not need to get added to the list of craziness that has been 2020." Supplied

The outages experienced by many companies in the US on Tuesday (Australian time) were apparently due to T-Mobile making changes to its network configuration resulting in a series of cascading failures for its users which affected both voice and data networks, the chief executive and co-founder of web-infrastructure and website-security company, Cloudflare claims.

Matthew Prince said in a series of tweets that this resulted in many users complaining on Twitter and other forums that they could not reach popular forums.

"So now people are looking around for an explanation and they stumble across sites like the Arbor Networks attack map," Prince said. "It looks terrifying today! Thing is, it always looks terrifying. It’s a marketing gimmick put up to sell DDoS mitigation services so that’s not surprising."

T-Mobile chief executive Mike Siewert made no mention of the configuration issues in a short post he made on the company's website at 8.45pm PST on 15 June (1.45pm AEDT on 16 June): "Starting just after 12 pm ET (3am AEDT on 16 June) and continuing throughout the day, T-Mobile has been experiencing a voice and text issue that has intermittently impacted customers in markets across the US," he wrote.

"We are recovering from this now but it may still take several more hours before customer calling and texting is fully recovered. Neville Ray has shared updates throughout the day but I wanted to share the latest on what we know and what we’re doing to address it.

"This is an IP traffic-related issue that has created significant capacity issues in the network core throughout the day. Data services have been working throughout the day and customers have been using services like FaceTime, iMessage, Google Meet, Google Duo, Zoom, Skype and others to connect."

Prince's explanation appears to be on the mark as there was not a single post about this so-called DDoS attack on the North American Network Operators Group mailing list – and any time there is a major outage due to a DDoS or other reason, like a BGP error, this group is full of chatter.

Prince said that from Cloudflare's point of view, there were many things that showed there was no big DDoS attack. "First, traffic from WARP to supposedly impacted services is normal and has no increase in errors.

"Second, there is no spike in traffic to any of the major Internet Exchanges, which you do see during actual DDoS attacks and definitely would during one allegedly this disruptive.

"Finally, our team know the network operators at nearly all the other major Internet services and platforms and none of them are reporting anything anomalous."

He ended with a jab at T-Mobile, saying that nobody was having a bad day, "Except T-Mobile, which is having a bad day almost certainly entirely of their own team’s making. So, please, #hugops. And don’t worry, this is one thing that does not need to get added to the list of craziness that has been 2020."

Former NSA hacker Jake Williams told iTWire that it was just T-Mobile and then Down Detector showing false positives "because people were talking about the T-Mobile outage on other platforms and it became a self licking ice cream cone".

Williams, who now runs his own outfit, Rendition Infosec, said: "I haven't looked at the root cause inside of T-Mobile – other than some Duo issues, it didn't impact me or clients". Duo is enterprise multi-factor authentication that primarily uses push notifications but which could fall back to SMS depending on the configuration, he added.

Quotes in the last two paragraphs of this article were mistakenly attributed to British security expert Kevin Beaumont at the time of publication. The error is regretted and has been corrected. 


Subscribe to ITWIRE UPDATE Newsletter here

GRAND OPENING OF THE ITWIRE SHOP

The much awaited iTWire Shop is now open to our readers.

Visit the iTWire Shop, a leading destination for stylish accessories, gear & gadgets, lifestyle products and everyday portable office essentials, drones, zoom lenses for smartphones, software and online training.

PLUS Big Brands include: Apple, Lenovo, LG, Samsung, Sennheiser and many more.

Products available for any country.

We hope you enjoy and find value in the much anticipated iTWire Shop.

ENTER THE SHOP NOW!

INTRODUCING ITWIRE TV

iTWire TV offers a unique value to the Tech Sector by providing a range of video interviews, news, views and reviews, and also provides the opportunity for vendors to promote your company and your marketing messages.

We work with you to develop the message and conduct the interview or product review in a safe and collaborative way. Unlike other Tech YouTube channels, we create a story around your message and post that on the homepage of ITWire, linking to your message.

In addition, your interview post message can be displayed in up to 7 different post displays on our the iTWire.com site to drive traffic and readers to your video content and downloads. This can be a significant Lead Generation opportunity for your business.

We also provide 3 videos in one recording/sitting if you require so that you have a series of videos to promote to your customers. Your sales team can add your emails to sales collateral and to the footer of their sales and marketing emails.

See the latest in Tech News, Views, Interviews, Reviews, Product Promos and Events. Plus funny videos from our readers and customers.

SEE WHAT'S ON ITWIRE TV NOW!

BACK TO HOME PAGE
Sam Varghese

Sam Varghese has been writing for iTWire since 2006, a year after the site came into existence. For nearly a decade thereafter, he wrote mostly about free and open source software, based on his own use of this genre of software. Since May 2016, he has been writing across many areas of technology. He has been a journalist for nearly 40 years in India (Indian Express and Deccan Herald), the UAE (Khaleej Times) and Australia (Daily Commercial News (now defunct) and The Age). His personal blog is titled Irregular Expression.

Share News tips for the iTWire Journalists? Your tip will be anonymous

WEBINARS ONLINE & ON-DEMAND

GUEST ARTICLES

VENDOR NEWS

Guest Opinion

Guest Interviews

Guest Reviews

Guest Research

Guest Research & Case Studies

Channel News

Comments