This was a major mobility outage effecting 71,000+ customers with cisco gear. Poor management and taking shortcut is responsible and Directors and above in SP are totally incompetent and should be immediately fired!!!
14 replies (most recent on top)
Back in the day, the left hand was considered the "sinister" hand and it was the hand you were supposed to use because the right hand was "holy"
It’s the other way around: sinister is the Latin word for left and dexter is the Latin word for right. The sinister meaning of the word for left came later, as did dextrous and dexterity.
Blaming Cisco for the outage is like blaming Chevrolet for a hit-and-run incident.
Or it could have been a Pinto where Ford did the analysis showing it was cheaper to pay for the lawsuits of the 180 people each year who would burn to death than put in an $11 part in every car to prevent that. When I was there Cisco grandfathered decades of severe static analysis warnings so there was the possibility of a knowable error.
It's not the hardware's fault. It's the people who run it.
There are a wide range of hardware, software and firmware errors in both what Cisco produces as well as the COTS pieces they integrate. if you work there look back into the all hands to find what Cisco actually spends dealing with customer found defects, and that doesn't address the massive losses of dealing with internally found defects. Cisco has competitors that can only dream of having that much money for actual development and yet they still kick Cisco's bottom in their market segments. Before anything was announced you couldn't preclude any of these possibilities.
As it happens AT&T has put out an statement. From https://apnews.com/article/cellular-att-verizon-tmobile-outage-02d8dfd93019e79e5e2edbeed08ee450
AT&T blamed the incident on an error in coding, without elaborating.
“Based on our initial review, we believe that today’s outage was caused by the application and execution of an incorrect process used as we were expanding our network, not a cyber attack,” the Dallas-based company said.
Cisco SP products are known for poor software quality and difficult to upgrade and maintain. I won't be surprised if this is the reason leading to that "technical error".
An initial review by the company found the disruption was caused by the "application and execution of an incorrect process used as we were expanding our network," or, more simply put, a technical error.
He hired software engineers who wipe their butts with left hands.
What? Doesn't everyone wipe their butts w/ their left hands? I grew up hearing adults say that if they ever lost their left hand in an accident, they'd never be able to wipe their butt because it's the only thing they ever use it for.
Back in the day, the left hand was considered the "sinister" hand and it was the hand you were supposed to use because the right hand was "holy" and bodily functions were considered "dirty".
Ok, let's say it was Cisco gear that was involved in the outage.
Still not Cisco's fault. Operator error.
Blaming Cisco for the outage is like blaming Chevrolet for a hit-and-run incident.
It's not the hardware's fault. It's the people who run it.
"Boeing plane crash !", it happened because the former Boeing CEO was short-sighted. He hired software engineers who wipe their butts with left hands. This is a good analog since Cisco is doing the same.
It happens everywhere ….. AWS down, Google cloud down or apple cloud down ….. Facebook down …. Slack down !!
Tesla car crash ! Boeing plane crash !
As usual no evidence at all.
nice try, the FCC will do an investigation due to the duration and severity of the outage. then comment away, but it won't be the same as the OPs accusation
Not true. I know who did it.
SP within CX works in mafia mode. Technical skills are not rewarded, including those with CCIE certification. Leaders are clueless. Time to move out from sick teams.
@OP, that is serious libel. Hope you have evidence.
OP, do you have a news source to back this up?