Any guesses? :)
8 replies (most recent on top)
If this happened at Amazon, heads would roll. Everything would be re-examined.
No, that isn't the Amazon way. They would have every team connected in the slightest review what went wrong to determine every root cause. These would be summarized into a COE and released to the entire company for review and to learn from the mistake.
COEs are very common and range from insignificant outages to financial statement impacting events. It is very rare to not have a COE open for review by everyone in the company.
Their goal isn't to assign blame but to learn. Even the chaos of prime day 2018 followed this model, and that likely cost a fortune.
That is really the biggest difference between Cisco and Amazon... Amazon is too busy to play the political blame game. Learn and do better next time.
In my 12 years here I’ve never seen anybody held accountable for outages that affect business critical systems. When is the last time you saw Webex proactively alert people internally about maintenance? Never... we simply can’t connect to customer calls, or internal team meetings and simply say “webex is acting funky today” or “Anybody having trouble getting on webex?” Our entire day-to-day business is run on this application and they operate above the law with no accountability. During the global webex teams outage, which cost us millions in customer restitution, who paid the price? - absolutely nobody.
the team that caused the outage works in my facility. They were in the process of migrating an acquisition that is being spun out to a segment that can be more easily cut of from the cisco internet
Maybe Cisco IT should become performance based? Sc-ap the relationship based used car salesman culture.
https://techcrunch.com/2019/10/10/cisco-internal-network-outage
For those of us no longer there, what happened?
If this happened at Amazon, heads would roll. Everything would be re-examined. But at Cisco? Things will not change much.
Operations/IT is mostly a good ol' boys club of incompetent VPs. Surround yourself with yes-men and collect a nice paycheck.