Coming after another one of a smaller scale in the recent months that forced however some organisations to trigger their BCP.
An archetype of a derelict organisation after massive jobs offshoring / outsourcing. Internal competences located close to the field, able to promptly react when the sh:t hits the fan are gone.
One day or another there'll be a similar situation in some industrial plant, with far worse consequences than just IT apps being unavailable...
26 replies (most recent on top)
I'm already bringing my own basic PPE,
but maybe that kevlar suit and bathysphere-for-one are worth money out of my pocket?
If something much more serious than IT/Systems issues occur, you can 100% bank on ZERO accountability of the folks that just keep cutting and cutting while claiming no loss of capability. They will simply claim, “We told you to keep things operating in a safe manner and [insert name of scapegoat] failed to do that.” Of course the scapegoat will not be a HiPo but some lowly SLS that just happened to be in the job when the issue occurred. Remember, HiPos do not make bad decisions, they only experience “learning opportunities”.
OP, "One day or another there'll be a similar situation in some industrial plant, with far worse consequences than just IT apps being unavailable" This scares the sh-t out of me. For those that don't work at the plants, this's real and it's happening. The cost cutting has gone too deep and safety has been compromised in all out plants and refineries. I truly think that something somewhere is about to go bo-m very soon and people will die. Darren must to change direction now. ExxonMobil's unsafe at this point. All manufacturing plants and refineries must be shut down now and evaluated for safety. Darren must change direction now.
I was told an army of KL and BTC resources have been keeping up fantastic infrastructure. There's no way a power issue could bring everything down for multiple days right??? ;)
Seriously though, fk outsourcing, fk XOM leadership and their pet projects overseas overstating their capabilities.
I don’t understand how this happened even once. There are backup generators.
Let's get a cold beer, a bag of pop-corn and sit down to see who's going to be the scapegoat in E&PS and/or EMIT...
Another system outage with only days left in the quarter. Somebody in E&PS better get moving fast... DW is watching... On his Blackberry. Haha
Another IT problem and outage from typical TX thunderstorm…how does DWW keep productive at this hour
SKY needs to go. His penny pinching is leading to the campus seating disaster and now equipment power failure. All it will take is delaying DW or KM at the Gate one morning and he's toast! Hahahaha
IT problem is nuanced.
Power issue was coming out of the E&PS power shaving project and poor handling of code by vendor. We didn’t start that problem.
However, the EMIT part of the problem was the inability to massively fail over to other data centers. We did a lot of small scale disaster tests, but we never actually lived through the real experience and whether or not we were truly resilient. EMIT owns that.
Whoever says about divine retribution... What doe it say about all tornadoes hitting the deep south and bibble belts?
Dream on. And all the physical interconnections are designed by our crack EMTEC & EMIT SMEs.
Industrial control systems have air gapped layers and highly redundant failsafe systems. I wouldn’t worry about what the OP said happening in a plant.
EMTEC+EMIT, case of 2 dysfunctional organizations. Absolute opposite of "The whole is greater than the sum".
- Business line
Electrical problem. Not IT
This is a direct consequence of Darren W's massive layoffs. There's nobody to keep things running and there are even fewer people to fix things when they break. Way to go Darren, the worst CEO anyone could imagine.
EMIT are a joke, with the thousands of them wound think our systems would be flawless
PIP them all
Emit sucks
EMIT's moto: If you can do your job, we are not doing ours.
Outage had nothing to do with EMIT. It was self inflicted, apparently.
As for agile, without it you wouldn't get much work of value. Or are you just mad your stuff doesn't get done instantly by your pet EMIT resource.
Don't worry, EMITs Agile strategy will fix it all. There are SDM's, Product Managers, Product Owners, Scrum Masters and Architects galore that will help you out.
But hey, we’re still saving money!
Do the needful.
Gotk/shitshow
"That part isn't in the workflow" and then ka-bam!!!
Exactly. The cracks are showing...