Anyone else fighting crowdstrike this morning?
# random
s
Anyone else fighting crowdstrike this morning?
w
Just global banking and transportation from the looks of it 😆
s
I know others. Smaller foot prints tho.
For all that $CRWD is down, $MSFT should be down further.
w
🤯
In some cases, from what I've seen/heard, there might have been an issue with a custom kernel that CloudStrike uses - so there might be the need for some level of manual restarting of servers if they're stuck in boot loops. I hope that I'm wrong about that, because that's so rough
s
Its not a kernel, but a sys module that wires into the kernel to watch syscalls and io buffers.
Not saying I am in an incident response now...
w
Sorry, kernel driver?
s
Pretty much.
Boot safe mode, remove files, reboot.
w
Yep, either way, pour one out for sysadmins today 😢
h
Yeah, we're in Spain and had firsthand experience of the flight chaos, don't even ask
So my sympathies are with the sysadmins, half of Spain is shut down
w
Here's hoping the US land border and flights open up again in the next day or two, otherwise bye bye vacation
🤞 2
s
Common US hashtag for this is #hugops
w
I wonder PXE would help mitigate the fix.... I know it was super helpful to me working on train stuff back in the day (unencrypted boot drives... cough...)
s
As in replacing hosts? Sure, but windows and AD registered systems and conflicting hostnames and and and...
w
😢 I, for one, can't wait to read the postmortem on this
b
popcorn
h
This comes to mind...
dependency_2x.png
w
Yeah, if that guy in Nebraska had a market cap of 80B 😆
c
Why aren't people blaming the windows kernels for poor exception handling
In what world do you design an operating system kernel that can tank because of 3rd party software
h
Not any more he doesn't...
😆 1
s
Then there is the 2010 McAfee debacle. Who was their CTO? Oh yeah. Same guy.