this post was submitted on 19 Jul 2024
245 points (98.0% liked)

Technology

58009 readers
2949 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
L3s@lemmy.world
enu@lemm.ee
fry@fry.gs
L3s@fry.gs
enu@lemmy.world
L4s@fry.gs
L4s@lemmy.world
245
CrowdStrike Update Causes Global Microsoft Outage Affecting Banks, Airlines And More (www.forbes.com)
submitted 1 month ago by AnActOfCreation@programming.dev to c/technology@lemmy.world
31 comments fedilink hide all child comments
 
  • A global Microsoft Windows outage, caused by a CrowdStrike software update, has disrupted airlines, banking services, and 911 lines, leading to grounded flights and long queues.
  • The issue resulted in many systems experiencing the “Blue Screen of Death” (BSOD), affecting major carriers and airports worldwide, and also impacted the London Stock Exchange and Australian banking systems.
  • CrowdStrike has identified and isolated the defect, deploying a fix, but recovery is expected to be slow due to the need for manual intervention on affected devices.
top 31 comments
sorted by: hot top controversial new old
[–] n3cr0@lemmy.world 62 points 1 month ago (6 children)

And that's why the IT dept needs to test all software updates before rolling them out on the productive systems.

[–] themeatbridge@lemmy.world 67 points 1 month ago* (last edited 1 month ago) (4 children)

Yeah, a lot of people are (understandably) mad at Crowdstrike right now, but I want to drag some c-suite executives into a conference room and impress upon them the value of allocating budget for test environments and disaster recovery. Banks, airlines, service providers, these aren't mom-and-pop bakeries and plumbers who don't have time for all that nonsense. Every service that went down should be looking for the fuckwit in their organization, and they're probably in the executive lounge. Anyone can make a mistake, but it takes dedication to systematically ignore the best advice of top experts in the field and run your infrastructure on a shoestring budget.

[–] teft@lemmy.world 29 points 1 month ago (1 children)

IT is just a cost center to most executives.

[–] melroy@kbin.melroy.org 8 points 1 month ago

Software development is also a cost center in my company I work for.

[–] elvith 18 points 1 month ago

... value of allocating budget for test environments and disaster recovery ...

I mean, they do have a test environment. Everyone does have one!

They're just missing a separated production environment....

[–] Crackhappy@lemmy.world 17 points 1 month ago

Man, money for a test environment is pretty low on my list of priorities right now. I'm trying to row a 20 man boat with one other person.

[–] paraphrand@lemmy.world 3 points 1 month ago

The CTO of Clownstrike presided over a similar disaster in 2010 too. AFAIK.

[–] NOT_RICK@lemmy.world 19 points 1 month ago (1 children)

Nah real men commit straight to prod. Why yes, I do have 13 bastard children, condoms are also for cowards

[–] Lost_My_Mind@lemmy.world 9 points 1 month ago (1 children)

Guys.....this is TOTALLY Rick. He's just avoiding his child support payments.

[–] NOT_RICK@lemmy.world 2 points 1 month ago

I invoke the shaggy defense

[–] TimeSquirrel@kbin.melroy.org 7 points 1 month ago

Yes, don't do what I do at home and edit live PHP with users on the server...

[–] Ok_imagination@lemmy.world 3 points 1 month ago (1 children)

If they're as slow to roll out the updates to CS as they are the rest of the updates we'll be a year behind on CS updates haha.

[–] BarbecueCowboy@lemmy.world 8 points 1 month ago* (last edited 1 month ago)

Been awhile since we've POCed Crowdstrike, but I don't think you can set the cadence on updates for Crowdstrike. I believe Crowdstrike enforces auto-updates, it was at least the default setting.

[–] praise_idleness@sh.itjust.works 2 points 1 month ago

afaik It wasn't a software update that we all think. It was a content update that you can't even delay update(I'm assuming it's fordidentifying new viruses...etc). Updating software itself can be delayed and was usually being tested by IT guys before doing so. Content update however seemed harmless and wasn't the case.

Crowdstrike fucked up. There seems to be nothing mucy IT depts could've done.

[–] melroy@kbin.melroy.org 1 points 1 month ago

Deploy to prd! I'm on holiday.

[–] 0x0@programming.dev 32 points 1 month ago (1 children)

Cmon guys, it's Crowdstrike implementing the 4 day week.

[–] candybrie@lemmy.world 24 points 1 month ago

Or the 7 day week if you're in IT.

[–] melroy@kbin.melroy.org 16 points 1 month ago

Luckily I'm using Linux!

[–] altima_neo@lemmy.zip 3 points 1 month ago (1 children)

What is crowd strike and is it a Microsoft product?

[–] Aatube@kbin.melroy.org 48 points 1 month ago* (last edited 1 month ago)

CrowdStrike is a popular third-party suite of security software that has forced OTA updates. https://www.cnn.com/2024/07/19/tech/crowdstrike-update-global-outage-explainer/index.html It’s not a Microsoft product.

[–] prettydarknwild@lemmy.world 2 points 1 month ago

crowdstrike doing just a little of tomfoolery