How one line of code caused a $60 million loss
engineercodex.substack.com
external-link
60,000 people lost full phone service, half of AT&T's network was down, and 500 airline flights were delayed
@BeardedGingerWonder@feddit.uk
link
fedilink
English
11
edit-2
10M

Hahahaha, you’re kidding right? I shit you not, I’ve literally seen a single line change almost cost a company £150MM during testing because “we need to test in prod because the guy we need to run the test hasn’t got access to the QA environment”

Best part was the actual change, there was a bug where a number that should’ve been divided by 100 was being multiplied by 100, the dev somehow managed to implement the fix in such a way that the number was multiplied by a further 100.

snowe
mod
link
fedilink
210M

Knight Capital Group lost $440 million in just 45 minutes due to a repurposed feature flag.

https://www.henricodolfing.com/2019/06/project-failure-case-study-knight-capital.html?m=1

Kinda makes the att one seem tiny in comparison.

Create a post

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person’s post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you’re posting long videos try to add in some form of tldr for those who don’t want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev



  • 1 user online
  • 1 user / day
  • 1 user / week
  • 1 user / month
  • 1.11K users / 6 months
  • 1 subscriber
  • 1.21K Posts
  • 17.8K Comments
  • Modlog