Elektrine
Log in Register
Paige Chat Timeline Gallery Friends Email Drive DNS Private DNS Domains VPN Kairo Nerve
Remote

Lorin Hochstein :verified:

@norootcause@hachyderm.io
mastodon 4.7.3
  • Open on hachyderm.io

Student of complex systems failures, resilience engineering, cognitive systems engineering. Will talk your ear off about learning from incidents in software.

0 Followers
0 Following
43 Posts
Joined November 20, 2022
blog:
https://surfingcomplexity.blog
website:
https://lorinhochstein.org
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 2w ago
Today's blog post: a play in one act. https://surfingcomplexity.blog/2026/09/19/how-the-incident-happened-a-play-in-one-act/
How the incident happened: a play in one act
Surfing Complexity

How the incident happened: a play in one act

A hallway in a tech company office. A and B are standing in the hallway. B is holding a multiple page document. A: Wow, that incident from a couple of weeks ago was a real doozy. Do you know how it…

30
5
24
1
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 2w ago
"The engineer who, at forty, can still use a slide rule or logarithmic table, and make a true drawing, is a failure". – Everett Hughes, 1958. As a fifty-year-old individual contributor: ouch!
16
1
4
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

The three skills with a lot less overlap than you’d expect:

1. Ability to code.
2. Ability to perform well in a coding interview.
3. Ability to validate code.

409
42
181
1
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 1mo ago
I wrote up some thoughts on Boris Tane's argument for putting AI agents on-call. https://surfingcomplexity.blog/2026/08/22/wild-ai-related-reliability-incidents-are-coming/
surfingcomplexity.blog
21
5
19
2
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

Looking for a little less machine learning and a little more human learning

36
2
16
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

New blog post about Erik Hollnagel's Safety-II model: https://surfingcomplexity.blog/2026/04/26/the-normal-work-of-creating-reliability/

surfingcomplexity.blog
21
10
13
1
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

Automation can only solve your reliability problems if that automation is perfect. But if you were capable of writing perfect software, we wouldnt be talking about your reliability problems.

Automation is only part of the reliability story, you’ve got to be ready for when it breaks, too. Because I promise you, your reliability automation is going to break. Will you be ready for when it does?

23
1
11
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 16mo ago

Ad blockers, but for AI

130
6
68
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago
Replying to
I keep writing the same post over and over because the same thing keeps happening over and over!
16
8
1
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

The consequences of being able to generate code with AI much more quickly than we can validate that code is Nature’s way of teaching us about Erik Hollnagel’s ETTO Principle. https://www.erikhollnagel.com/ideas/etto-principle/index.html

erikhollnagel.com
24
2
16
1
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

According to the data, we shouldn’t trust the data

12
2
2
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

It's counterintuitive, but you can learn about the nature of successful work from incidents, even though the incident was a failure case. I wrote a blog post about that here:

https://surfingcomplexity.blog/2026/05/02/how-incidents-can-teach-us-about-whats-already-working-well/

How incidents can teach us about what’s already working well
Surfing Complexity

How incidents can teach us about what’s already working well

Here’s a famous optical illusion, which was developed by the American neuroscientist Edward H. Adelson. Source Even though square A appears darker than square B, the two are, in fact, the exa…

12
0
11
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

I’ve heard of “Nimrod” primarily because of

11
67
22
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

New blog post about flipping the bozo bit: https://surfingcomplexity.blog/2026/05/09/flipping-the-bozo-bit-on-flips-the-learning-off/

surfingcomplexity.blog
10
2
11
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

RE: @giflian@techhub.social

What a time to be alive

techhub.social
13
1
4
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

Jim Calabro did an excellent write-up of a recent Bluesky outage, I learned a lot from it. I wrote my own post here: https://surfingcomplexity.blog/2026/04/12/thoughts-on-the-bluesky-public-incident-write-up/

Thoughts on the Bluesky public incident write-up
Surfing Complexity

Thoughts on the Bluesky public incident write-up

Back on April 4, the social media site Bluesky suffered a pretty big outage. I was delighted to discover that one of their engineers, Jim Calabro, published a public writeup about it: April 2026 Ou…

13
3
4
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

RE: @levelbot@mastodon.social

There’s no way this reading is accurate

mastodon.social
10
2
2
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

Cloudflare announces a huge layoff and then, the very same day, an availability zone in AWS’s us-east-1 region loses power due to a “thermal event”. Coincidence???

Well, yes

9
0
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 2mo ago
Software engineering research question I’ve always wondered about (although less relevant in the age of AI): are developers more productive when working in their preferred language compared to working in a language imposed upon them due to business constraints?
2
0
2
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

You get what the system is optimized for.

10
0
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

Saturation: a never-ending series. https://www.githubstatus.com/incidents/ql942tw29yl6

githubstatus.com
6
0
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

Oops! All AI companies!

7
0
1
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

GitHub's had some availability issues lately. Their CTO wrote a blog post with some details about recent incidents. I wrote a quick post with my reaction here: https://surfingcomplexity.blog/2026/03/12/quick-thoughts-on-github-ctos-post-on-availability/

surfingcomplexity.blog
8
0
4
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 4mo ago
Bonus blog post for today about my instinctual revulsion towards AI slop: https://surfingcomplexity.blog/2026/06/06/i-cant-bear-to-read-ai-generated-prose/
surfingcomplexity.blog
3
0
1
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

Prediction: Within the next two years, the New York Times will write a story about people who are unable to prove they are not AIs (à la CAPTCHAs).

6
0
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

RE: @regehr@mastodon.social

Is there a burn ward nearby?

mastodon.social
4
0
0
1
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

Seamlessness is, indeed, a worthwhile goal; systems fail at the seams.

3
4
1
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 7mo ago

New blog post on the surprising increases in load faced by AI companies and the operational consequences: https://surfingcomplexity.blog/2026/03/07/grow-fast-and-overload-things/

surfingcomplexity.blog
5
0
4
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago
Replying to
@regehr Welcome to my world. https://surfingcomplexity.blog/2026/04/12/thoughts-on-the-bluesky-public-incident-write-up/
Thoughts on the Bluesky public incident write-up
Surfing Complexity

Thoughts on the Bluesky public incident write-up

Back on April 4, the social media site Bluesky suffered a pretty big outage. I was delighted to discover that one of their engineers, Jim Calabro, published a public writeup about it: April 2026 Ou…

3
2
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

I’m very concerned about the aliens already walking among us who are going to insider trade on this market: https://kalshi.com/markets/kxaliens/aliens/kxaliens-27

kalshi.com
2
0
2
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

Tired: old code that calls new code (extensibility!)
Wired: old code that breaks new code (latent failures!)

2
0
1
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago
Replying to
@marick I suspect my followers skew older in general.
3
4
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

Managing the risk of saturation, AI edition: https://www.infoworld.com/article/4151196/anthropic-throttles-claude-subscriptions-to-meet-capacity.html

Anthropic throttles Claude subscriptions to meet capacity
InfoWorld

Anthropic throttles Claude subscriptions to meet capacity

Analysts say this could be a strategy to push users and enterprises toward more predictable API-based plans.

2
0
1
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago
Replying to
@shriramk @rk Is vibe-verification a thing yet?
2
3
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago
Replying to
@dan@discuss.systems of course
1
0
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

Which of these technologies will become practical in your lifetime?

1
9
4
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

If you live with a partner (or partners) and you all work from home, how do you communicate with each other during the work day?

1
2
3
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 44mo ago

All metrics are subjective, it’s just that you don’t see the subjectivity because it’s baked in at metric definition time. What you decide to measure and how you decide to measure it are both subjective decisions.

23
1
15
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

If you celebrate Passover, which of these do you commonly eat at a Passover seder?

0
0
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago
Replying to
@jawnsy Feels like a “ha, ha, only serious” response
0
0
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago
Replying to
@palvaro@discuss.systems How long did you work there?
0
2
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

RE: @ezrasf@mas.to

We want goblin mode!

mas.to
0
0
0
0
Back
313k7r1n3
Elektrine

Tor hidden service

elekhj7afj4qnrr4yd3bkzslsyo5jgfxw3orgjkhlcxifueodybyiiad.onion

I2P eepsite

j6b6cyk6gjmepjih7jjadxgxvvf3lzzujljuu2v4biemzpg3naya.b32.i2p

Platform

  • Email
  • Chat
  • Timeline
  • VPN
  • DNS

Company

  • About
  • Contact
  • FAQ
  • Lite (no JS)

Legal

  • Terms of Service
  • Privacy Policy
  • Transparency Report
  • Report Abuse
  • Warrant Canary
  • VPN Policy

Support

  • support@elektrine.com
  • Report Security Issue
Mail client setup IMAP mail.elektrine.com:993 POP3 mail.elektrine.com:995 SMTP mail.elektrine.com:465
© 2026 Elektrine. All rights reserved. Server: 16:05:03 UTC