https://hypercrux.com/tags/operations/ Recent content in Operations on HyperCrux.com Hugo en-us Wed, 07 Oct 2026 00:00:00 +0000 https://hypercrux.com/at-3-a.m.-find-the-incident-that-looks-like-this-one-on-call-notes-with-links-and-similarity/ Wed, 07 Oct 2026 00:00:00 +0000 https://hypercrux.com/at-3-a.m.-find-the-incident-that-looks-like-this-one-on-call-notes-with-links-and-similarity/ <p>Think of a platform team of six that keeps an online shop&rsquo;s checkout running. Every incident gets a short write-up afterwards, saying what broke and what fixed it. After a few years that&rsquo;s a few hundred pages in the team wiki, full of hard-won knowledge that nobody can find at 3 a.m.</p> <p>The question at 3 a.m. is &ldquo;has this happened before?&rdquo; Wiki search matches words, and the words in an alert rarely match the words in a write-up. The alert says connection refused. The write-up from March says checkout errors after a database failover. They describe the same problem from opposite ends. And on a truly bad night the wiki may be down too, if it runs on the same infrastructure that&rsquo;s failing.</p>