September 2025: Web services go down due to Caddy update

Revision as of 22:02, 5 October 2025 by Sirdog (talk | contribs) (Created page with "{{Sysop incident header|summary=Web services become unresponsive.|reporter=N/A|date-report=September 26th, 2025|date-resolved=September 26th, 2025 (~30 minutes)|cause=Caddy was reinstalled using it's generic package.|resolution=Custom Caddy binary re-installed.}} == Narrative == SierraKomodo, while attempting to resolve September 2025: Arma server becomes unresponsive, saw that there were 50 upgradeable packages on the machine. She then ran the update command with e...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Template:Sysop incident header

Narrative

SierraKomodo, while attempting to resolve September 2025: Arma server becomes unresponsive, saw that there were 50 upgradeable packages on the machine. She then ran the update command with elevated privileges. Following this, all web services operating on the machine became unresponsive. Sushiloid happened to be available in text while discussing the aforementioned incident. After brief investigation, he determined that the update command replaced the machine's custom Caddy binary, which included within it a module that allowed Caddy to communicate with Cloudflare.

Shortly thereafter Sushiloid re-installed the relevant binary and web services were promptly restored.