September 2025: Web services go down due to Caddy update: Difference between revisions
Jump to navigation
Jump to search
No edit summary Tag: Reverted |
m Sirdog moved page September 2025: Web services go down due to Caddy update to October 2025: Web services go down due to Caddy update without leaving a redirect |
(No difference)
| |
Revision as of 13:18, 6 October 2025
Template:Sysop incident header
Narrative
On September 26th, 2025 SierraKomodo observed after logging into the EDC machine that there were 50 packages ready to be updated. She then ran the update command in line with usual best practice. Following this, all web services operating on the machine became unresponsive. Sushiloid happened to be available in text while discussing an unrelated incident. After brief investigation, he determined that the update command replaced the machine's custom Caddy binary, which included within it a module that allowed Caddy to communicate with Cloudflare.
Shortly thereafter Sushiloid re-installed the relevant binary and web services were promptly restored.