Subnet 4ecnw down?

[sat]

I published a post mortem report here:

Post Mortem: subnets cv73p and 4ecnw failed upgrade process on March 27, 2024

Summary On March 27, 2024, between 11:42 UTC and 13:36 UTC, a critical incident occurred in the upgrade process, affecting two IC Mainnet subnets cv73p and 4ecnw, which resulted in a temporary interruption of services. This downtime impacted various user applications, including a few high-profile services. The root cause of the incident was traced to changes in error code mappings in the newly deployed replica version. Specifically, certain error codes that were used in the previous replica ver…

Feel free to dig in and leave a comment.