Quadric - API cache issues – Incident details

All systems operational

API cache issues

Resolved
Major outage
Started about 1 month agoLasted 19 minutes

Affected

API

Major outage from 5:37 PM to 5:56 PM

Updates
  • Postmortem
    Postmortem

    While deploying some application and configuration updates a cache restart was required. When restarting the cache, loading from a corrupted saved snapshot caused startup failures.

    After removing the corrupted cache snapshot, we were able to successfully restart our cache service from a differently slightly older snapshot.

    We will investigate solutions to mitigate this problem if it occurs again.

  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring
    We implemented a fix and are currently monitoring the result.
  • Identified
    Identified

    We've identified the issue with the cache and are working on a fix.

  • Investigating
    Investigating
    We are currently investigating this incident.