Sep 29 Incident Update: Read-Only Repls
Replit attempted to deploy an asynchronous batch commit system for filesystem snapshots to production. This feature was intended to optimize filesystem access and save operations by decoupling commit execution from the main process.
Verified State Diff
Impact & Verification Analysis
Replit users who accessed their Repls between 14:00 and 16:30 Pacific Time on September 29.
The incident highlights critical risks in CI/CD pipelines regarding infrastructure-level feature flags and the complexity of maintaining data integrity in distributed filesystem snapshot systems.
Full Fact Overview
The incident originated from a deployment error where an unfinished storage optimization feature was pushed to production clusters instead of the intended test environment. The architecture relies on a manifest-based snapshot system for filesystem management, which was being modified to support asynchronous batching of commits. The premature deployment caused I/O errors and read-only filesystem states for Repls accessed during the 2.5-hour window, as the incomplete code failed to correctly handle manifest writes and garbage collection processes.