Payment webhooks from Stripe, Apple, and Google are revenue-critical but prone to ordering issues and duplicates. A single bug can corrupt subscription state with no recovery path. A new system uses AWS Kinesis Data Streams as an immutable event log, enabling full replay to rebuild state from scratch.

The architecture routes webhooks through API Gateway to a Lambda ingestion function, which writes raw events to Kinesis. A second Lambda processor reads the stream, sorts events, and uses DynamoDB conditional writes for idempotency. This setup ensures events are preserved for replay, even if processing logic fails.

When data loss occurs, a replay script pulls events from Kinesis and reprocesses them, skipping duplicates. This is vital for recovering from bugs, debugging revenue discrepancies, or handling provider outages. The entire system costs roughly $30 monthly for moderate volume, treating the event stream as a source of truth.