Design a Cloud Log Ingestion and Cold Archival Pipeline

Shows a durable message queue or staging buffer between collectors and indexing workers to absorb traffic spikes and prevent data loss.

Demonstrates a clear split between expensive indexed hot storage and cheap object storage for cold logs, addressing the primary theme directly.

Accurately translates daily ingestion volumes and peak factors into peak throughput, network bandwidth, and raw storage sizing requirements.

Explains how client agents and ingestion gateways handle downstream database outages or network partitions without losing data.

Includes a mechanism at the edge or ingestion layer to drop or sample low-value logs before incurring expensive indexing costs.

Every functional requirement in the brief is visibly served by something on the board, and the non-functional targets are addressed rather than ignored.

Components are labelled, data flows are drawn as connections between them, and the direction of each flow is unambiguous.