Build and review a complete Data Engineering project.
Project brief
Required concepts
- Data source contracts: preserve raw records before transformation
- Incremental extraction: advance a compound watermark without losing ties
- Change data capture: apply updates and deletes by source order
- Idempotent loads: commit target rows and extraction progress together
- Event time and late arrivals: close windows with an explicit correction policy
- Data quality gates: quarantine bad rows and reconcile complete batches
- Warehouse history: join facts to the dimension version valid at event time
- Backfills: rebuild history without exposing a half-written result
Completion standard
Submit inputs, runnable work, measured output, failure-case results and a short decision note.