, framework components, design spikes, performance fixes). ETL orchestration & data movement Design and develop robust ETL... management, metadata-driven pipelines, and scalable runtime patterns. Optimise for performance, cost, and reliability...
, model validation, observability, performance tuning, security controls, documentation, and production-readiness gates... and engineering: Advanced Python and SQL; APIs; test automation; data structures; distributed processing; Git; CI/CD; containers...
, performance, recovery and support processes. Deliver production readiness: Secure operational sign-off, publish the service...
and infrastructure for performance and reliability. 6. Ensure compliance with security and governance policies in all IaC...