Senior Data Engineer

BNA Principal Data Engineer. Own BNA pipeline architecture, orchestration and production readiness. Implement and review arbitration, eligibility, suppression, consent, contact-policy and cooldown logic. Own activation datasets/files, manifests, delivery status and SFTP integration. Sequence and approve PRs; enforce end-to-end, regression and production validation. Own production cutover, rerun/recovery, observability, alerting and incident technical response.

Mandatory Skills:

Advanced SQL; Python/Spark; Databricks data engineering; workflow orchestration; dependency management; idempotency; scheduled/triggered jobs; CI/CD; Git/Azure DevOps; PR review; unit/integration testing; environment promotion; production support; DQ controls; alerting; reconciliation; incident diagnosis.

Nice to have:

CRM decisioning; customer eligibility/consent and activation; practical Comarch and/or SFMC/SFTP interface experience.