Lead Data Migration Engineer

The team you'll be working with:We are seeking an accomplished and detail-oriented Lead Data Migration Engineer to join our Data & AI practice. The successful candidate will bring deep expertise in data migration, ETL/ELT pipeline engineering, and cloud-native data platforms, with a strong focus on AWS-based Data Lakehouse architectures.This role is critical in designing, building, and validating end-to-end data migration pipelines, enabling the seamless transition of data from legacy data warehouses to modern cloud platforms. You will play a key role in ensuring data quality, integrity, and performance, particularly through robust testing and validation of ETL pipelines.As a senior practitioner, you will collaborate with architects, engineers, and analysts to deliver secure, scalable, and high-performing migration solutions, leveraging technologies such as AWS Glue, Apache Iceberg, Python/PySpark, SQL, and YAML-based configurations.You will thrive in a collaborative, client-facing environment, with a passion for solving complex data challenges, ensuring delivery excellence, and driving modernisation through data migration initiatives.What you'll be doing:Client Engagement & DeliveryWork as a senior engineer within data migration programmes, supporting delivery across complex transformation initiativesCollaborate with architects and stakeholders to implement migration strategies and technical solutionsContribute to project planning, estimation, and execution of migration deliverablesData Migration EngineeringDesign, build, and optimise data migration pipelines from legacy data warehouses to AWS-based Data Lakehouse platformsDevelop and maintain ETL/ELT pipelines using:AWS GluePython / PySparkSQLYAML-driven configurationsImplement bulk data migration processes followed by incremental/delta loadsSupport pipeline repointing and replatforming to target cloud architecturesData Pipeline Testing & Validation (Core Focus)Test end-to-end ETL data solutions running on AWS services, including AWS Glue and Apache IcebergValidate data feed pipeline migrations transitioning to new AWS Data Lakehouse architecturesTest pipelines underpinned by:AI ETL acceleratorsPython/PySpark transformationsSQL-based logicYAML configuration-driven orchestrationExecute and validate:Initial bulk data loadsSubsequent incremental/delta migrationsDevelop and run SQL-based validation and reconciliation queries to ensure:Data completenessData accuracyTransformation correctnessSupport creation of automated testing and validation frameworksAWS Data Platforms & LakehouseWork hands-on with AWS cloud services, including:AWS GlueS3-based data lakesSupport implementation of Data Lakehouse architectures, including Apache IcebergOptimise data pipelines for performance, scalability, and reliability in cloud environmentsData Modelling & TransformationApply data transformation logic aligned to migration mapping rulesSupport data modelling activities required for target-state schemasEnsure consistency between source and target systems during migrationCollaboration & Best PracticesCollaborate with:Solution ArchitectsData EngineersData Migration ArchitectsAnalysts and QA teamsPromote engineering best practices, reusable components, and automationContribute to migration accelerators and reusable frameworksQuality, Governance & SecurityEnsure data integrity, quality, and traceability throughout migration processesFollow best practices for secure data handling in regulated environmentsSupport compliance with:GDPRUK public sector data requirements (where applicable)Contribute to audit and validation processesWhat experience you'll bring:Proven experience in data engineering and data migration delivery, particularly within cloud environmentsStrong focus on data pipeline testing, validation, and quality assuranceAbility to work across the full data lifecycle, with emphasis on migration and transformationStrong analytical, problem-solving, and communication skillsExperience working in client-facing and delivery-focused environmentsAbility to mentor junior engineers and contribute to team deliveryTechnical ExpertiseStrong hands-on experience with:AWS cloud services, especially AWS GluePython / PySpark for data transformationSQL for querying, validation, and reconciliationYAML configuration for pipeline orchestrationExperience testing and validating:End-to-end ETL/ELT pipelinesData migration workflowsFamiliarity with:Apache Iceberg and Lakehouse architecturesDistributed processing frameworks (e.g., Apache Spark)Data lake environmentsUnderstanding of:ETL vs ELT design patternsMigration performance tuningExperience with version control and CI/CD tools desirableWho we are:We’re a business with a global reach that empowers local teams, and we undertake hugely exciting work that is genuinely changing the world. Our advanced portfolio of consulting, applications, business process, cloud, and infrastructure services will allow you to achieve great things by working with brilliant colleagues, and clients, on exciting projects.Our inclusive work environment prioritises mutual respect, accountability, and continuous learning for all our people. This approach fosters collaboration, well-being, growth, and agility, leading to a more diverse, innovative, and competitive organisation. We are also proud to share that we have a range of Inclusion Networks such as: the Women’s Business Network, Cultural and Ethnicity Network, LGBTQ+ & Allies Network, Neurodiversity Network and the Parent Network.For more information on Diversity, Equity and Inclusion please click here: Creating Inclusion Together at NTT DATA UK | NTT DATAwhat we'll offer you:We offer a range of tailored benefits that support your physical, emotional, and financial wellbeing. Our Learning and Development team ensure that there are continuous growth and development opportunities for our people. We also offer the opportunity to have flexible work options.You can find more information about NTT DATA UK & Ireland here: are an equal opportunities employer. We believe in the fair treatment of all our employees and commit to promoting equity and diversity in our employment practices. We are also a proud Disability Confident Committed Employer - we are committed to creating a diverse and inclusive workforce. We actively collaborate with individuals who have disabilities and long-term health conditions which have an effect on their ability to do normal daily activities, ensuring that barriers are eliminated when it comes to employment opportunities. In line with our commitment, we guarantee an interview to applicants who declare to us, during the application process, that they have a disability and meet the minimum requirements for the role.If you require any reasonable adjustments during the recruitment process, please let us know. Join us in building a truly diverse and empowered team.