21 of 21 Change Data Capture Jobs in the UK excluding London

data layers using Medallion Architecture principles. Build and maintain ETL/ELT pipelines across batch, streaming and Change Data Capture (CDC) workloads. Develop reusable transformation frameworks, data models and curated datasets using Python, SQL and dbt. Support data migration and integration activity across … Athena and EventBridge. Experience implementing Medallion Architecture, including Bronze, Silver and Gold data layers. Strong data engineering experience across batch, streaming and CDC ingestion patterns. Advanced SQL skills and strong Python development experience. Experience using dbt for data transformation and modelling would be highly beneficial. Experience building ...

love making it sparkle for millions of Very customers. About the Role You’ll be one of the technical experts within the Data Enablement team, a hands-on Principal Data Engineer at the heart of our data transformation. You’ll work across multiple initiatives, partnering with Engineering … enterprise data platforms. A solid understanding of modern data engineering concepts such as data ingestion, change data capture (CDC), data modelling, and analytics. Experience working with version control, CI/CD, and modern engineering practices. A collaborative mindset and a willingness to learn ...

love making it sparkle for millions of Very customers. About the Role You'll be one of the technical experts within the Data Enablement team, a hands-on Principal Data Engineer at the heart of our data transformation. You'll work across multiple initiatives, partnering with Engineering … enterprise data platforms. A solid understanding of modern data engineering concepts such as data ingestion, change data capture (CDC), data modelling, and analytics. Experience working with version control, CI/CD, and modern engineering practices. A collaborative mindset and a willingness to learn ...

Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start and end times … and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) Experience with data product thinking, domain-oriented ownership or federated operating models Understanding of data standards and industry models ...

make your mark? Join us and be part of something bigger. MAIN PURPOSE OF THE ROLE & RESPONSIBILITIES IN THE BUSINESS: As a Senior Data Engineer (Senior Associate) at Kainos, you will be responsible or designing and developing data processing and data persistence software components for solutions which … complex data transformations Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products Expertise in continuous improvement and sharing input on data best practice Practical experience with AI technologies, tools, processes and delivery Embracing our differences ...

monitoring**Data Engineering*** Strong Python, PySpark, and SQL development skills* Design and build ingestion and transformation pipelines* Full and incremental data loading* CDC (Change Data Capture) implementation* Data quality controls, schema evolution, reconciliation, and error handling**Integration Development*** REST API integration experience* Integration with … Zone & Migration Support*** Experience enabling application deployment within Databricks* BI tooling integration and scheduling* Support for POSIT/RStudio migration activities**Collaboration*** Working with Data Engineers, Data Scientists, and Platform Teams* Technical documentation and knowledge transfer* Agile delivery experience**Desirable Skills*** POSIT/RStudio migration experience* AI/ ...

mindset. On AWS, you’re fluent across the core services, for example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker … services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service), ML Data Product mentality ...

Senior AWS Data Engineer (Fixed Term Contract) When registering to this job board you will be redirected to the online application form. Please ensure that this is completed in full in order that your application can be reviewed. Join Microlise as a Senior AWS Data Engineer … cloud-native data pipelines, lakehouse structures and reusable data products on AW Ingest and transform data from operational systems using batch, CDC, event, file and API pattern Use lakehouse and medallion architecture concepts to move data from raw ingestion through to curated, business-ready product Create ...

seeking someone to join our Data Obfuscation team as a Full Stack Developer – Data Engineering to design and deliver scalable, secure, and reusable data platforms and services that support enterprise data protection and obfuscation initiatives. In the Technology division, we leverage innovation to build the connections … level, which is part of the job family responsible for monitoring, detecting, and responding to security incidents to ensure the organization's systems and data are protected from actual and potential threats or breaches. Since 1935, Morgan Stanley is known as a global leader in financial services, always evolving ...

Senior AWS Data Engineer (Fixed Term Contract) When registering to this job board you will be redirected to the online application form. Please ensure that this is completed in full in order that your application can be reviewed. Join Microlise as a Senior AWS Data Engineer … cloud-native data pipelines, lakehouse structures and reusable data products on AW Ingest and transform data from operational systems using batch, CDC, event, file and API pattern Use lakehouse and medallion architecture concepts to move data from raw ingestion through to curated, business-ready product Create ...

command of the Java language, spanning from low‐level optimisation to high‐level system architecture. Frameworks: Deep expertise within the Spring Boot ecosystem and data persistence frameworks (JPA/Hibernate). API Design: Proven experience in designing, building, and scaling high‐performance RESTful APIs. Database Management: Solid understanding … with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working in Linux environments, with strong communication skills and experience ...

column-level security, and PII handling. Define the streaming and batch ingestion architecture, building on our investments in NATS JetStream, Apache Flink, and Debezium CDC patterns, and direct the engineering team on execution. Specify the catalog, lineage, and data-quality foundation and own the operational practice that keeps them … experience with: Dremio, Snowflake, or Databricks AWS data services (S3, Glue, Athena, Lake Formation, or equivalent) NATS/Apache Kafka or similar, and CDC patterns (Debezium or equivalent) Stream processing (Apache Flink, Spark Structured Streaming, or equivalent) SQL and query optimisation at scale Data and table formats (Parquet ...

Security clearance requirements: BPSS level Storm ID is an award-winning Edinburgh-based digital transformation consultancy that helps organisations accelerate their use of digital, data and AI. We believe in tailored solutions, assembling expert teams to address each client's unique needs. Our services span strategy, design, technology … data & AI, ensuring seamless end-to-end delivery of platforms, products and services with real-world impact. Role Overview Storm ID has delivered the Alpha phase of a prominent Scottish Government digital transformation programme. The work is focused on shaping and validating an end-to-end service model, including ...

platforms that safeguard the nation's financial system . The Bank of England, in partnership with Inspire People, is seeking a Lead Solution Architect - Data Analytics with strong enterprise and solution architecture experience, deep knowledge of cloud-based data platforms, and a track record of delivering complex data … TOGAF, Zachman) Broad knowledge of enterprise data technologies, including lakehouse and medallion architectures, legacy data platforms and data engineering (ETL, ELT, CDC) Experience working within large, complex or highly regulated organisations In return, you can expect a flexible working culture, including: Non-contributory career-average pension. ...

Azure Databricks Data Engineer (Contract) | International Digital Infrastructure Organisation | London (Hybrid) 6-Month Initial Contract | Inside IR35 | 4 Days Onsite, 1 Day Remote We're partnering with a leading international digital infrastructure organisation undergoing a significant data transformation programme. Operating across multiple markets and supporting critical communications infrastructure … optimise Azure Databricks solutions using PySpark, Python, SQL, and Azure-native technologies. Build and maintain enterprise-grade ETL/ELT pipelines supporting ingestion, transformation, CDC, validation, and data delivery across multiple business functions. Develop and support Lakeflow pipelines, Delta Lake implementations, and modern data engineering frameworks. Drive best ...

Data Architect - Azure/Fabric Salary: up to £85,000 Location: West Yorkshire (1-2 days p/w) About the Opportunity Our client is a fast-growing RegTech group providing identity verification, AML, and digital compliance solutions to regulated businesses. Following a recent acquisition, they are bringing … room and come out with agreed definitions. Key Technologies Microsoft Fabric (OneLake, Lakehouse, Warehouse, Pipelines, Dataflows Gen2) Power BI and medallion architecture patterns CDC, streaming ingestion, and entity resolution SQL Server, Azure SQL Database, MySQL, Cosmos DB Azure integration services (API Management, Service Bus, Event Hubs, Functions, Logic Apps) Entra ...

Lead Data Quality & Platform Engineer London 5 days in the office Duration: 12-Month Contract Rate: £400/day to £450/day (Inside IR35) A top-tier firm is seeking an experienced Data Quality & Platform Engineer to shape, govern, and optimise core data environments … flows from ingestion to serving, defining upstream/downstream contracts and data ownership boundaries. Architect robust batch and streaming pipelines capable of handling CDC concepts, late-arriving data, incremental loads, and rerun safety. Drive pipeline health monitoring, logging-driven diagnoses, and automated reconciliation checks to triage and remediate ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Your role Capgemini Engineering is looking for OSS Data Architect who will be the senior technical authority responsible for designing the end-to-end data extraction, connectivity, and ingestion architecture. You will define … multiple data ingestion patterns, including batch file processing, API integration (REST/SOAP), RDBMS querying (JDBC), and real-time data streaming (CDC, Kafka, etc.). Deep understanding of hybrid cloud connectivity and security principles, including VPNs, dedicated interconnects, firewalls, and API security. Demonstrated ability to create and govern ...

powerful, enterprise-ready products are fuelled by beqom pay intelligence. Role Overview We are looking for a Senior Backend Engineer to join our Data Platform Core team, which owns the services at the heart of beqom’s data architecture - multi-tenant data ingestion, schema management, snapshots, calculated … tools. Experience with LLM evaluation: eval suites, behavioural test design, or benchmarking agent workflows. Functional programming in C# (LanguageExt - Either/Option patterns). CDC/event-driven ingestion (Debezium, Kafka) or lakehouse exposure (Microsoft Fabric). Azure services, Docker, Kubernetes/Helm. Familiarity with compensation, HR, or pay transparency ...

powerful, enterprise-ready products are fuelled by beqom pay intelligence. Role Overview We are looking for a Senior Agentic Backend Engineer to join our Data Platform Core team, which owns the services at the heart of beqom’s data architecture — multi-tenant data ingestion, schema management, snapshots … agent evaluation environments. Experience with LLM evaluation at scale: eval suites, red-teaming AI-generated code, benchmarking agent workflows. Multi-tenant SaaS architecture experience, CDC/event-driven ingestion (Debezium, Kafka, RabbitMQ/MassTransit), or lakehouse exposure (Microsoft Fabric). Azure services, Docker, Kubernetes/Helm. Experience with legal, security ...

environment. The role is focused on supporting and improving a business-critical AWS Aurora MySQL estate, with exposure to SaaS database services, reporting databases, data lake platforms and wider cloud tooling. You’ll be involved in the day-to-day running, performance and reliability of production and QA database … environments. Exposure to any of the following would be helpful, but not essential: AWS, CloudWatch, Performance Insights, Terraform, Ansible, Rundeck, MSSQL, data lakes, CDC tooling or event-driven systems. Why Apply? This is a strong opportunity to step into a visible database role where your work will directly support ...