1 to 25 of 70 Change Data Capture Jobs

Data Architect

Location
Greater London, England, United Kingdom
memory (Redis), time‐series (TimescaleDB/InfluxDB), and document (MongoDB) stores used by applications Design the data ingestion and movement architecture – real‐time CDC pipelines, batch ETL/ELT patterns, and event‐driven feeds from the NATS messaging layer into Snowflake Define data domain boundaries, ownership, and lineage … programme scale Comfortable working hands‐on – writing dbt models, reviewing SQL, profiling queries – while operating at senior stakeholder and architecture level Experience with CDC‐based real‐time data pipelines and event‐driven data integration patterns Strong communicator able to convey complex data architecture decisions to both engineering ...

Sr Data Analyst â Public Sector

Hiring Organisation
eStaffLLC
Location
Austin, Texas, United States
Employment Type
Permanent
Salary
USD Annual
seeking a Senior Data Analyst - Data Bridge Technical Lead -for a hybrid (2days/wk on-site) role with our Austin, Texas client. Can only submit local candidates. This role works alongside the Data Bridge Project Manager and serves as the technical data lead … Texas client's legacy-to-CCWIS data bridge initiative, coordinating and overseeing a multidisciplinary technical team. The initiative involves phased modernization of the legacy system, with legacy and new CCWIS environments operating simultaneously. The Senior Data Analyst will lead technical data activities supporting migration, integration, synchronization, reconciliation ...

Data Engineer

Hiring Organisation
Brio Digital
Location
Leeds, West Yorkshire, United Kingdom
Employment Type
Contract
Contract Rate
£500 - £550/day
data layers using Medallion Architecture principles. Build and maintain ETL/ELT pipelines across batch, streaming and Change Data Capture (CDC) workloads. Develop reusable transformation frameworks, data models and curated datasets using Python, SQL and dbt. Support data migration and integration activity across … Athena and EventBridge. Experience implementing Medallion Architecture, including Bronze, Silver and Gold data layers. Strong data engineering experience across batch, streaming and CDC ingestion patterns. Advanced SQL skills and strong Python development experience. Experience using dbt for data transformation and modelling would be highly beneficial. Experience building ...

Principal Data Engineer

Location
Greater London, England, United Kingdom
more than 38,000 trials and 12 million patients, Medidata offers industry-leading expertise, analytics-powered insights, and one of the largest clinical trial data sets in the industry. More than 1 million registered users across approximately 2,300 customers trust Medidata's seamless, end-to-end platform … refactoring, and performance tuning. Technical Strategy & Database Optimization: Promote technical direction and engineering best practices across teams for Change Data Capture (CDC), clustering, data migration, and aggregation. Use AI query-optimization tools to analyse execution plans, auto-tune complex Snowflake/Iceberg SQL workloads, and eliminate ...

Principal Data Engineer

Hiring Organisation
DASSAULT SYSTÈMES
Location
London, UK
Employment Type
Full-time
more than 38,000 trials and 12 million patients, Medidata offers industry-leading expertise, analytics-powered insights, and one of the largest clinical trial data sets in the industry. More than 1 million registered users across approximately 2,300 customers trust Medidata's seamless, end-to-end platform … refactoring, and performance tuning. Technical Strategy & Database Optimization: Promote technical direction and engineering best practices across teams for Change Data Capture (CDC), clustering, data migration, and aggregation. Use AI query-optimization tools to analyse execution plans, auto-tune complex Snowflake/Iceberg SQL workloads, and eliminate ...

Finance Data Engineer (Senior Manager)

Location
City Of London, England, United Kingdom
Finance RP Finance Data Engineer The practice Finance is one of the most demanding and valuable environments in which to apply modern technology. You will work with complex enterprise data, mission-critical processes and high-impact decisions, using AI, data and engineering to reshape how organisations plan … creates a differentiated career path that is difficult to develop in a purely technology-focused role. Purpose of the role Responsible for the finance data and ontology layer on which agentic solutions depend. Builds the entities, relationships, definitions, lineage and data contracts sourced from live ...

Finance Data Engineer (Senior Manager)

Location
Greater London, England, United Kingdom
Finance RP Finance Data Engineer The practice Finance is one of the most demanding and valuable environments in which to apply modern technology. You will work with complex enterprise data, mission‐critical processes and high‐impact decisions, using AI, data and engineering to reshape how organisations plan … creates a differentiated career path that is difficult to develop in a purely technology‐focused role. Purpose of the role Responsible for the finance data and ontology layer on which agentic solutions depend. Builds the entities, relationships, definitions, lineage and data contracts sourced from live ...

Finance Data Engineer (Consultant)

Location
Greater London, England, United Kingdom
Finance RP Finance Data Engineer The practice Finance is one of the most demanding and valuable environments in which to apply modern technology. You will work with complex enterprise data, mission‐critical processes and high-impact decisions, using AI, data and engineering to reshape how organisations plan … creates a differentiated career path that is difficult to develop in a purely technology‐focused role. Purpose of the role Responsible for the finance data and ontology layer on which agentic solutions depend. Builds the entities, relationships, definitions, lineage and data contracts sourced from live ...

Remote Lead Java Developer/Solution Architect (6-month contract)

Hiring Organisation
Gravity9
Location
Essex, United Kingdom
JSON transformation framework backed by a versioned schema registry — twenty years of history, multiple record types and continual schema and semantic drift; CDC and streaming pipelines, or a checkpointed parallel bulk-extract alternative; a field-level mapping validation and reconciliation framework robust enough to stand up to audit; a replay … aggregation pipelines, indexing and sharding strategies, and integrate them cleanly into Java service layers rather than through a leaky abstraction • Build data pipelines: CDC and streaming ingest, transformation frameworks, checkpointed batch extract workers, and MongoDB sink configuration and tuning at terabyte scale • Implement access control, encryption and audit within ...

Remote Lead Java Developer/Solution Architect (6-month contract)

Hiring Organisation
Gravity9
Location
Nottinghamshire, United Kingdom
JSON transformation framework backed by a versioned schema registry — twenty years of history, multiple record types and continual schema and semantic drift; CDC and streaming pipelines, or a checkpointed parallel bulk-extract alternative; a field-level mapping validation and reconciliation framework robust enough to stand up to audit; a replay … aggregation pipelines, indexing and sharding strategies, and integrate them cleanly into Java service layers rather than through a leaky abstraction • Build data pipelines: CDC and streaming ingest, transformation frameworks, checkpointed batch extract workers, and MongoDB sink configuration and tuning at terabyte scale • Implement access control, encryption and audit within ...

Remote Lead Java Developer/Solution Architect (6-month contract)

Hiring Organisation
Gravity9
Location
Highland, United Kingdom
JSON transformation framework backed by a versioned schema registry — twenty years of history, multiple record types and continual schema and semantic drift; CDC and streaming pipelines, or a checkpointed parallel bulk-extract alternative; a field-level mapping validation and reconciliation framework robust enough to stand up to audit; a replay … aggregation pipelines, indexing and sharding strategies, and integrate them cleanly into Java service layers rather than through a leaky abstraction • Build data pipelines: CDC and streaming ingest, transformation frameworks, checkpointed batch extract workers, and MongoDB sink configuration and tuning at terabyte scale • Implement access control, encryption and audit within ...

Remote Lead Java Developer/Solution Architect (6-month contract)

Hiring Organisation
Gravity9
Location
Merseyside, United Kingdom
JSON transformation framework backed by a versioned schema registry — twenty years of history, multiple record types and continual schema and semantic drift; CDC and streaming pipelines, or a checkpointed parallel bulk-extract alternative; a field-level mapping validation and reconciliation framework robust enough to stand up to audit; a replay … aggregation pipelines, indexing and sharding strategies, and integrate them cleanly into Java service layers rather than through a leaky abstraction • Build data pipelines: CDC and streaming ingest, transformation frameworks, checkpointed batch extract workers, and MongoDB sink configuration and tuning at terabyte scale • Implement access control, encryption and audit within ...

Remote Lead Java Developer/Solution Architect (6-month contract)

Hiring Organisation
Gravity9
Location
Durham, United Kingdom
JSON transformation framework backed by a versioned schema registry — twenty years of history, multiple record types and continual schema and semantic drift; CDC and streaming pipelines, or a checkpointed parallel bulk-extract alternative; a field-level mapping validation and reconciliation framework robust enough to stand up to audit; a replay … aggregation pipelines, indexing and sharding strategies, and integrate them cleanly into Java service layers rather than through a leaky abstraction • Build data pipelines: CDC and streaming ingest, transformation frameworks, checkpointed batch extract workers, and MongoDB sink configuration and tuning at terabyte scale • Implement access control, encryption and audit within ...

Remote Lead Java Developer/Solution Architect (6-month contract)

Hiring Organisation
Gravity9
Location
Merthyr tydfil, United Kingdom
JSON transformation framework backed by a versioned schema registry — twenty years of history, multiple record types and continual schema and semantic drift; CDC and streaming pipelines, or a checkpointed parallel bulk-extract alternative; a field-level mapping validation and reconciliation framework robust enough to stand up to audit; a replay … aggregation pipelines, indexing and sharding strategies, and integrate them cleanly into Java service layers rather than through a leaky abstraction • Build data pipelines: CDC and streaming ingest, transformation frameworks, checkpointed batch extract workers, and MongoDB sink configuration and tuning at terabyte scale • Implement access control, encryption and audit within ...

Remote Lead Java Developer/Solution Architect (6-month contract)

Hiring Organisation
Gravity9
Location
East sussex, United Kingdom
JSON transformation framework backed by a versioned schema registry — twenty years of history, multiple record types and continual schema and semantic drift; CDC and streaming pipelines, or a checkpointed parallel bulk-extract alternative; a field-level mapping validation and reconciliation framework robust enough to stand up to audit; a replay … aggregation pipelines, indexing and sharding strategies, and integrate them cleanly into Java service layers rather than through a leaky abstraction • Build data pipelines: CDC and streaming ingest, transformation frameworks, checkpointed batch extract workers, and MongoDB sink configuration and tuning at terabyte scale • Implement access control, encryption and audit within ...

Finance Data Engineer (Senior Manager)

Location
Manchester, England, United Kingdom
Description UKI Finance RP Finance Data Engineer The practice Finance is one of the most demanding and valuable environments in which to apply modern technology. You will work with complex enterprise data, mission-critical processes and high-impact decisions, using AI, data and engineering to reshape … creates a differentiated career path that is difficult to develop in a purely technology-focused role. Purpose of the role Responsible for the finance data and ontology layer on which agentic solutions depend. Builds the entities, relationships, definitions, lineage and data contracts sourced from live ...

Data Engineer 12 month FTC Information Technology - Smiths Group - Birmingham

Location
United Kingdom
Description Responsible for designing and building the ingestion and transformation of data pipelines and maintain optimal data pipeline processes for the Smiths Group. Maintain the ingestion framework processes of data, apply security and governance of data as well as modelling to ensue data preparation … employing a verity of data ingestion and data preparations tools, or write code such as Scala Python, and Java Manage & Maintain CDC and Data Catalogue processes Creating and maintaining analytical extracts Identify Sensitive and confidential datasets and use appropriate framework methods to protect the data Monitoring ...

Principal Data Architect - Databricks & AI

Hiring Organisation
Wolters Kluwer
Location
London, UK
Employment Type
Full-time
opportunity We are investing in the next generation of our data and technology capabilities to create more connected, intelligent experiences for customers. Data is central to this ambition. This is an opportunity to define the architecture, standards and delivery patterns for a modern data platform that will … customer data. Strong data-modelling expertise across conceptual, logical, physical, dimensional and canonical models. Experience with batch and real-time integration, including APIs, CDC, streaming or event-driven pipelines. A strong data-engineering or software-development foundation using Python, SQL, Scala, Java and/or Spark. Deep experience ...

data engineer for customer data platforms

Location
Greater London, England, United Kingdom
Описание: Tecknuovo delivers data solutions that help customers make better use of their data. Its multidisciplinary delivery teams build data pipelines, platforms and integrations, and transfer knowledge so customer teams can own and evolve those solutions. Задачи: Design, build and maintain scalable data pipelines and processing solutions … Strong understanding of building scalable, secure and maintainable data solutions Practical experience with data replication and change data capture (CDC) technologies in large, complex environments Experience with Python, SQL, data pipelines, ETL/ELT, data modelling and cloud-based data platforms Ability ...

Data Analyst

Location
Biggin Hill, England, United Kingdom
marketing, or communications there is always a talented team working to maximise the potential of the sport. Role Overview: We are looking for a Data Analyst to join our IT department. Reporting into our IT Systems Manager, this role will maintain, develop and optimisation of data enterprise solutions. … Supporting the data lifecycle, including data ingestion, modelling and reporting across the IT Systems. Main Duties and Responsibilities Support data activities, data integration, warehousing and business intelligence Maintain and develop data ingestion processes using ELT methodologies Design and build scalable data pipelines and orchestration ...

Data Engineer

Location
Greater London, England, United Kingdom
about $500bn in assets. We have proved distribution, trust and demand. The most important infrastructure is still ahead of us. Your role As a Data Engineer, you will build the data foundations that Saturn’s products, AI systems, operations and decision-making depend on. Saturn is a Series … Combinator-backed company building the AI-native operating system for financial advice. Our platform combines a living data model of the client, AI agents that complete complex advice and operational workflows, and compliance logic embedded directly into how work is produced. All of that rests on data drawn ...

Lead Solution Data Architect in ARCHITECTURE

Location
Leeds, England, United Kingdom
Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start and end times … and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) Experience with data product thinking, domain-oriented ownership or federated operating models Understanding of data standards and industry models ...

Lead Solution Data Architect in ARCHITECTURE

Location
Greater London, England, United Kingdom
Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start and end times … and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) Experience with data product thinking, domain-oriented ownership or federated operating models Understanding of data standards and industry models ...

Data Engineer - Okemos/Farmington Hills, MI

Hiring Organisation
Digital Technology Solutions
Location
Farmington Hills, Michigan, United States
Employment Type
Permanent
Salary
USD Annual
looking for Data Engineer for our direct client position in Okemos/Farmington Hills, MI Job Description: Summary: We are looking for a Data Engineer to join our Data Engineering Team. The ideal candidate should have a minimum of 3 years of data engineering experience with … Enterprise Data Warehousing (EDW) work. The Data Engineering Team also creates data pipelines that use change data capture (CDC) mechanisms to move data from on-premises to cloud-based destinations. Responsibilities: Participates in the analysis and development of technical specifications, programming, and testing ...

Senior Data Engineer

Location
Belfast, County Antrim, United Kingdom
make your mark? Join us and be part of something bigger. MAIN PURPOSE OF THE ROLE & RESPONSIBILITIES IN THE BUSINESS: As a Senior Data Engineer (Senior Associate) at our client, you will be responsible or designing and developing data processing and data persistence software components for solutions … complex data transformations Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products Expertise in continuous improvement and sharing input on data best practice Practical experience with AI technologies, tools, processes and delivery Embracing our differences ...