13 of 13 Change Data Capture Jobs

Solutions Architect - Inside IR35 - Hybrid Overview We are seeking an experienced and highly skilled Data Engineer to join our growing data team. This role focuses on designing, building, and maintaining scalable data integration solutions using modern cloud technologies, with a strong emphasis on AWS and Snowflake. … Step Functions Build and optimize data models and transformations using Snowflake and dbt Core Implement and manage Change Data Capture (CDC) processes using tools such as Qlik Replicate Design and develop AWS-hosted APIs to support data access and integration requirements Collaborate with cross-functional ...

South Norfolk and Broadland Councils are looking for a Data Engineer to join our Strategy and Innovation Team. In this role, you'll be key to us being able to use our data to understand and improve our performance and integrate services. You'll figure out data structures and transform that data for other operational purposes and for analytical reporting, working with officers across the Council who use those systems day to day or who need to understand how the services run. You'll work in a team advancing the Council's ability to make ...

truth for cross-team BI, regulatory reporting, and historical trend analysis). - Orchestration: Kubernetes (EKS), Terraform, Ansible and on-prem. - Data Pipelines: Kafka, CDC (Change Data Capture) tools like Debezium. Key Responsibilities - Multi-Engine Management: Administer a hybrid database environment, ensuring seamless data flow between … PostgreSQL (Live Trading) and ClickHouse/Snowflake (Analytics). - Data Movement & ETL: Own the reliability of CDC pipelines that stream data from production Postgres instances into the analytical layer. - Schema Evolution: Manage schema changes across different engines, ensuring that transactional data models translate effectively into columnar formats ...

Glue, and Redshift Define and execute data validation, reconciliation, and cutover strategies ensuring zero/low data loss Enable CDC-based replication and minimal downtime migrations across heterogeneous systems Design and optimize ETL/data pipelines using AWS Glue, PySpark, or EMR Architect and implement scalable, secure … proficiency in SQL and data modeling concepts Experience working with S3-based data lakes and Glue Data Catalog Strong understanding of CDC, transaction consistency, and migration cutover strategies Hands-on experience with performance tuning, schema design, and query optimization Proficiency in Python/PySpark and scripting (Shell ...

Palantir Solution Architect (Manager) Lead Data Solutions at Scale Location: Flexible/Hybrid Are you an experienced Palantir Solution Architect (Manager) looking for your next challenge? Our client, a leading organisation in the data and digital space, is seeking a highly skilled Palantir Solution Architect (Manager) to join … their growing team. This is a fantastic opportunity for a Palantir Solution Architect (Manager) to work on complex, high-impact data platforms while leading talented agile teams. As a Palantir Solution Architect (Manager) , you will play a critical role in shaping modern data solutions, driving technical excellence ...

Glue, and Redshift. Define and execute data validation, reconciliation, and cutover strategies ensuring zero/low data loss. Enable CDC-based replication and minimal downtime migrations across heterogeneous systems. Design and optimize ETL/data pipelines using AWS Glue, PySpark, or EMR. Architect and implement scalable, secure … proficiency in SQL and data modeling concepts. Experience working with S3-based data lakes and Glue Data Catalog. Strong understanding of CDC, transaction consistency, and migration cutover strategies. Hands-on experience with performance tuning, schema design, and query optimization. Proficiency in Python/PySpark and scripting (Shell ...

seeking a Data Solutions Architect to join a and support with a critical piece of work for a consultancy client of ours who are working with a customer in the financial services sector.**Key Responsibilities:** * Strong knowledge and hands on experience of the AWS Data integration stack … Lambdas, Eventbridge, SQS, Step Functions etc* Strong knowledge and hands on experience of Snowflake* Strong knowledge and hands on experience of data transformation tools such as dbt core* Strong knowledge and hands on experience with Change Data Capture software such as Qlik Replicate* Experience of designing ...

Strong knowledge and hands on experience of the AWS Data integration stack: S3, Lambdas, Eventbridge, SQS, Step Functions etc Strong knowledge and hands on experience of Snowflake Strong knowledge and hands on experience of data transformation tools such as dbt core Strong knowledge and hands on experience with … Change Data Capture software such as Qlik Replicate Experience of designing and building AWS Hosted APIs Experience of preparing and presenting designs at governance forums Knowledge and experience of Cloud to on-premises AWS Network routing Knowledge of Cloud database and mainframe database technology Experience of working ...

GenAI Data Engineer Location: London/Edinburgh - (Hybrid - 2 days per week in the office) Day Rate: Market rate (Inside IR35) Duration: 6 months The Role We are seeking a highly skilled GenAI Data Engineer to join a forward-thinking team delivering advanced data and AI solutions. … distributed data processing (ETL/ELT pipelines) Advanced SQL expertise, including schema design (star/snowflake), indexing and optimisation techniques Proven experience implementing CDC and SCD (Type 1/2/3) in data warehousing environments Advanced Python skills for data engineering, automation and AI/ ...

Role GenAI Data Engineer Your responsibilities: Design and maintain scalable data pipelines using PySpark, Python, and distributed computing frameworks to support high‐volume data processing. Architect and optimize AWS-based data and AI infrastructure, ensuring secure, performant, and cost‐efficient ingestion, transformation, and storage. Develop, finetune … processing, and largescale ETL/ELT pipelines. Strong SQL expertise including star/snowflake schema design, indexing strategies, writing optimized queries, and implementing CDC, SCD Type 1/2/3 patterns for reliable data warehousing. Advanced proficiency in Python for data engineering, automation, and ML/ ...

conventions) Lead platform engineering and infrastructure delivery (IaC, networking, security, environment setup) Oversee migration of ~8–10 enterprise databases into AWS using DMS and CDC patterns Ensure migration pipelines are scalable, automated, and resilient Enable event-driven and batch data pipelines (S3, Lambda, orchestration) Ensure data lineage, cataloguing …/networking, DMS Proven experience with Infrastructure-as-Code (Terraform) and CI/CD pipelines Experience delivering large-scale data migrations, including CDC approaches Strong Python and SQL skills Understanding of data platforms (e.g. Snowflake/CDP) and ingestion pipelines Exposure to AI/ML enablement frameworks (.e.g ...

Your Responsibilities: Design and maintain scalable data pipelines using PySpark, Python, and distributed computing frameworks to support high‐volume data processing. Architect and optimize AWS-based data and AI infrastructure, ensuring secure, performant, and cost‐efficient ingestion, transformation, and storage. Develop, finetune, benchmark, and evaluate GenAI/… processing, and largescale ETL/ELT pipelines. Strong SQL expertise including star/snowflake schema design, indexing strategies, writing optimized queries, and implementing CDC, SCD Type 1/2/3 patterns for reliable data warehousing. Advanced proficiency in Python for data engineering, automation, and ML/ ...

Functions, etc.) Leading architecture across a modern Snowflake data platform Applying dbt Core for modular, version-controlled data transformation Designing and implementing CDC pipelines (e.g., Qlik Replicate) Building AWS-hosted APIs and supporting secure cloud-to-on-prem connectivity Working with cloud and mainframe database technologies Presenting architecture … Looking For Deep hands-on experience across AWS data services Strong Snowflake expertise Real-world experience with dbt Core Strong understanding of CDC tooling (preferably Qlik Replicate) Proven experience designing cloud-based APIs Knowledge of hybrid networking routes between AWS and on-prem Confident communication and stakeholder engagement skills ...