17 of 17 Change Data Capture Jobs

Solutions Architect - Inside IR35 - Hybrid Overview We are seeking an experienced and highly skilled Data Engineer to join our growing data team. This role focuses on designing, building, and maintaining scalable data integration solutions using modern cloud technologies, with a strong emphasis on AWS and Snowflake. … Step Functions Build and optimize data models and transformations using Snowflake and dbt Core Implement and manage Change Data Capture (CDC) processes using tools such as Qlik Replicate Design and develop AWS-hosted APIs to support data access and integration requirements Collaborate with cross-functional ...

South Norfolk and Broadland Councils are looking for a Data Engineer to join our Strategy and Innovation Team. In this role, you'll be key to us being able to use our data to understand and improve our performance and integrate services. You'll figure out data structures and transform that data for other operational purposes and for analytical reporting, working with officers across the Council who use those systems day to day or who need to understand how the services run. You'll work in a team advancing the Council's ability to make ...

truth for cross-team BI, regulatory reporting, and historical trend analysis). - Orchestration: Kubernetes (EKS), Terraform, Ansible and on-prem. - Data Pipelines: Kafka, CDC (Change Data Capture) tools like Debezium. Key Responsibilities - Multi-Engine Management: Administer a hybrid database environment, ensuring seamless data flow between … PostgreSQL (Live Trading) and ClickHouse/Snowflake (Analytics). - Data Movement & ETL: Own the reliability of CDC pipelines that stream data from production Postgres instances into the analytical layer. - Schema Evolution: Manage schema changes across different engines, ensuring that transactional data models translate effectively into columnar formats ...

Glue, and Redshift Define and execute data validation, reconciliation, and cutover strategies ensuring zero/low data loss Enable CDC-based replication and minimal downtime migrations across heterogeneous systems Design and optimize ETL/data pipelines using AWS Glue, PySpark, or EMR Architect and implement scalable, secure … proficiency in SQL and data modeling concepts Experience working with S3-based data lakes and Glue Data Catalog Strong understanding of CDC, transaction consistency, and migration cutover strategies Hands-on experience with performance tuning, schema design, and query optimization Proficiency in Python/PySpark and scripting (Shell ...

Palantir Solution Architect (Manager) Lead Data Solutions at Scale Location: Flexible/Hybrid Are you an experienced Palantir Solution Architect (Manager) looking for your next challenge? Our client, a leading organisation in the data and digital space, is seeking a highly skilled Palantir Solution Architect (Manager) to join … their growing team. This is a fantastic opportunity for a Palantir Solution Architect (Manager) to work on complex, high-impact data platforms while leading talented agile teams. As a Palantir Solution Architect (Manager) , you will play a critical role in shaping modern data solutions, driving technical excellence ...

Glue, and Redshift. Define and execute data validation, reconciliation, and cutover strategies ensuring zero/low data loss. Enable CDC-based replication and minimal downtime migrations across heterogeneous systems. Design and optimize ETL/data pipelines using AWS Glue, PySpark, or EMR. Architect and implement scalable, secure … proficiency in SQL and data modeling concepts. Experience working with S3-based data lakes and Glue Data Catalog. Strong understanding of CDC, transaction consistency, and migration cutover strategies. Hands-on experience with performance tuning, schema design, and query optimization. Proficiency in Python/PySpark and scripting (Shell ...

month contract opportunity. W2 rate: $55.00 - 58.00/hour We are seeking a Business Systems Analyst Lead who excels at source-to-target data mapping, advanced SQL, and has a solid understanding of robust ETL processes for an Enterprise Data Warehouse. You will translate regulatory and business requirements … into scalable data designs and collaborate closely with data engineering and OFSAA (Oracle Financial Services Analytical Applications) teams to deliver reliable, auditable reporting. Responsibilities: Lead end-to-end source-to-target mapping from banking source systems to the OFSAA staging, fact, and summary layers Document business rules, transformation ...

SDLC to optimize , accelerate, and enhance development outcomes. Collaboration and Integration: Work closely with cross-functional teams to integrate our platform with ERP systems, data warehouses, and other essential applications. Collaborate with product management to refine feature requirements and specifications. Best Practices and Optimization: Implement and advocate for best … code review automation. Conduct performance tuning and optimization to ensure high availability and scalability of the platform. Implement security best practices to protect sensitive data and ensure compliance with industry standards. Mentor junior engineers and contribute to team knowledge sharing. Career Pathing: This role offers a clear path ...

seeking a Data Solutions Architect to join a and support with a critical piece of work for a consultancy client of ours who are working with a customer in the financial services sector.**Key Responsibilities:** * Strong knowledge and hands on experience of the AWS Data integration stack … Lambdas, Eventbridge, SQS, Step Functions etc* Strong knowledge and hands on experience of Snowflake* Strong knowledge and hands on experience of data transformation tools such as dbt core* Strong knowledge and hands on experience with Change Data Capture software such as Qlik Replicate* Experience of designing ...

Strong knowledge and hands on experience of the AWS Data integration stack: S3, Lambdas, Eventbridge, SQS, Step Functions etc Strong knowledge and hands on experience of Snowflake Strong knowledge and hands on experience of data transformation tools such as dbt core Strong knowledge and hands on experience with … Change Data Capture software such as Qlik Replicate Experience of designing and building AWS Hosted APIs Experience of preparing and presenting designs at governance forums Knowledge and experience of Cloud to on-premises AWS Network routing Knowledge of Cloud database and mainframe database technology Experience of working ...

networking, security, environments) Build and maintain CI/CD pipelines and DevOps frameworks Support migration of enterprise databases into AWS using DMS and CDC patterns Ensure automation, scalability, and resilience across platform and data pipelines Enable event-driven and batch processing architectures (e.g., S3, Lambda) Enforce engineering standards … Solid programming skills in Python and SQL Experience supporting or working with data platforms and ingestion pipelines Experience with data migration and CDC approaches Strong communication and stakeholder engagement skills Priyanka Sharma Senior Delivery Consultant Office: 02033759240 Email: psharma@vallumassociates.com ...

GenAI Data Engineer Location: London/Edinburgh - (Hybrid - 2 days per week in the office) Day Rate: Market rate (Inside IR35) Duration: 6 months The Role We are seeking a highly skilled GenAI Data Engineer to join a forward-thinking team delivering advanced data and AI solutions. … distributed data processing (ETL/ELT pipelines) Advanced SQL expertise, including schema design (star/snowflake), indexing and optimisation techniques Proven experience implementing CDC and SCD (Type 1/2/3) in data warehousing environments Advanced Python skills for data engineering, automation and AI/ ...

conventions) Lead platform engineering and infrastructure delivery (IaC, networking, security, environment setup) Oversee migration of ~8–10 enterprise databases into AWS using DMS and CDC patterns Ensure migration pipelines are scalable, automated, and resilient Enable event-driven and batch data pipelines (S3, Lambda, orchestration) Ensure data lineage, cataloguing …/networking, DMS Proven experience with Infrastructure-as-Code (Terraform) and CI/CD pipelines Experience delivering large-scale data migrations, including CDC approaches Strong Python and SQL skills Understanding of data platforms (e.g. Snowflake/CDP) and ingestion pipelines Exposure to AI/ML enablement frameworks (.e.g ...

Role GenAI Data Engineer Your responsibilities: Design and maintain scalable data pipelines using PySpark, Python, and distributed computing frameworks to support high‐volume data processing. Architect and optimize AWS-based data and AI infrastructure, ensuring secure, performant, and cost‐efficient ingestion, transformation, and storage. Develop, finetune … processing, and largescale ETL/ELT pipelines. Strong SQL expertise including star/snowflake schema design, indexing strategies, writing optimized queries, and implementing CDC, SCD Type 1/2/3 patterns for reliable data warehousing. Advanced proficiency in Python for data engineering, automation, and ML/ ...

support complex business logic. Integration & Automation: Design Power Automate workflows and integrate solutions with external systems like Azure Functions, REST APIs, and SQL. Data Management: Architect Dataverse models and lead data migrations while ensuring data integrity and performance optimization. Security & Compliance: Configure role-based access and ensure … Degree in a relevant field or equivalent work experience. Preferred Skills Experience building and deploying Dynamic Packages. Experience with security and data classification (CDC, HIPAA, CJIS). Experience with Power BI data pipelines for reporting and analytics. Work Environment & Requirements Hybrid Schedule: 4 days per week onsite ...

Your Responsibilities: Design and maintain scalable data pipelines using PySpark, Python, and distributed computing frameworks to support high‐volume data processing. Architect and optimize AWS-based data and AI infrastructure, ensuring secure, performant, and cost‐efficient ingestion, transformation, and storage. Develop, finetune, benchmark, and evaluate GenAI/… processing, and largescale ETL/ELT pipelines. Strong SQL expertise including star/snowflake schema design, indexing strategies, writing optimized queries, and implementing CDC, SCD Type 1/2/3 patterns for reliable data warehousing. Advanced proficiency in Python for data engineering, automation, and ML/ ...

Functions, etc.) Leading architecture across a modern Snowflake data platform Applying dbt Core for modular, version-controlled data transformation Designing and implementing CDC pipelines (e.g., Qlik Replicate) Building AWS-hosted APIs and supporting secure cloud-to-on-prem connectivity Working with cloud and mainframe database technologies Presenting architecture … Looking For Deep hands-on experience across AWS data services Strong Snowflake expertise Real-world experience with dbt Core Strong understanding of CDC tooling (preferably Qlik Replicate) Proven experience designing cloud-based APIs Knowledge of hybrid networking routes between AWS and on-prem Confident communication and stakeholder engagement skills ...