1 to 25 of 28 Contract Data Ingestion Jobs in England

Position: PCT Data Engineer Location: Central London Hybrid work (3 days per week onsite) Description of role and key responsibilities: Primary function of the role is to deliver high quality data engineering solutions to business and end users across Private Client Transactional and Lending teams – either directly … self-service data products, or by working closely with the Analytics team, providing modelled data products on which they can add reporting and analytics. The candidate will be required to deliver to all stages of the data engineering process – data ingestion, transformation, data modelling ...

Data Engineer (Inside IR35) £425 Per day SC Cleared London o support the formation of a new Data Team, there is a critical need to establish robust, scalable, and secure data infrastructure. Currently, data is dispersed across multiple systems with inconsistent formats and limited automation. … Data Engineer will play a key role in designing and implementing the pipelines, architecture, and tooling required to enable reliable data ingestion, transformation, and delivery. Key Responsibilities Design, build, and maintain scalable data pipelines to ingest, transform, and store data from multiple sources. Develop ...

teams . The focus is on customer segmentation, lifecycle analysis, and generating high-quality, actionable insights. The successful candidate will be a full-stack data practitioner , comfortable owning data end to end rather than operating purely in reporting. Key Responsibilities Growth & Operations Split time between growth-focused … customer segmentation initiatives to deepen understanding of customer behaviour Analyse and track customer movement through the end-to-end lifecycle Ensure high standards of data quality, cleanliness, and reliability Reporting & Insights Take ownership of the data ecosystem end to end , including: Data ingestion Data modelling ...

Data Engineer- Azure £500-£525 pd via Umbrella Birmingham- 1-2 days per week in the office Leading business is looking to bring in a Data Engineer to develop, maintain, and operate data-ingestion routines across the estate to create a single, trusted data source … that supports a data-driven culture. Role: Design and implement scalable, secure data-processing pipelines using Azure Data Factory, Azure Synapse, and other Azure services. Manage and optimize data storage solutions, including Azure Data Lake Storage and Azure SQL Data Warehouse. Develop and maintain ...

Data Engineer (Databricks & Azure) - 3-Month Rolling Contract Rate: £400-£450 per day Location: Remote IR35 Status: Outside IR35 Duration: Initial 3 months (rolling) About the Company Join a leading Databricks Partner delivering innovative data solutions for enterprise clients. You'll work on cutting-edge projects leveraging Databricks … Azure to transform data into actionable insights. About the Role We are seeking an experienced Data Engineer with strong expertise in Databricks and Azure to join our team on a 3-month rolling contract. This is a fully remote position, offering flexibility and autonomy while working on high ...

Data Engineer (Databricks & Azure) - 3-Month Rolling Contract Rate: £400-£450 per day Location: Remote IR35 Status: Outside IR35 Duration: Initial 3 months (rolling) About the Company Join a leading Databricks Partner delivering innovative data solutions for enterprise clients. You'll work on cutting-edge projects leveraging Databricks … Azure to transform data into actionable insights. About the Role We are seeking an experienced Data Engineer with strong expertise in Databricks and Azure to join our team on a 3-month rolling contract. This is a fully remote position, offering flexibility and autonomy while working on high ...

title- L3 Data Engineer- Support Location: London, UK Duration: 6 Months Work Mode: Hybrid (12 Days Onsite per week) Job Description Looking for L3 Data Engineer | Support | Key Skills & Expertise AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing … pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format Schema evolution, partitioning, compaction & metadata management Query performance tuning with Athena & Redshift Spectrum ...

searching for one of our key clients a Senior Data Platform Engineer to support and optimise large scale data ecosystems across PostgreSQL, Snowflake and Greenplum. This is a high-impact role within a modern digital environment, ideal for someone who thrives on complex data challenges and enterprise … grade engineering. Youll be responsible for designing scalable data models, optimising performance across multiple database technologies, and enabling seamless data ingestion pipelines. Expect to work in a cloud-driven setting with Azure, modern tooling, and critical data platforms that underpin major transformation programmes. Key skills required ...

Data Platform Engineer DV Cleared £500 - £600 per day - Outside IR35 JOB DESCRIPTION This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring … This is a UK based onsite role with the option of compressed hours. The role will include: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality ...

Role Overview A leading financial services provider is embarking on a major data transformation, building a modern architecture with Microsoft and Databricks technologies to become a truly data-driven organisation. As part of our client's programme and management information team, we are seeking a Data Modeller … Developer to drive data modelling, schema design, and business intelligence reporting. This pivotal role will deliver tangible business value through data, supporting strategic initiatives and regulatory change. Responsibilities Design and implement robust data models and schemas. Develop PowerBI reports and dashboards for strategic and regulatory needs. Create ...

catastrophe modelling transformation within a global speciality insurer. The role will focus on shaping a long-term road map for CAT modelling and underwriting data capabilities, alongside delivering near-term improvements to SOV data ingestion and automation. undertaking a strategic enhancement of its catastrophe modelling and underwriting … data capabilities, supporting both existing lines of business and a potential move into Property D&F. This role will play a critical role across two major deliverable: Building a long-term roadmap for CAT modelling, data ingestion, and underwriting workflow improvements. Delivering tactical and strategic improvements ...

IR35 Long term contract Remote UK/EU We're looking for a BE Engineer to design and build high-quality backend systems and data pipelines that power the analytics platform. You'll collaborate with engineers and the Product team across the full software lifecycle, leading on scalable services … that ingest, transform and deliver data to our frontend applications and customers. You'll bring strong Python skills, experience with microservices and data ingestion/ETL pipelines , and an eye for clean, maintainable code. Familiarity with AI-assisted dev tools (GitHub Copilot, Cursor, Windsurf, Devin ...

Data Engineer £650-700/day outside IR35 3-month initial contract Remote working - occasional site visits Working with a leading financial services client who are looking for a Data Engineering Consultant. Looking for someone who can act independently and deliver complex data products - work with stakeholders … understand requirements, engineer and deliver products. Data Engineering Consultant, key responsibilities: Take ownership of end-to-end of complex data products Work cross-functionally with non-technical stakeholders to understand data requirements Expert knowledge of SQL to query, analysis and model data Experience with Snowflake Using ...

using FastAPI and hosted on Amazon Web Services (AWS). - Developing improvements to the existing product, following an existing roadmap focusing on improved data ingestion, UI updates (supported by Fullstack Developer) and potential agentic possibilities. - Helping design, develop and deliver a new capability focusing on turning existing audience … data and insights into conversational AI-powered synthetic audiences, mirroring the demographics and attitudes of their 'real world' counterparts. - Collaborating with a Product Manager and other Software Developers to ensure work is sufficiently organised and completed. - Working across the team to ensure informed decisions are made on the application ...

support the migration of observability workloads from Splunk to Elasticsearch (ELK Stack) . The ideal candidate will bring hands-on expertise in Splunk architecture, data ingestion, alerting, and dashboarding, along with experience migrating workloads to Elasticsearch. In addition to migration duties, the candidate will maintain and enhance existing … Responsibilities: Migration: Develop and implement a comprehensive migration strategy from Splunk to Elasticsearch (ELK Stack). Assess existing Splunk configurations (dashboards, alerts, saved searches, data models) and recreate them in Kibana. Collaborate with Elastic teams to configure alerting and monitoring using Kibana, Elasticsearch Watcher, or third-party tools. Ensure ...

Role Overview: We are seeking a skilled Digital Analytics & CDP Specialist with extensive expertise in Adobe Experience Platform (AEP) and Customer Data Platforms (CDP). The successful candidate will have hands-on experience with data collection, identity resolution, segmentation, and activation across multiple marketing and advertising platforms. … goal is to deliver personalized, data-driven customer experiences. Key Responsibilities: Customer Data Platform (CDP) & Adobe Experience Platform (AEP): Manage data ingestion workflows via AEP Data Collection UI/Adobe Launch and map collected data to XDM schemas. Build and maintain a Unified Customer ...

Role Overview We are looking for a Digital Analytics & CDP Specialist with strong expertise in Adobe Experience Platform (AEP) , Customer Data Platforms (CDP) , and digital marketing analytics . The role requires hands-on experience in data collection, identity resolution, segmentation, and activation across multiple marketing and advertising platforms … with a focus on delivering personalized, data-driven customer experiences. Key Responsibilities Customer Data Platform (CDP) & Adobe Experience Platform (AEP): Manage data ingestion workflows via AEP Data Collection UI/Adobe Launch, mapping collected data to XDM schemas . Build and maintain a Unified ...

Python Data Engineer Azure & PySpark - SC Cleared Contract £400-£458pd (Inside IR35) SC Clearance is Essential Summary Were looking for a Python Data Engineer skilled in PySpark, Delta Lake, Azure services, containerized development, and Behave-based testing. Youll design and build scalable data pipelines and maintain high … quality, test-driven code in a cloud environment. What youll do Build and maintain Python/PySpark pipelines for data ingestion, processing, and validation. Write unit and BDD tests using Behave, including mocking and patching. Create and optimize Delta Lake tables for reliable, performant data storage. ...

Data Engineer- Azure £500-£525 pd via Umbrella Birmingham- 1-2 days per week in the office Leading business is looking to bring in a Data Engineer to develop, maintain, and operate data-ingestion routines across the estate to create a single, trusted data source … that supports a data-driven culture click apply for full job details ...

West of England Combined Authority are seeking a highly skilled Data Engineer to support the optimisation, documentation, and enhancement of our existing data pipelines within the Databricks Lakehouse environment. This role will involve hands-on development, reverse-engineering of current solutions, and close collaboration with internal teams … debug Databricks notebooks, Delta Lake workflows, and Genie-bot automations Design, maintain, and enhance ETL pipelines , ensuring reliability and performance Validate, transform, and orchestrate data using Python and SQL within the Lakehouse environment Manage data ingestion and scheduling processes via Azure Data Factory Reverse-engineer, document ...

case definition through to high-level architecture and platform design. The role covers areas such as Predictive AI, Machine Learning and Generative AI, MLOps, data pipelines and modern AI platforms, across both cloud and private infrastructure. Alongside customer work, youll contribute to the development of AI offerings, standards … mentoring other architects within the wider team. Key Responsibilities Act as the AI subject matter expert in customer engagements, working directly with business stakeholders, data teams and IT operations. Lead discovery and design of AI strategies, governance models and platform architectures aligned to business outcomes. Design ...

title- L3 Data Engineer- Support Location: London, UK Duration: 6 Months Work Mode: Hybrid (12 Days Onsite per week) Job Description Looking for L3 Data Engineer Support Key Skills & Expertise AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing … pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) Worki click apply for full job details ...

About the RoleWe are looking for a Python Data Engineer with strong hands-on experience in Behave-based unit testing, PySpark development, Delta Lake optimisation, and Azure cloud services. This role focusses on designing and deploying scalable data processing solutions in a containerised environment, emphasising maintainable, configurable … test-driven code delivery.Key Responsibilities Develop and maintain data ingestion, transformation, and validation pipelines using Python and PySpark. Implement unit and behavior-driven testing with Behave, ensuring robust mocking and patching of dependencies. Design and maintain Delta Lake tables for optimised query performance, ACID compliance, and incremental data ...

About the RoleWe are looking for a Python Data Engineer with strong hands-on experience in Behave-based unit testing, PySpark development, Delta Lake optimisation, and Azure cloud services. This role focusses on designing and deploying scalable data processing solutions in a containerised environment, emphasising maintainable, configurable … test-driven code delivery. Key Responsibilities Develop and maintain data ingestion, transformation, and validation pipelines using Python and PySpark. Implement unit and behavior-driven testing with Behave, ensuring robust mocking and patching of dependencies. Design and maintain Delta Lake tables for optimised query performance, ACID compliance, and incremental ...

Description Summary The Ground Application Software Engineer designs, builds, and sustains ground-based software applications and services that support mission-critical operations, including data ingestion, processing, and integration with back-end services and hardware systems. This role partners closely with product, systems, platform, data, and test teams … reliable and performance oriented. Integrate with existing software, simulators, test equipment, and external systems using well-defined contracts and protocols Implement and maintain data schemas, messaging, and event-driven integrations. Establish unit, integration, and end-to-end tests Experience in writing and developing test cases Experience in developing ...