751 to 775 of 890 Data Engineer Jobs

About the Client Our client is a long-established, service-focused business delivering intelligent, data-driven solutions that help organisations increase efficiency, reduce operational risk, and streamline complex logistical processes. With a strong reputation for reliability and innovation, they serve a diverse portfolio of national and regional clients, many of whom rely on their services as a critical part … for a collaborative and pragmatic culture, they value long-term relationships and continuous improvement. How youll spend your day Youll play a key role in building, maintaining, and optimising data pipelines and transformation workflows. Your focus will be on ensuring data integrity, reliability, and performance across the organisations cloud-based analytics environment. Develop and maintain automated data ingestion pipelines using Fivetran. Implement and manage dbt models for scalable data transformations. Monitor and optimise Snowflake performance and costs. Ensure version control and CI/CD best practices for dbt projects. Set up orchestration and monitor pipeline health. Troubleshoot and resolve issues to maintain smooth data operations. Collaborate with BI Analysts and Data Stewards to More ❯

Key Responsibilities:SynapseDevelop and maintain data models in Synapse to support reporting and analyticsDevelop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction, transformation and aggregation from Salesforce objects.Analyze the source system and design the ETL data load.Ability to create and configure Azure Synapse Analytics workspace.Create pipelines in Azure Synapse using Linked Services/… Datasets/Pipeline to Extract, Transform and Load data from different sources.Perform regular monitoring, troubleshooting, and maintenance of the data architecture and pipelines.Contribute to cloud infrastructure and security (Azure storage, networking, security, cost management)Power BI ToolsCollaborate with data scientists, analysts, and stakeholders to gather requirements, design visualizations, and provide training to use self-service BI Tools.Salesforce … and MuleSoftKnowledge of Salesforce object and data structuresDesign and implement data integrations between Salesforce and Azure Synapse using APIs, ETL tools, and integration platforms like MuleSoft and Azure Data Factory/Azure Synapse Analytics.Strong knowledge of Salesforce APIs (REST, SOAP), Apex, and Lightning Web ComponentsFamiliarity with integration tools like MuleSoft, Informatica, or similar.GovernanceImplement and maintain best practices More ❯

We’re working with a well-known public sector organisation in Lancashire who are looking to appoint a Data Engineer on a permanent basis. This role sits within a growing Information & BI function and offers the chance to make a real impact across their data landscape. The role will involve: Supporting the BI reporting team by creating … and maintaining data solutions for KPI reporting. Developing scalable, performance-optimised ELT/ETL pipelines using T-SQL, Python, ADO, C#, PySpark and Jupyter Notebooks. Working with the Gazetteer and GIS teams to maintain stable, consolidated database platforms for mapping and GIS systems. Contributing to the development and maintenance of a Data Warehouse and organisation-wide BI reporting … environment. Implementing and managing data flows with tools such as Azure Data Factory and SSIS. Working closely with the Business Systems Manager to automate data quality assessments and produce data quality metrics. Helping shape best practice through improved development standards, documentation and continuous improvement. Thoroughly testing data engineering solutions (unit, integration and UAT). Any More ❯

has big ambitions but needs more excellent minds to challenge the status-quo and help it reach new horizons. Where you come in? You'll be joining the Portfolio Data squad to tackle some of the most critical challenges in transforming how we manage insurance exposure and risk aggregations. The current data estate is siloed, inefficient, and difficult … to scale, so the team is designing a robust solution to support seamless data ingestion, scalable storage, and optimise for downstream use cases, including developing our algorithmic underwriting capability. Alongside this, the squad is building a trusted source of truth for insurance exposure data — aligning methodologies with the Exposure Management team and delivering intuitive, high-value views and … dashboards for Portfolio Management. By joining us, you'll help modernize our data landscape, eliminate manual and unreliable processes, and empower the business with faster, smarter, and more reliable insights. What you will be doing: • Work with actuaries, data scientists and engineers to design, build, optimise and maintain production grade data pipelines to feed the Ki algorithm More ❯

Senior Data Engineers with a background are required by this major client, as they continue to expand their engineering capability in their Leeds offices, where you will provide best in class Data Engineering services to a wide range of major Public Sector organisations. As a result of the work that they do, this client requires applicants to hold … UK national or dual UK national. Please note your application will not be taken forward if you cannot fulfil these requirements. In order to secure one of these Senior Data Engineer roles you must be able to demonstrate the following experience: Experience in prominent languages such as Python, Scala, Spark, SQL. Experience working with any database technologies from … an application programming perspective - Oracle, MySQL, Mongo DB etc. Experience with the design, build and maintenance of data pipelines and infrastructure Understanding of design practices and system architecture and with a focus on data security Excellent problem solving skills with experience of troubleshooting and resolving data-related issues Skills they would love to see: Experience in data More ❯

opportunity Make sure to apply fast, as a high volume of applications is expected Scroll down to read the complete job description. We are looking for a senior-level Data Platform Engineer who will own the entire data lifecycle—from raw ingestion to clean, standardized tables to production-grade KPI calculation and API exposure. This is a … true “full-stack data” role: you will deeply understand every data source, build and maintain the PostgreSQL core, implement all business-critical metrics and calculations, and expose them reliably via FastAPI (or GraphQL) endpoints consumed by our applications and dashboards. This is a high-ownership, hands-on engineering position with end-to-end responsibility for data correctness … performance, and usability. Key Responsibilities *Multi-Source Data Ingestion & Standardization * Proactively request, receive, and integrate data from numerous external and internal sources in varied formats (CSV, JSON, Excel, APIs, database dumps, etc.). Build robust, automated Python-based ingestion pipelines that parse, validate, cleanse, enrich, and standardize incoming data. Transform heterogeneous sources into a single, consistent schema in More ❯

AI, we want you on board Job Description At Recraft, we're building the next generation of generative models across images and text. We're looking for an ML Data Engineer to scale our data pipelines for unstructured data (primarily images) and keep our training flows fast, reliable, and repeatable. You'll design and operate high … throughput ingestion and preprocessing on Kubernetes, evolve our internal data-pipeline framework, and work hand-in-hand with ML engineers to ship datasets that move model quality forward. Key Responsibilities Develop and maintain data-ingestion pipelines to source and prepare large-scale image (and occasional text/HTML) datasets from open, publicly accessible, and permitted sources. Own the … end-to-end flow: raw data → quality/beauty/relevance filtering → dedup/validation → ready-to-train artifacts. Operate and improve our Kubernetes-based data-pipeline framework (distributed jobs, retries, monitoring, automation). Work with S3-style object storage: efficient layouts, lifecycle, throughput, and cost awareness. Add tooling around pipelines (progress/health visualization, metrics, alerts) for More ❯

We're looking for a mid-level AWS Data Engineer to help us build and run reliable, scalable data pipelines. You'll turn raw data from multiple data sources into trusted datasets for our internal users, working closely with analysts, data scientists, and the wider team. You will be responsible for developing pipelines end More ❯

Data Engineer - ETL Developer + £510 to £530 per day + Long term contract - 6-12 months + SC is required for this role. + Telford - atleast 2 days per week Key Skills: + ETL based solutions + Oracle RDS ETL Developer - Talend/Oracle RDS We're expanding our data engineering capability to meet growing demand … programme - supporting ongoing work on the DPRS regime and taking on new challenges with the CARF regime. We're looking for an experienced ETL Developer to join our established data engineering team. You'll help deliver high-quality data management and ETL solutions across multiple concurrent projects in a fast-paced, collaborative environment. As part of one of … our core project teams, you'll take ownership of solution delivery while also contributing to our shared Talend framework and supporting the wider data delivery function. What you'll be working on: Developing and maintaining ETL solutions using Talend within our existing framework and patterns Working with Oracle RDS databases Contributing to the continuous improvement of our CI/ More ❯

Data Engineer - ETL Developer + 510 to 530 per day + Long term contract - 6-12 months + SC is required for this role. + Telford - atleast 2 days per week Key Skills: + ETL based solutions + Oracle RDS ETL Developer - Talend/Oracle RDS We're expanding our data engineering capability to meet growing demand … programme - supporting ongoing work on the DPRS regime and taking on new challenges with the CARF regime. We're looking for an experienced ETL Developer to join our established data engineering team. You'll help deliver high-quality data management and ETL solutions across multiple concurrent projects in a fast-paced, collaborative environment. As part of one of … our core project teams, you'll take ownership of solution delivery while also contributing to our shared Talend framework and supporting the wider data delivery function. What you'll be working on: Developing and maintaining ETL solutions using Talend within our existing framework and patterns Working with Oracle RDS databases Contributing to the continuous improvement of our CI/ More ❯

We’re seeking a Lead Data Engineer to design and deliver scalable data and AI solutions across internal and client projects. You’ll own the full data lifecycle — from ingestion and processing to deployment and monitoring of machine learning models — while leading a small, high-performing team. What You’ll Do Build and maintain data … cloud infrastructure (AWS/GCP). Develop AI-driven applications including LLM tools, RAG pipelines, and automation solutions. Lead on client communication , project delivery, and stakeholder alignment. Collaborate with Data Science and Analytics teams to improve data access, automation, and governance. Drive innovation through proofs-of-concept , model monitoring , and adoption of emerging AI tech. What We’re … Looking For 5+ years in data engineering, with team or project leadership experience. Advanced Python (Pandas, PyTorch, TensorFlow, Scikit-learn). Strong AWS/GCP , MySQL , and CI/CD experience; Docker/Kubernetes a plus. Excellent communication, organisation, and problem-solving skills. Passion for innovation and ethical, scalable AI. Nice to Have Experience in digital marketing or web More ❯

Data Platform Engineer DV Cleared £500 - £600 per day - Outside IR35 JOB DESCRIPTION This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security standards and regulations. This is … a UK based onsite role with the option of compressed hours. The role will include: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance … with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana More ❯

CV Technical are proud to be partnered with a leading UK data consultancy who are looking to grow their data engineering capabilities with a Senior Data Engineer on a permanent basis. You'll have the opportunity to work across a variety of client engagements, create real business impact, and contribute to the growth of a fast … consultancy. The Role: Manchester based with a hybrid working arrangement. You will work across a diverse portfolio of client assignments, delivering technical solutions that address a wide spectrum of data-related challenges and enabling organisations to make informed, data-driven decisions. In this position, you'll design and implement advanced data systems and pipelines that meet clients … in Python, R, SQL, SAS Experienced with DevOps processes Experienced working in regulated industries Experienced on the Microsoft Azure stack Excellent stakeholder and communication skills. 4+ years experience in data engineering Experience mentoring or supporting more junior engineers Experience migrating between platforms. Experience with SAS tools and SAS administration. Agile Development and Deployment experience As this role is for More ❯

CV Technical are proud to be partnered with a leading UK data consultancy who are looking to grow their data engineering capabilities with a Senior Data Engineer on a permanent basis. You'll have the opportunity to work across a variety of client engagements, create real business impact, and contribute to the growth of a fast … consultancy. The Role: Manchester based with a hybrid working arrangement. You will work across a diverse portfolio of client assignments, delivering technical solutions that address a wide spectrum of data-related challenges and enabling organisations to make informed, data-driven decisions. In this position, you'll design and implement advanced data systems and pipelines that meet clients … in Python, R, SQL, SAS Experienced with DevOps processes Experienced working in regulated industries Experienced on the Microsoft Azure stack Excellent stakeholder and communication skills. 4+ years experience in data engineering Experience mentoring or supporting more junior engineers Experience migrating between platforms. Experience with SAS tools and SAS administration. Agile Development and Deployment experience As this role is for More ❯

Role: Data & ML Engineer Location: Newcastle Upon Tyne Levels: Senior Analyst, Specialist Please Note: Due to the nature of client work you will be undertaking, you will need to be willing to go through a Security Clearance (Including BPSS) process as part of this role, which requires 5+ years UK address history at the point of application. Hybrid … team, you'll be working with cutting-edge technologies and will have the opportunity to develop a wide range of new skills on the job. Role Overview: As a Data & ML Engineer, you will design, build, and optimize scalable data pipelines and machine learning solutions. You’ll work with client teams to deliver intelligent data products … leveraging modern cloud and AI technologies. Key Responsibilities Design and implement robust data pipelines and ML workflows using Python, SQL, Spark, and Databricks. Develop and deploy machine learning models (including NLP, deep learning, and agentic AI) in production environments. Integrate data from diverse sources, including streaming and batch ingestion, using Azure Data Factory, GCP Dataflow and AWS More ❯

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising and sharing opportunities to reuse data flows where possible click apply for More ❯

Senior Data Engineer (Developer) Pyspark We are supporting a leading global financial markets infrastructure and data provider as they modernise and scale their core data engineering capabilities. This role sits at the centre of their transformation programme, delivering high-quality data pipelines, models, and platforms that underpin critical services across the business. Key Responsibilities Design … build, and optimise scalable data pipelines for both batch and streaming workloads: Develop dataflows and semantic models aligned to analytics and reporting needs Implement complex transformations and performance-focused data processing logic Apply data validation, cleansing, and profiling techniques to ensure accuracy and consistency Implement access controls, data masking, and compliance-aligned security protocols Tune workloads … ability and experience working in Agile environments Excellent communication skills with stakeholder-facing experience Practical experience building ETL workflows, lakehouse architectures, dataflows, and semantic models Exposure to time-series data, financial market feeds, transactional records, and risk-related datasets More ❯

Data Engineer x3 Telford 2 days a week 55,000 - 65,000 A Leading consultancy organisation based in is looking to expand their team of Data Engineers to join a specific public sector client. This is a pivotal role, where you will contribute to data acquisition, preparation and management projects, helping to modernise services and deliver … secure, reliable data products at scale. WHAT YOU'LL DO Design and implement robust, secure and performance data integration solutions (batch and/or near-real-time). Build, operate and improve data pipelines (ingestion, transformation, curation) with monitoring, alerting and SLAs. Collaborate with product teams and client stakeholders to refine requirements and align decisions to NFRs … analysts and business teams. WHAT YOU'LL BRING Our team delivers solutions across a wide range of technologies, and so we are looking for candidates with strong knowledge in data engineering fundamentals, with ability to operate at all stages of the delivery lifecycle, with an interest in learning and cross-skilling. Essential skills and experience: Strong SQL and hands More ❯

Data Engineer x3 Telford 2 days a week £55,000 - £65,000 A Leading consultancy organisation based in is looking to expand their team of Data Engineers to join a specific public sector client. This is a pivotal role, where you will contribute to data acquisition, preparation and management projects, helping to modernise services and deliver … secure, reliable data products at scale. WHAT YOU'LL DO Design and implement robust, secure and performance data integration solutions (batch and/or near-real-time). Build, operate and improve data pipelines (ingestion, transformation, curation) with monitoring, alerting and SLAs. Collaborate with product teams and client stakeholders to refine requirements and align decisions to NFRs … analysts and business teams. WHAT YOU'LL BRING Our team delivers solutions across a wide range of technologies, and so we are looking for candidates with strong knowledge in data engineering fundamentals, with ability to operate at all stages of the delivery lifecycle, with an interest in learning and cross-skilling. Essential skills and experience: Strong SQL and hands More ❯

Tableau Developer/Engineer £500/day Outside IR-35 Contract until the end of the financial year (March 26) Start ASAP Active SC required Key Responsibilities Dashboard Development: Design and build interactive Tableau dashboards and reports to provide actionable insights for stakeholders. Data Engineering: Develop and maintain robust data pipelines, ensuring data integrity, scalability, and … performance across multiple sources. Data Integration: Work with structured and unstructured data from various internal and external systems, applying ETL best practices. Collaboration: Partner with analysts, data scientists, and business teams to understand requirements and deliver high-quality solutions. Performance Optimisation: Monitor and tune Tableau Server performance, ensuring efficient query execution and user experience. Governance & Security: Implement … data governance standards and ensure compliance with Home Office security protocols. Essential Skills & Experience Proven experience in Tableau development (Desktop and Server) with strong visualisation and storytelling skills. Solid background in data engineering, including ETL processes and data pipeline development. Proficiency in SQL and experience with relational databases (e.g., Oracle, PostgreSQL, SQL Server). Familiarity with cloud More ❯

Junior Data Engineers are required by this major client, as they continue to build the cloud engineering capability in their Leeds offices, where you will provide best in class Data Engineering services to a wide range of major Public Sector organisations. As a result of the work that they do, this client requires applicants to hold or be … UK national or dual UK national. Please note your application will not be taken forward if you cannot fulfil these requirements. In order to secure one of these Junior Data Engineer roles you must be able to demonstrate the following experience: Commercial experience gained in a Data Engineering role on any major cloud platform (Azure, AWS or … Python, Scala, Spark, SQL. Experience working with any database technologies from an application programming perspective - Oracle, MySQL, Mongo DB etc. Some experience with the design, build and maintenance of data pipelines and infrastructure Excellent problem solving skills with experience of troubleshooting and resolving data-related issues Skills they would love to see: Interest in building Machine learning and More ❯

the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world. YOUR ROLE We are seeking a skilled and hands-on AWS Data Engineer with strong coding expertise and deep experience in building scalable data solutions using AWS services. The ideal candidate will have a solid background in data engineering, Python development, and cloud-native architecture. YOUR PROFILE Design, develop, and maintain robust data pipelines and ETL workflows using AWS services. • Implement scalable data processing solutions using PySpark and AWS Glue. • Build and manage infrastructure as code using CloudFormation. • Develop and deploy serverless applications using AWS Lambda, Step Functions, and S3. • Perform data querying and … analysis using Athena. • Collaborate with Data Scientists to operationalize models using SageMaker. • Ensure secure and compliant data handling using IAM, KMS, and VPC configurations. • Containerize applications using ECS for scalable deployment. • Write clean, testable code in Python, with a strong emphasis on unit testing. • Use GitLab for version control, CI/CD, and collaboration. • Strong coding background in More ❯

travel to London - Outside IR35 ACTIVE CTC (or SC) & NPPV 2 or above Clearance required - Please only apply if you hold these clearances. We are seeking a highly capable Data Analyst/Data Engineer to join a multidisciplinary transformation team delivering a major public sector redesign programme. The role requires an individual with strong analytical and interpersonal … skills who can work proactively with large operational data sets to generate insight, models, and evidence that inform key workstreams across operating model design, logistics, organisational change, and business case development. This role suits a confident self-starter who can thrive in a complex and fast-moving environment, balancing analytical depth with strong communication and collaboration across technical and … senior stakeholders, tailoring analysis to different audiences. Work collaboratively with project managers, operating model designers, cost modellers, and change managers to integrate analytical outputs into programme deliverables. Maintain strict data integrity and confidentiality, adhering to all relevant data protection and security policies. Skills and Experience Required Essential: Current NPPV Level 2 and CTC (or SC) security clearance. Proven More ❯

Data Engineer x3 Worthing 2 days a week £55,000 - £65,000 A Leading consultancy organisation based in is looking to expand their team of Data Engineers to join a specific public sector client. This is a pivotal role, where you will contribute to data acquisition, preparation and management projects, helping to modernise services and deliver … secure, reliable data products at scale. WHAT YOU'LL DO Design and implement robust, secure and performance data integration solutions (batch and/or near-real-time).Build, operate and improve data pipelines (ingestion, transformation, curation) with monitoring, alerting and SLAs.Collaborate with product teams and client stakeholders to refine requirements and align decisions to NFRs (cost, performance … engineers, analysts and business teams.WHAT YOU'LL BRING Our team delivers solutions across a wide range of technologies, and so we are looking for candidates with strong knowledge in data engineering fundamentals, with ability to operate at all stages of the delivery lifecycle, with an interest in learning and cross-skilling.Essential skills and experience:Strong SQL and hands-on More ❯

Data Engineer x3 Worthing 2 days a week 55,000 - 65,000 A Leading consultancy organisation based in is looking to expand their team of Data Engineers to join a specific public sector client. This is a pivotal role, where you will contribute to data acquisition, preparation and management projects, helping to modernise services and deliver … secure, reliable data products at scale. WHAT YOU'LL DO Design and implement robust, secure and performance data integration solutions (batch and/or near-real-time). Build, operate and improve data pipelines (ingestion, transformation, curation) with monitoring, alerting and SLAs. Collaborate with product teams and client stakeholders to refine requirements and align decisions to NFRs … analysts and business teams. WHAT YOU'LL BRING Our team delivers solutions across a wide range of technologies, and so we are looking for candidates with strong knowledge in data engineering fundamentals, with ability to operate at all stages of the delivery lifecycle, with an interest in learning and cross-skilling. Essential skills and experience: Strong SQL and hands More ❯