201 to 225 of 283 Data Engineer Jobs in the UK excluding London

Data Engineer - North Lincolnshire - £40,000 + Bonus - Hybrid Are you someone who loves solving data challenges and working with modern cloud technologies? We're on the lookout for a Data Engineer who's ready to dive into building and optimising a cutting-edge data platform. This is your chance to join with a … better ways of working. It's a mega opportunity to join and make a difference! You'll be helping to design and manage ETL/ELT pipelines, making sure data flows smoothly and reliably across the business. You'll also get hands-on with tools like Datadog or CloudWatch to monitor performance and keep things secure and efficient. If … AI initiatives ,helping to build infrastructure for training, deploying large language models and integrating them into real-world applications. We're looking for someone with a good foundation in Data Engineering, ideally with exposure to cloud platforms like AWS, Azure, or GCP, and tools like Databricks or Snowflake. If you've worked in Agile teams, used BI tools like More ❯

Role: Azure Senior Data Engineer Location: Manchester, Lancashire Hybrid working: go into office 1x day a week Salary: £60,000 - £70,000 (dependent on experience) Insight into the Company: A large retail organisation - market leaders in their industry - are looking for a Senior Data Engineer to enter their team. You will be working in a small … team of 3 (including you!) and they are looking to build up the team over the next year. The ideal candidate will have experience with managing data warehouses from start to finish and liaise with IT teams regularly. The role will involve stakeholder management, working with diverse roles, such as software engineers, sales and marketing professionals and more. Therefore … communicating your projects needs and understanding others is an essential part of this role. Role and Responsibilities: You will design, build and upgrade data pipelines You will work in CI/CD and with Software/DevOps teams in the organisation You will have expertise in azure - from collecting, to transforming to loading! Skills and Experience: Essential to have More ❯

The Company Nigel Wright are delighted to be partnering exclusively with growing financial services firm Radiant Financial, in their search for a Data Engineer. The business have hubs across the UK however this role will be based in the North East. The Role The organisation have been working closely with a consultancy who have been building a new data platform and they are looking for a Data Engineer to support the platform's next phase. This will focus on enhancing ingestion pipelines, data modelling and downstream integration into Power BI. Other key responsibilities will include: Build scalable ETL/ELT pipelines using Azure Data Factory and Synapse Model and store data using Delta … Lake Contribute to CI/CD workflows for data pipelines Support data APIs from platforms like Intelligent Office, AJ Bell etc Document architecture, data flows and best practises across platform boundaries The Requirements This is a unique role to help shape Radiant Financials drive to become more data driven. You will be expected to attend the More ❯

and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … AWS LakeFormation, data modelling, DBT, Airflow, Docker and will be responsible for driving best practices in data engineering, governance, and DevOps. Key Responsibilities: • Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and business stakeholders to understand data requirements and deliver robust solutions. • Implement and maintain CI/CD pipelines for data workflows using tools like AWS CodePipeline, Git, GitHub Actions. • Ensure data quality, lineage, and observability. • Mentor junior engineers More ❯

and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … AWS LakeFormation, data modelling, DBT, Airflow, Docker and will be responsible for driving best practices in data engineering, governance, and DevOps. Key Responsibilities: • Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and business stakeholders to understand data requirements and deliver robust solutions. • Implement and maintain CI/CD pipelines for data workflows using tools like AWS CodePipeline, Git, GitHub Actions. • Ensure data quality, lineage, and observability. • Mentor junior engineers More ❯

and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … AWS LakeFormation, data modelling, DBT, Airflow, Docker and will be responsible for driving best practices in data engineering, governance, and DevOps. Key Responsibilities: • Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and business stakeholders to understand data requirements and deliver robust solutions. • Implement and maintain CI/CD pipelines for data workflows using tools like AWS CodePipeline, Git, GitHub Actions. • Ensure data quality, lineage, and observability. • Mentor junior engineers More ❯

Full time senior data cabling engineer required for works across Glasgow & the West, data engineer will be required to carryout the below works. Cat6, Cat6A & Cat7 structured cabling Cat6, Cat6A and Cat7 terminating & testing Working too and reading site drawings Full UK driving license 3 years minimum data engineer experience Fibre cabling Fibre splicing More ❯

Data Engineer (Snowflake & Airflow) London/Edinburgh 6 Month Contract Via Umbrella Our UK leading banking client are looking for a Data Engineer to join their team on an initial 6-month contract. Key Skills: Snowflake Agile methodology and working within small multiskilled feature teams. Comfortable with GIT and version control. Knowledge of older coding standards More ❯

Data Platform EngineerLondon - Hybrid£80,000-£90,0000 + 38 Days Holiday + Private Healthcare + Life Assurance + Flexible Working + Pension + Package Excellent opportunity for a Data-focused Site Reliability Engineer or a Data Platform Engineer with some DevOps principals to join a forward-thinking and high-growth Fintech company offering a … for further progression!This company are a bleeding-edge technology business driving innovation across the global financial services sector. Their platform processes vast amounts of real-time and batch data, supporting business critical reporting and analytics. With a strong culture rooted in integrity, creativity, and technical excellence, they've become a trusted partner across a wide range of businesses.In … performance of large-scale date pipelines built on AWS, Apache Flink, Kafka, and Python. You'll play a key role in diagnosing incidents, optimising system behaviour, and ensuring reporting data is delivered on time and without failure.The ideal candidate will have a strong experience working with streaming and batch data systems, a solid understanding of monitoring a observability More ❯

About the role: We're looking for a Senior Data Engineer to join the Data & Analytics team at Holland & Barrett. This is a high-impact, mid-seniority role within our growing data function, where you'll design, build, and scale modern data solutions on AWS. You'll work closely with cross-functional teams including Data Science, BI, and Product Analytics to develop cloud-native, scalable data infrastructure powering advanced analytics and machine learning. As a Senior Engineer, you'll not only deliver code — you'll take ownership, lead small teams, mentor others, and contribute to shaping our engineering culture and best practices. You'll join a team of Data Engineers, reporting … to the Senior Data Engineering Manager. You'll work alongside Associates, Mid-level Engineers, and Senior/Principal engineers. What You'll Do: Design, build, and scale data pipelines and services using AWS Glue, Lambda, Step Functions, S3, EMR, Athena, and more. Lead projects involving serverless, event-driven architectures and CI/CD workflows (GitLab CI). Write More ❯

The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on premises platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient … access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation, and delivery. You should be adept at identifying and resolving issues within NiFi flows, managing performance bottlenecks, and implementing robust … error handling strategies. Youll work closely with cross-functional teams including data architects, compliance officers, and cybersecurity specialists to integrate data from various systems such as databases, APIs, and cloud platforms. Your work will directly support batch processing, real-time streaming, and event-driven data pipelines across a variety of use cases. Were looking for candidates with More ❯

Senior Data Engineer is required to join a forward-thinking data team within a thriving city-based insurance group. This role will see you playing a critical role in delivering reliable, scalable and business-focused data solutions. With a strong focus on Microsoft technologies and cloud-based tools, you’ll work directly with key business stakeholders … to drive performance and decision-making through data. The ideal candidate here will have a strong background in MI or reporting—experience within insurance is essential. Key Responsibilities Deliver data solutions and changes that support evolving business requirements. Build and maintain robust, scalable data pipelines using SQL and ETL best practices. Collaborate with stakeholders to analyse, define and … implement solutions to complex data challenges. Proactively assess the impact of changes on the broader data model and ensure integrity is maintained. Work alongside the MI/reporting team to ensure data is accurately reflected in dashboards and reporting tools. Consult with business analysts, system owners and architects to align technical delivery with strategic objectives. Build deep More ❯

Senior Data Engineer is required to join a forward-thinking data team within a thriving city-based insurance group. This role will see you playing a critical role in delivering reliable, scalable and business-focused data solutions. With a strong focus on Microsoft technologies and cloud-based tools, you’ll work directly with key business stakeholders … to drive performance and decision-making through data. The ideal candidate here will have a strong background in MI or reporting—experience within insurance is essential. Key Responsibilities Deliver data solutions and changes that support evolving business requirements. Build and maintain robust, scalable data pipelines using SQL and ETL best practices. Collaborate with stakeholders to analyse, define and … implement solutions to complex data challenges. Proactively assess the impact of changes on the broader data model and ensure integrity is maintained. Work alongside the MI/reporting team to ensure data is accurately reflected in dashboards and reporting tools. Consult with business analysts, system owners and architects to align technical delivery with strategic objectives. Build deep More ❯

Are you passionate about harnessing data to drive meaningful transformation? As a Senior Data Engineer, you will play a pivotal role in strengthening their data ecosystem, ensuring that high quality data fuels innovation across the business. You will collaborate closely with teams across the company, designing, developing, and optimising scalable data solutions that elevate … decision making and operational efficiency. You'll play a key role in mentoring and upskilling fellow data engineers, helping them deepen their expertise in Snowflake and optimise their workflows for scalability and efficiency What You will Be Doing: Crafting and refining data pipelines that transform raw information into actionable insights. Designing robust data models and database structures … that support large scale information processing. Partnering with product managers and engineers to understand data needs and usage patterns. Implementing performance enhancing techniques such as indexing, caching, and partitioning. Providing mentorship and guidance to junior data professionals, fostering knowledge sharing and collaboration. Establishing rigorous data validation and quality assurance processes to maintain integrity across systems. Troubleshooting and More ❯

As a Data Engineer , youll design, build, and maintain scalable pipelines and models that ensure data is accurate, accessible, and usable across the organisation. Youll partner closely with analysts, engineers, and business stakeholders, applying modern software development principles and promoting a DataOps culture of automation, reliability, and agility. Key Responsibilities Design, build, and optimise data pipelines … across a modern data platform. Ingest, clean, and transform data using tools such as dbt, Snowflake, and Airflow . Collaborate with cross-functional teams to deliver data products aligned to business priorities. Develop scalable data models that support BI and analytics platforms including Tableau and Power BI. Apply robust engineering practices (testing, version control, CI/… CD) to all development. Advocate for and embed DataOps principles across data workflows. Partner with other technology functions to solve shared challenges and streamline processes. Ensure compliance with security and quality frameworks, including ISO 27001, BS 10012, ISO 50001, and ISO 22301 . Skills & Experience Strong SQL expertise, with the ability to write and optimise complex queries. Hands-on More ❯

Description We are looking for a contract Data Engineer, to join us as we look to support our stakeholders with Finance, specifically improving the accuracy of our existing finance reporting. You will deliver data products in line with business requirements which enable data driven decision making. Understand business needs, design and deliver cloud solutions which enable … data analysis across the business. You'll help is to be ready to move our platform to the next stage and explore Data Engineering concepts, demonstrating what a well designed data platform can provide for our customers. Design, deliver and improve data products in a timely fashion. Develop the current data warehouse solution, designing and … deliver engineering solutions which meet the business needs. Find and implement new methods or technology to reduce the time required to ingest and self-serve data. The Team The data team is an enabling team and as such it is important to note that we are a key function for all other teams across the business. We consist of More ❯

Senior Data Engineer Opportunity to work on an AI-powered platform Salary up to £110k + Private Medical Insurance + Share Options Hybrid working from our London HQ (Paddington) Tech stack: Python, Scala, SQL, AWS, Spark If you'd prefer to keep your CV and personal data private, feel free to WhatsApp your details or CV directly … transform the way our industry operates. WHAT YOU WILL BE DOING As a key member of our tech team, you will take ownership of building Fornax - our AI-powered data migration platform. This system is designed to seamlessly transfer data from outdated legacy systems into our own platform, enabling rapid onboarding of new clients and driving our continued … growth. ESSENTIAL SKILLS Strong SQL querying skills Proven experience in data migrations and data pipeline development Proficiency in writing clean, maintainable code and collaborating effectively within a team environment TO BE CONSIDERED Please apply online or email me directly at .For further information, call me on . By applying for this role, you are giving express consent for More ❯

science performed at Diamond. Our software systems facilitate operations at all levels, including the low-level control of synchrotron and beamline hardware, the planning, execution and monitor of experiments, data archiving and retrieval, data processing and visualisation, the application for beamtime, and capture of remote experiment plans and samples. Our software engineers work alongside our scientists to develop … innovative and robust solutions to keep Diamond at the forefront of scientific research. About the Data Acquisition Group The Data Acquisition (DAQ) group develops software to interface with and control the hardware which allows experiments to be performed and monitored as well as guiding the end user to tools for data reduction and analysis. The group works … closely with scientists, controls, data analysis and information management engineers to continuously develop and improve software solutions for scientific data acquisition and on-the-fly monitoring and data analysis. The current DAQ software platform is a client-server application called GDA (Generic Data Acquisition) which is written in Java and uses the Eclipse RCP framework. To More ❯

Data Platform Engineer | London (3 days onsite) | 6 Month Contract | Inside IR35 We are looking for an experienced Data Platform Engineer to join a forward thinking infrastructure and data optimisation team. In this role you'll be responsible for analysing storage consumption patterns, working closely with development teams to rightsize databases, and implementing automated data archiving and tiering strategies as part of a broader data lifecycle management initiative. Location: London (3 days onsite) Contract: 6-months (IIR35) Rate: £550-650 (depending on experience) Start date: ASAP Key responsibilities: Analyse application-level storage usage and consumption trends Identify optimisation opportunities and collaborate with dev teams to implement storage efficiency improvements Lead and implement automated … data archiving, tiering, and lifecycle management solutions Support database rightsizing efforts and help reduce infrastructure costs Contribute to the design of scalable, efficient data platforms aligned with business and compliance needs Required Experience: Strong background in data platform engineering , database management, or storage optimisation Experience with application-level storage analysis and performance tuning Familiarity with automated data More ❯

Job summary Data Science and clinical intelligence are revolutionising healthcare, offering opportunities for continuous clinical improvement as well as more personalised care. In this senior role, you will lead on the delivery and continued improvement of MFT's data management platform and services. As weseek to improve clinical quality through digital solutions, we'll look to your expertise … in designing and developing information solutions, with a particular focus on cloud and web-based data platforming. You will also lead on the specification and development of dataflows, models, automation, and reports, ensuring we deliver a first-class service to the Trust. On-site working (Trafford House, Wythenshawe) will be required in some form. If you are shortlisted, you … acute healthcare sector. Along with advanced technical and analytical skills, experience of designing and delivering large, enterprise-wide relationalmodelling and analytical solutions is critical. Knowledge of SQL, ETL, modelling, data science, andvisualisations platforms is essential. Main duties of the job This is a senior developer role, leading in the development, maintenance, and continued improvement of the Trust data More ❯

A fantastic opportunity has arisen for a person to join a department to assist with the delivery of innovative generative AI data solutions. This role performs the duties of a Data Engineer specialising in generative AI and reports to the senior lead within a developing international and transversal structure. Key Responsibilities: Evaluate, design, deploy, improve and support … data sets for internal customers, ensuring resilience, security and responsiveness. Collaborate with internal stakeholders to optimise and secure their data in line with operational needs. Maintain and enhance data pipelines, ensuring compliance with data governance standards. Provide expertise in data management and quality assurance. Stay up to date with evolving technology, contribute to the technology … in the industrial and/or defence sector. The successful candidate must have: SQL technologies skills (e.g. MS SQL, Oracle). noSQL technologies skills (e.g. MongoDB, InfluxDB, Neo4J). Data exchange and processing skills (e.g. ETL, ESB, API). Development skills (e.g. Python). Big data technologies knowledge (e.g. Hadoop stack). This position offers a lucrative benefits More ❯

Role Title: Data Scientist ML Engineer Duration: contract to run until 28/11/2025 Location: Birmingham/Sheffield, Hybrid 2-3 days onsite Rate: TBC Key Skills/requirements Carrying out preprocessing of structured and unstructured data Enhancing data collection procedures to include all relevant information for developing analytic systems Processing, cleansing, and validating … the integrity of data to be used for analysis. Analyzing large amounts of information to find patterns and solutions. Developing prediction systems and machine learning algorithms Presenting results in a clear manner Propose solutions and strategies to tackle business challenges. Data mining or extracting usable data from valuable data sources. Using machine learning tools to select … Scala and java is an added advantage. Statistics - Good applied statistical skills, including knowledge of statistical tests, distributions, regression, maximum likelihood estimators, etc. Proficiency in statistics is essential for data-driven companies. Machine Learning - good knowledge of machine learning methods like Decision-making, k-Nearest Neighbors, Naive Bayes, SVM, Decision Forests. Strong Math Skills (Multivariable Calculus and Linear Algebra More ❯

A fantastic opportunity has arisen for a person to join a department to assist with the delivery of innovative generative AI data solutions. ** Please note that due to the nature of the client’s business, only candidates who currently hold full sole British Citizenship (without limitations) will be considered. ** This role performs the duties of a Data Engineer specialising in generative AI and reports to the senior lead within a developing international and transversal structure. Key Responsibilities: Evaluate, design, deploy, improve and support data sets for internal customers, ensuring resilience, security and responsiveness. Collaborate with internal stakeholders to optimise and secure their data in line with operational needs. Maintain and enhance data pipelines, ensuring … compliance with data governance standards. Provide expertise in data management and quality assurance. Stay up to date with evolving technology, contribute to the technology roadmap, and deliver cutting-edge solutions. The successful candidate will ideally have: Knowledge in NLP (Natural Language Processing). Knowledge in OCR (Object Character Recognition). Knowledge in Generative AI. Experience in containerisation technologies More ❯

A fantastic opportunity has arisen for a person to join a department to assist with the delivery of innovative generative AI data solutions. ** Please note that due to the nature of the client’s business, only candidates who currently hold full sole British Citizenship (without limitations) will be considered. ** This role performs the duties of a Data Engineer specialising in generative AI and reports to the senior lead within a developing international and transversal structure. Key Responsibilities: Evaluate, design, deploy, improve and support data sets for internal customers, ensuring resilience, security and responsiveness. Collaborate with internal stakeholders to optimise and secure their data in line with operational needs. Maintain and enhance data pipelines, ensuring … compliance with data governance standards. Provide expertise in data management and quality assurance. Stay up to date with evolving technology, contribute to the technology roadmap, and deliver cutting-edge solutions. The successful candidate will ideally have: Knowledge in NLP (Natural Language Processing). Knowledge in OCR (Object Character Recognition). Knowledge in Generative AI. Experience in containerisation technologies More ❯

Senior Data Engineer - Hybrid - Up to £80,000 Imcurrentlysupportingawell-establishedorganisationthatisundergoingamajordigitaltransformationandbuildinga modern,enterprise-scaledataplatform .Aspartofthisgrowth,theyrelookingforanexperienced SeniorDataEngineer tojointheteamonafull-time,permanentbasis. TheyhaveanofficeinLeicester,whichthey'rehappyforpeopletoattendasfrequentlyasacoupleoftimesaweekoracoupleoftimesamonth if you live further afield. Thisrolewouldsuitsomeonewhothrivesindesigninganddelivering robust,scalabledatasolutions thatdrivebusinessinsightandinnovation. Whatyoullbeworkingon: Designingandimplementing lakehouse/medallionarchitectures with Azure+Databricks Developingandoptimising ETLpipelines (AzureDataFactory,Python,SQL) Managing MSSQL/AzureSQLdatabases Deliveringcleanoutputsfor PowerBI reporting Ensuringstronggovernance,security,anddocumentationinan Agile/CI-CDenvironment Whatwerelookingfor More ❯