26 to 50 of 586 Permanent Data Engineer Jobs

Data Engineer (Databricks) - Leeds (Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names … within technology. They are looking for Data Engineers with significant Databricks experience to join an exceptional Agile engineering team. We are seeking a Data Engineer with strong Python, PySpark and SQL experience, possess a clear understanding of databricks, as well as a passion for Data Science (R, Machine Learning and AI). Database experience with SQL … exposure along with SOLID principles. Continuous Integration tools, Infrastructure as code and strong Cloud Platform knowledge, ideally with AWS is also key. We are keen to hear from talented Data Engineer candidates from all backgrounds. This is a truly amazing opportunity to work for a prestigious brand that will do wonders for your career. They invest heavily in More ❯

Data Engineer (Python SQL ETL) London/WFH to £80k Are you a tech savvy Data Engineer with experience of working with sensitive patient/healthcare data? You could be progressing your career as a Data Engineer working on Tech for Good application for the healthcare sector that utilises AI and Machine Learning … techniques to help prevent patients from experiencing health crisis. As a Data Engineer you will take ownership of the healthcare data pipelines and platforms, focussing on implementing robust ETL processes and scalable data architectures, collaborating with various teams to deliver high quality data solutions. You'll develop and maintain data infrastructure on Azure Data Lakes and Data Warehouses; create robust data transformation processes that ensure data quality, consistency and security and implement automation workflows. You will help to maintain compliance with ISO27001 and ISO13485 requirements for healthcare data management and ensure that security first practices are employed in all data processing solutions to protect sensitive patient information. This More ❯

Data Engineer (Python SQL ETL) London/WFH to £80k Are you a tech savvy Data Engineer with experience of working with sensitive patient/healthcare data? You could be progressing your career as a Data Engineer working on Tech for Good application for the healthcare sector that utilises AI and Machine Learning … techniques to help prevent patients from experiencing health crisis. As a Data Engineer you will take ownership of the healthcare data pipelines and platforms, focussing on implementing robust ETL processes and scalable data architectures, collaborating with various teams to deliver high quality data solutions. You'll develop and maintain data infrastructure on Azure Data Lakes and Data Warehouses; create robust data transformation processes that ensure data quality, consistency and security and implement automation workflows. You will help to maintain compliance with ISO27001 and ISO13485 requirements for healthcare data management and ensure that security first practices are employed in all data processing solutions to protect sensitive patient information. This More ❯

Overview We are looking for a data engineer experienced in DevOps-based pipeline delivery, who can not only develop the pipeline but also establish the foundational framework for reusable data ingestion processes. The ideal candidate is proactive, a self-starter, and demonstrates a strong can-do attitude. While not essential, experience with Health Data systems would … be highly advantageous. Responsibilities Ingestion Framework Delivery: Responsible for building reusable metadata driven data pipelines within a framework to handle batch and near-real-time data feeds. Data Pipeline Development: Develop end-to-end data pipelines, including data load patterns, error handling, automation, and hardware optimisation. Requirements Formulation: Collaborate with Business Analysts, Architects, SMEs, and … teams to define requirements and implement solutions using modern EDW cloud tools and best practices. Detailed Solution Design: Work with architects and analysts to create detailed solution designs for data pipelines, ensuring adherence to policies, rules, and standards. Promote DevOps best practices for iterative solution delivery including CI/CD, version control, monitoring and alerting, automated testing and IaC. More ❯

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, youll not only be part of a creative and open work culture focused on innovation and … making it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. Integrate … data management technologies and software tools into existing structures. Create data tools to support sport data modelling, prediction and analytics. Work with data and analytics experts to strive for greater functionality in our data systems. As the selected Data Engineer, your background will include: 3+ years industry experience in a Data Engineer More ❯

At Dufrain , we don't just build data solutions-we shape the future of data-driven decision-making. Do you thrive on solving complex challenges and turning data into powerful insights that drive transformation? We're looking for Data Engineers who have a broad range of data engineering skills, with a focus on Microsoft Databricks … . Experience with Microsoft Fabric or Snowflake is also highly desirable. ABOUT THE ROLE As a Data Engineer, you will play a key role in delivering high-quality data solutions for our clients. This role offers the opportunity to work across a variety of technologies and contribute to the growth of our Consulting practice. ROLE RESPONSIBILITIES Develop … good working relationships with clients on a project, including interpersonal skills with both business and technical colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Deliver high-quality work, escalate problems to clients or senior team members when necessary, and propose solutions. Support building the Consulting practice through More ❯

Data Engineer | Data Consultant | Azure | Fabric | Python | SQL | PySpark Senior Data Engineer - Up to £70,000 London - 3 days in-office Method Resourcing are thrilled to be partnering with a Microsoft Solutions Partner to support them in hiring a Data Consultant to focus on and specialise on their current and upcoming Fabric projects. This … pipeline of projects confirmed for the coming 18 months. You will be an in-house specialist for Microsoft fabric and work on a variety of projects, focusing largely on Data Engineering tasks and work streams to deliver Fabric/Azure solutions for a range of clients. For this role, we are looking for someone who can demonstrate experience in … the following areas: Commercial experience with implementing Fabric strong Azure experience - Ideally using ADF, Databricks, ADLS etc Data Engineering background - ETL development, data storage platforms such as Data Warehouse, Lake, or Lakehouse architectures You will ideally have come from a consultancy background, and henceforth understand how to balance multiple projects with different clients at one time and More ❯

Position : Senior Data Engineer Salary: Negotiable, depending on Experience Location : Hybrid - Bristol, Manchester, or London Security Requirement : SC Clearance to start and be willing/able to obtain DV Clearance We are seeking Data Engineers, with a keen interest/experience in AI/ML and strong proficiency in Python Scripting. To join our Consultancy client working … on meaningful projects in the Defence and Security sector. Required Experience: End-to-End Data Development : Strong experience with data pipelines, ETL processes, and workflow orchestration, demonstrating best practices across tech stacks. Strong Python Skills Diverse Data Handling : Familiarity with batch, streaming, real-time, and unstructured data sources. Architectural Design & Systems Thinking : Ability to design and … build scalable, high-performance data solutions. Data Modelling & Warehouse Design : Proficiency in data modelling, warehouse design, and database optimization, with examples of logical and physical models. Distributed Data Systems : Experience in deploying, managing, and tuning distributed systems for optimal reliability and performance. Coding & Development Practices : Demonstrated coding expertise with modular, reusable, and efficient code in various More ❯

and offers the opportunity for growth. As a company, we live by six core values that guide everything we do: Clear Honest Ambitious Inquisitive Caring Sustainable The Role Senior Data Engineerat SO ENERGY As a Senior Data Engineer, you will play a key role in the development and maintenance of our data infrastructure, ensuring efficient and … scalable data pipelines. You will be responsible for hands-on implementation and optimization of data systems on the Google Cloud Platform (GCP), contributing to critical projects while mentoring junior Engineers. This role focuses on delivering technical solutions, applying best practices, and driving innovation within the data engineering team. Reporting into our Interim Head of Data. What you … ll be getting up to: Design, develop, and maintain scalable data pipelines using modern data engineering tools and technologies on our GCP stack. Build and optimize our lake house on Google Cloud Platform (GCP). Implement data ingestion, transformation, and loading processes for various data sources (e.g., databases, APIs, cloud storage). Ensure data quality More ❯

Role Summary Tasman is defining the future of Data Analytics-as-a-Service. We are a young and growing company funded fully by analytics & data science work for our ambitious clients. We are hiring a senior data engineer at Tasman to: Take ownership of the design and implementation of data pipelines and platforms for our … clients Mentor and develop other Engineers to achieve their full potential Work with Data Product Manager to develop plans and roadmaps that deliver on client objectives each sprint and throughout the engagement Support and enable other functions within your team to deliver data products. ABOUT TASMAN At Tasman, we transform disorganised data into meaningful business value, empowering … analytics. As a boutique consultancy with offices in the UK and the Netherlands, we have been serving clients across Europe since 2017. Our expertise spans analytics, business intelligence, and data science, allowing us to deliver rapid, impactful results through tailored, scalable solutions. Our past and current clients include well known brands like The Earthshot Prize, Verisure, Paired, Ecosia, Gousto More ❯

We are seeking a skilled and proactive Azure Data Engineer to join our Data team. This role is critical in design input and development to managing and optimising our data infrastructure using Microsoft Azure. The role will play a key part in enabling data-driven decision-making by developing robust data pipelines, ensuring data integrity, and supporting analytics and reporting functions. This role is perfect for a driven Azure Data Engineer who thrives on solving complex data challenges and contributing to the success of a forward-thinking law firm. Roles and Responsibilities Data Infrastructure Development • Build and maintain scalable data pipelines as defined by our Senior Data Architectures on Azure. • Develop and manage ingestion, transform, and process data pipelines from various sources with tools such as Tray.io, Azure Data Factory. • Implement data lakes and data warehouses using Azure Synapse Analytics, Azure Data Fabric or similar tools. Data Integration & Transformation • Develop and maintain ELT (Extract, Load, Transform) and ETL (Extract, Transform More ❯

Senior Data Engineer We are seeking a highly skilled Data Engineer to focus on maintaining data streams and ETL pipelines within a cloud-based environment. The ideal candidate will have experience in building, monitoring, and optimizing data pipelines, ensuring data consistency, and proactively collaborating with upstream and downstream teams to enable seamless data flow across the organization. In this role, you will not only troubleshoot and resolve pipeline issues but also contribute to enhancing data architecture, implementing best practices in data governance and security, and ensuring the scalability and performance of data solutions. You will play a critical role in understanding the business context of data, supporting analytics … and decision-making by collaborating with data scientists, analysts, and other key stakeholders This position requires client presence between 25%-50% of the time per month at the client's office, which is located in London. Key Responsibilities: Data Pipeline Development & Maintenance Build, maintain, and optimize scalable ETL/ELT pipelines using tools such as Dagster, or similar. More ❯

Senior Data Engineer Consultant This leading Data & Insights Consultancy have a great pipeline of projects and are now seeking a Senior Data Engineer Consultant to join their consulting team. In this client facinf role you will get the opportunity to apply your hands-on data engineering skills across a wide variety of challenging projects … and deliver value-adding data and analytics solutions that make a true business impact. Role & Responsibilities As a Senior Data Engineer Consultant you will utilise your functional and hands-on technical data engineering skills to implement end-to-end reporting, analytics and data solutions for a variety of different customers, from large enterprises to small … deliveries; gathering requirements, understanding business problems, designing and building solutions, reporting and analysis through to go-live and training. You will have plenty of opportunity to flex your broad data skills to help design and deliver solution, and you will have the opportunity to witness the change and impact your work has on the end client. Responsibilities will include More ❯

Data Engineer Lead - NatGas and Power page is loaded Data Engineer Lead - NatGas and Power Apply locations London posted on Posted 12 Days Ago job requisition id JR102268 Job Title: Data Engineer Lead - NatGas and Power Contract Type: Time Type: Job Description: Reporting to the Head of Data, the Data Engineering Lead … will oversee the design, development, and maintenance of high-performance data systems that support trading, risk, and analytics functions across the Natural Gas and Power business. This role bridges technical execution and business impact, ensuring that data pipelines, platforms, and products are robust, scalable, and aligned with enterprise data strategy. The ideal candidate will lead a team … of data engineers, collaborate with trading desks and analysts, and ensure that data infrastructure supports pre-trade modeling, live execution, and post-trade analytics with precision and reliability. Main Responsibilities 1. Data Platform Ownership Lead the development and maintenance of scalable data pipelines and databases tailored to Natural Gas and Power trading workflows. Ensure seamless integration More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate … about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you. Key Responsibilities: Design, develop, maintain, and optimise data pipelines, ETL processes, and More ❯

New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Gloucester Gloucester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We … supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the … Data Engineer be Doing? You will develop mission-critical data solutions and manage pipelines that transform diverse data sources into valuable insights for our client’s National Security customers. You will collaborate with clients to solve complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop More ❯

Data Engineer£55,000 to £65,000 basic salary per annum plus benefits including bonus, pension, 25 days holiday, buy and release annual leave, wellness days, healthcare scheme, excellent career development plans, hybrid-working etc.Our client, a leading UK law firm ranked as one of the best companies to work for in the country, is seeking a Data Engineer to join their AI team on a permanent basis. This is a fantastic opportunity for a Data Engineer to join an innovative law firm where AI has become fundamental to their entire business plan.The successful Data Engineer will split their time between core data engineering tasks and low-code AI product development. … This is a fantastic opportunity for someone with a strong technical background to play a key role in building a brand-new AI-enabled data platform, while also contributing to the development of the AI-driven products it powers. Essential skills: - At least 2-3 years in Data Engineering- Data Warehousing- SQL- Python- Experience with either Power More ❯

Data Engineer £55,000 to £65,000 basic salary per annum plus benefits including bonus, pension, 25 days holiday, buy and release annual leave, wellness days, healthcare scheme, excellent career development plans, hybrid-working etc. Our client, a leading UK law firm ranked as one of the best companies to work for in the country, is seeking a … Data Engineer to join their AI team on a permanent basis. This is a fantastic opportunity for a Data Engineer to join an innovative law firm where AI has become fundamental to their entire business plan. The successful Data Engineer will split their time between core data engineering tasks and low-code AI … product development. This is a fantastic opportunity for someone with a strong technical background to play a key role in building a brand-new AI-enabled data platform, while also contributing to the development of the AI-driven products it powers. Essential skills: - At least 2-3 years in Data Engineering - Data Warehousing - SQL - Python - Experience with More ❯

Senior Data Engineer Remote £70,000 to £80,000 per annum Permanent Our client is seeking a Senior Data Engineer to join their data team in a leading UK SaaS firm. Senior Data Engineer - What will you be doing? * Leading the design and implementation of robust and scalable data architecture solutions. * Driving … the implementation of data integration processes to seamlessly ingest data, leveraging Azure. * Promoting data quality, reliability and integrity within Azure-stored datasets. * Analysing API documentation and analysing raw data and source system data models. * Collaborating with the Senior Data Analyst to assist with complex SQL queries and Power BI reporting. * Conveying technical concepts to … non-technical stakeholders across the business. Senior Data Engineer - What will you need? * Extensive Data Warehouse Experience. * Proficiency in Azure: Azure Data Factory (ETL), Azure SQL Server, Azure DevOps, Key Vaults and Logic Apps. * Strong Data Modeling Skills. * Familiarity with CI/CD pipelines and agile workflows. * Experience integrating data from diverse sources, ensuring More ❯

Broster Buchanan are partnered global business within the food industry with a turnover of £8Bn+ who are looking for a Fabric Data Engineer to join as they set up an exciting new project team within the group. This would suit an experienced Azure Data Engineer with good Fabric experience looking to join a new, growing team … of £55k - £65k + 10% bonus is on offer. Responsibilities: Help set up and deliver the future direction of strategy and approach to the management, storage and usage of data Collaborate with their wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing and lake processes, including … collaborating with their architecture teams to figure out what that will look like At times, guide and mentor the junior data engineers within the team, reviewing their ideas, providing feedback and identifying their knowledge gaps to support their development Design, develop, and manage data pipelines using Fabric Data Factory Leverage Fabric Data Integration for seamless data More ❯

We’re partnering with a mission-driven HealthTech company to find a talented Senior Data Engineer . In this role, you'll work on healthcare data pipelines and platforms, with a strong focus on building robust ETL processes and scalable data architectures. You'll collaborate closely with cross-functional teams to deliver high-quality, reliable data solutions that support impactful health outcomes. You will develop and maintain our data infrastructure, working with both data processing technologies and storage systems. Your commitment to best practices will be essential as you build secure data pipelines, implement efficient ETL processes following healthcare standards, optimise data workflows for performance, and ensure our data solutions … are highly scalable and maintainable. You'll tackle diverse technical challenges across our data stack, emphasizing security-first development and systematic approaches to data architecture. From designing efficient data processing pipelines to implementing robust data governance, this role requires meticulous attention to established processes and standards. You'll focus on writing clean, maintainable code while implementing More ❯

Principal Data Engineer/Architect (Snowflake AWS SQL Python) London/WFH to £140k Opportunity to progress your career in an impactful Principal Data Engineer role at a growing technology company as they scale their UK presence. As a Principal Data Engineer you will lead the architecture and design of the Data Platform … using Snowflake and AWS. Collaborating with product and engineering colleagues as well as internal business stakeholders on the product backlog for the Data Platform, you'll ensure solutions are secure and scalable and promote best practices in CI/CD, IaC and DataOps. Location/WFH: You'll be bale to work from home most of the time, meeting … up with colleagues in the London office once or twice a week. About you: You are a highly technical Data Engineer/Architect with experience of designing data lakes, data pipelines and meta data management You have strong Snowflake and AWS data services experience You have advanced SQL and Python coding skills You have More ❯

Principal Data Engineer/Architect (Snowflake AWS SQL Python) London/WFH to £140k Opportunity to progress your career in an impactful Principal Data Engineer role at a growing technology company as they scale their UK presence. As a Principal Data Engineer you will lead the architecture and design of the Data Platform … using Snowflake and AWS. Collaborating with product and engineering colleagues as well as internal business stakeholders on the product backlog for the Data Platform, you'll ensure solutions are secure and scalable and promote best practices in CI/CD, IaC and DataOps. Location/WFH: You'll be bale to work from home most of the time, meeting … up with colleagues in the London office once or twice a week. About you: You are a highly technical Data Engineer/Architect with experience of designing data lakes, data pipelines and meta data management You have strong Snowflake and AWS data services experience You have advanced SQL and Python coding skills You have More ❯

Senior Data Engineer (on-prem) £70,000 - £80,000 + Bonus + PHC, high pension contribution Bournemouth: Hybrid On premise Microsoft BI Technology stack Senior Data Engineer: The role A business on the brink of a data revolution - and they need a Senior Data Engineer to help lead the charge! This is not … warm" kind of role. You'll be at the heart of a major transformation, helping the business bridge the gap between legacy systems and a cutting-edge Azure-based data platform. Senior Data Engineer: What You'll Be Doing Maintain and enhance the existing SQL-based systems (SSIS, SSRS, SSAS). Collaborate with the Lead Engineer to deliver scalable, cloud-first solutions using Azure technologies. Ensure seamless integration between legacy and modern platforms. Work closely with finance teams to modernise their data processes Bring leadership and gravitas to a business-facing role. Senior Data Engineer: Must-Have Experience: Strong SQL skills and experience with SSIS, SSRS, SSAS Data warehousing, ETL processes More ❯

and HuffPost UK. The additional brands echo the existing business ethos and allow for increased audiences and a further strategic diversification of revenue streams. About You An experienced Lead Data Architect & Engineer who is a positive, collaborative, proactive, self-driven professional with a passion for building scalable data solutions. Confident working across teams, and comfortable managing multiple … stakeholders. An innovative and systems-focused mindset, with a proven track record of designing infrastructure that supports both immediate business needs and long-term growth. An accomplished Lead Data Engineer with advanced knowledge of SQL and hands-on experience with both relational and non-relational databases, supporting data needs in fast-paced, content-driven environments. Strong expertise … in designing and maintaining scalable data pipelines and architectures—integrating data from web analytics, content management systems (CMS), subscription platforms, ad tech, and social media. Proven ability to automate and optimise data workflows, using modern ETL/ELT tools (e.g., Airflow, dbt, Apache Spark) to ensure timely and reliable delivery of data. Experience building robust data More ❯