226 to 250 of 636 Data Engineer Jobs in the UK

eSC Cleared Data Engineer Bristol or London (Mostly working from home) Up to 745 per day (Umbrella, Inside IR35) Must hold live and transferrable Enhanced SC Security Clearance About the Role We're seeking an experienced Data Engineer to join a high-profile programme, working with cutting-edge cloud and data technologies. You'll be … instrumental in building, optimising, and maintaining scalable data pipelines and platforms that underpin mission-critical systems. If you thrive on solving complex data challenges, working with modern orchestration tools, and applying best practices in security and compliance, this role offers both technical depth and impact. Key Responsibilities Design & Optimise Pipelines - Build and refine ETL/ELT workflows using … Apache Airflow for orchestration. Data Ingestion - Create reliable ingestion processes from APIs and internal systems, leveraging tools such as Kafka, Spark, or AWS-native services. Cloud Data Platforms - Develop and maintain data lakes and warehouses (e.g., AWS S3, Redshift). Data Quality & Governance - Implement automated validation, testing, and monitoring for data integrity. Performance & Troubleshooting - Monitor More ❯

Data Engineer Contract Opportunity Outside IR35 Up to £400/day Amtis is proud to be recruiting for a contract Data Engineer to join a fantastic client based in the West Midlands. You will be responsible for: Designing, developing, and deploying scalable data platforms. Lead the implementation and support the data infrastructure. Analyse complex … datasets to uncover correlations and resolve data integrity issues. Collaborate with stakeholders to gather requirements and deliver tailored data solutions. Provide ongoing support and manage queries from SMEs and stakeholders. Create and maintain technical design documentation. Propose innovative solutions and emerging technologies to support strategic initiatives. Partner with BI and Data team members to deliver impactful, data-driven solutions. Support colleagues across the business in interpreting and leveraging data effectively. Maintain comprehensive documentation for all developed products. What You'll Bring: Proven experience delivering advanced analytics and data warehousing solutions. Expertise in cloud data platforms such as Azure , AWS , or GCP . Strong hands-on experience with Snowflake and Matillion . Deep understanding More ❯

Curve is a next-gen insights, analytics and technology consultancy that leverages digital consumer data and advanced technology to help businesses unlock consumer opportunities. Digital consumer data is powerful; it's big, it's real, and it's always updating. We use a combination of in-house technology and bespoke solutions, powered by AI, to transform data … machine learning and AI are key to how we deliver impact, centred on: Natural Language Processing, GPT & other LLMs : unearthing trends, themes and other patterns from large text-based data sets, and deploying state-of-the-art AI to automate and empower consumer facing businesses and their insights & analytics functions Marketing Data Science & Personalisation : using first party consumer … data to understand each client's consumer base, building personalisation and other machine learning models to better engage with and excite consumers Data Engineering & Data Architecture : data engineering across a variety of tools to integrate these leading technologies into optimised and efficient data models and ecosystems, feeding into best-in-class analytics dashboards, marketing activation More ❯

by delivering ultrafast connectivity to business dense areas across the UK, working with partners to identify the right locations and then maximising subsequent connection rates. Role Description As a Data Engineer at ITS you will be a core member of the wider technical team, responsible for designing, building, and optimising the pipelines that turn raw network, commercial, and … operational data into trustworthy, analytics ready assets. Working closely with Data Analysts, Network Engineering, and Digital teams, you will own our data platform, ensuring data is accurate, timely, and secure to drive reporting, automation, and develop towards AI driven decision making. Key Responsibilities • Design, develop and maintain scalable ELT/ETL pipelines that ingest data from network devices (IPDR, SNMP, OSS/BSS), CRM, finance, and IoT platforms into our BI warehousing environment. • Model data using Kimball/star schemas and data vault principles to support BI and self service analytics. • Implement data quality, lineage, and observability tooling (e.g., dbt tests, Great Expectations, Azure Purview). • Optimise storage and compute costs More ❯

Job Title: Lead Data Engineer Location: London (Hybrid) Type: Full-time Agency: Representing a leading digital media group We're representing a forward-thinking digital media organisation with a growing portfolio of high-traffic content brands. As they continue to scale their data capabilities, they're seeking a Lead Data Engineer to join their London … based team. Key Responsibilities: Design and maintain scalable data pipelines across diverse sources including CMS, analytics, ad tech, and social platforms. Lead engineering efforts to automate workflows using tools like Airflow, dbt, and Spark. Build robust data models to support dashboards, A/B testing, and revenue analytics. Collaborate with cross-functional teams to deliver actionable insights and … support strategic initiatives. Drive cloud-based data infrastructure projects, particularly on GCP. Manage and mentor a Data Engineer, fostering growth and technical excellence. Requirements: Advanced SQL skills and experience with relational/non-relational databases. Proficiency in Python and/or Java for data services and API integration. Proven experience with cloud platforms (GCP preferred) and More ❯

Job Title: Lead Data Engineer Location: London (Hybrid) Type: Full-time Agency: Representing a leading digital media group We're representing a forward-thinking digital media organisation with a growing portfolio of high-traffic content brands. As they continue to scale their data capabilities, they're seeking a Lead Data Engineer to join their London … based team. Key Responsibilities: Design and maintain scalable data pipelines across diverse sources including CMS, analytics, ad tech, and social platforms. Lead engineering efforts to automate workflows using tools like Airflow, dbt, and Spark. Build robust data models to support dashboards, A/B testing, and revenue analytics. Collaborate with cross-functional teams to deliver actionable insights and … support strategic initiatives. Drive cloud-based data infrastructure projects, particularly on GCP. Manage and mentor a Data Engineer, fostering growth and technical excellence. Requirements: Advanced SQL skills and experience with relational/non-relational databases. Proficiency in Python and/or Java for data services and API integration. Proven experience with cloud platforms (GCP preferred) and More ❯

Join Barclays as a Digital Customer Data Engineer, where you'll be leading the development for a new shared data platform that is transforming how individuals/organisations interact with the bank. Your role involves using the latest data and AI engineering skills to deliver a digital capability. As part of our team, you'll also … benefit from being part of a vast professional network, collaborating with industry mentors and experts. To be successful you should have experience with: Modern data engineering practices, inc. event-driven and data lake. Digital platform development, inc. experience developing colleague and customer facing applications. Banking software development. Deep technical awareness of cloud and data technology, such as … Kafka, Data Bricks, microservices, API. Some other highly valued skills may include: Technical design: Analysis and documentation of system characteristics, inc. designing solutions to meet multi-faceted non-functional requirements. Communication Skills: Ability to clearly convey project goals to senior leadership, updates, and technical details to stakeholders at all levels, including non-technical audiences at all levels of the More ❯

A rapidly growing specialist manufacturing business is looking to recruit a talented Data Engineer to join their newly established product development program, based in Abingdon (OX14) . This is an exceptional opportunity to be at the forefront of aerospace innovation, working with advanced materials and additive manufacturing to revolutionize jet engine performance. Data Engineer key responsibilities … Design and maintain robust data logging frameworks to capture real-time jet engine performance metrics Build scalable data architectures for processing and analyzing complex experimental data Create versatile sandbox environments for rapid prototyping and fast iteration Own the data acquisition platforms that enable breakthrough testing capabilities Collaborate directly with testing engineers to ensure experiments are feasible … from an infrastructure standpoint Develop automated workflows for platform-agnostic post-processing and self-service data access Implement clean code practices with strict version control across code repositories Build dashboards and control systems for real-time test monitoring Enforce data security, privacy, and compliance standards Key requirements for Data Engineer: Minimum First Class Degree (MSc preferred More ❯

Data Engineer - UK - Remote A leading AI-powered search intelligence platform is hiring a Data Engineer to join their globally recognised data team. If you're passionate about distributed systems, real-time data, and cutting-edge tech, this is your chance to make a real impact at an award-winning AI tech company. About … the role: Build and maintain distributed data systems processing millions of data points daily. Design complex Spark jobs, asynchronous APIs, and scalable data pipelines. Collaborate with Data Science and Web teams to deliver user-centric solutions. Use Gen AI tools to accelerate development and improve quality. Requirements: Strong experience with Scala, Java, and distributed systems (Spark … . Hands-on expertise in ETL workflows, orchestration tools, and cloud platforms. Familiarity with Gen AI tools for coding and debugging. Solid understanding of data structures, algorithms, and database technologies. A collaborative mindset and a passion for solving complex problems. Benefits: Trust-Based Vacation Policy - take time off when you need it Private Medical Healthcare Generous Parental Leave & Pension More ❯

Data Engineer - UK - Remote A leading AI-powered search intelligence platform is hiring a Data Engineer to join their globally recognised data team. If you're passionate about distributed systems, real-time data, and cutting-edge tech, this is your chance to make a real impact at an award-winning AI tech company. About … the role: Build and maintain distributed data systems processing millions of data points daily. Design complex Spark jobs, asynchronous APIs, and scalable data pipelines. Collaborate with Data Science and Web teams to deliver user-centric solutions. Use Gen AI tools to accelerate development and improve quality. Requirements: Strong experience with Scala, Java, and distributed systems (Spark … . Hands-on expertise in ETL workflows, orchestration tools, and cloud platforms. Familiarity with Gen AI tools for coding and debugging. Solid understanding of data structures, algorithms, and database technologies. A collaborative mindset and a passion for solving complex problems. Benefits: Trust-Based Vacation Policy - take time off when you need it Private Medical Healthcare Generous Parental Leave & Pension More ❯

Data Engineer - UK - Remote A leading AI-powered search intelligence platform is hiring a Data Engineer to join their globally recognised data team. If you're passionate about distributed systems, real-time data, and cutting-edge tech, this is your chance to make a real impact at an award-winning AI tech company. About … the role: Build and maintain distributed data systems processing millions of data points daily. Design complex Spark jobs, asynchronous APIs, and scalable data pipelines. Collaborate with Data Science and Web teams to deliver user-centric solutions. Use Gen AI tools to accelerate development and improve quality. Apply best practices in TDD, SOLID, and scalable architecture. Requirements … Java, and distributed systems (Spark). Hands-on expertise in ETL workflows, orchestration tools, and cloud platforms. Familiarity with Gen AI tools for coding and debugging. Solid understanding of data structures, algorithms, and database technologies. A collaborative mindset and a passion for solving complex problems. Benefits: Trust-Based Vacation Policy - take time off when you need it Private Medical More ❯

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer experiences. It is initially … one day a week being based in their Nottingham office, this is negotiable. It is a full-time role, 37 hours per week. Accountabilities: Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. Build and manage an enterprise data model within Databricks. Integrate new data sources into the platform … using batch and streaming processes, adhering to SLAs. Create and maintain documentation for data pipelines and associated systems, following security and monitoring protocols. Ensure data quality and reliability processes are effective, maintaining trust in the data. Be comfortable with taking ownership of complex data engineering projects and develop appropriate solutions in accordance with business requirements. Able to More ❯

Principal Market Data Engineer page is loaded Principal Market Data Engineer Apply locations Belfast time type Full time posted on Posted Yesterday job requisition id R4033 About Liquidnet Liquidnet is a next-generation agency execution specialist. Powered by technology that helps drive institutional alpha, our trading and liquidity network intelligently and securely connects the world's … Our purpose guides every decision we make, from the tools we develop to the relationships we nurture with our Members. Role Overview As a member of the Liquidnet Market Data team, you will be responsible for multi-vendor market data feeds, middleware/infrastructure, Solace appliance/messaging and data types including low latency market data infrastructure. This is a unique opportunity to work with the latest cutting-edge technologies across major market data providers in the field today. The successful candidate will also support internal Product Support and Development Technology team with our applications. The ideal candidate will have at least 7 years' experience in a similar role from the financial services or More ❯

Senior AWS Data Engineer - Greenfield Market Data Platform | London | Vice President Level Location: London - Canary Wharf (Hybrid: 2-3 days/week in office) Salary: Up to around £120,000 + Bonus + Benefits Employment Type: Permanent Industry: Financial Services We're working with a prestigious financial services client on a greenfield data engineering opportunity that … s set to transform how market data is accessed and used across the business. This is a rare chance to join a high-impact initiative at its inception, designing and building a cutting-edge Market Data Store (MDS) platform using the latest cloud technologies. This individual contributor role is ideal for a hands-on Senior Data Engineer who thrives in technically complex environments and enjoys solving large-scale data pipeline challenges. You'll work with tools like AWS Glue, PySpark, Iceberg, Databricks, and Snowflake , collaborating with data scientists and stakeholders across multiple business units. Key Responsibilities: Design, build, and maintain scalable data pipelines and architectures. Implement secure and efficient data lakes and More ❯

Senior AWS Data Engineer - Greenfield Market Data Platform | London | Vice President Level Location: London - Canary Wharf (Hybrid: 2-3 days/week in office) Salary: Up to around £120,000 + Bonus + Benefits Employment Type: Permanent Industry: Financial Services We're working with a prestigious financial services client on a greenfield data engineering opportunity that … s set to transform how market data is accessed and used across the business. This is a rare chance to join a high-impact initiative at its inception, designing and building a cutting-edge Market Data Store (MDS) platform using the latest cloud technologies. This individual contributor role is ideal for a hands-on Senior Data Engineer who thrives in technically complex environments and enjoys solving large-scale data pipeline challenges. You'll work with tools like AWS Glue, PySpark, Iceberg, Databricks, and Snowflake , collaborating with data scientists and stakeholders across multiple business units. Key Responsibilities: Design, build, and maintain scalable data pipelines and architectures. Implement secure and efficient data lakes and More ❯

Europe's biggest credit management service and have begun the next phase in our growth - expansion into 17 European markets over the next two years. The Role - AI Automation & Data Engineer We're seeking a proactive, execution-focusedAI Automation & Data Engineer to join our fast-paced team focused on transforming manual processes into intelligent automation solutions. … You'll work at the intersection of data engineering and AI automation, building robust pipelines and systems that power our company-wide automation initiatives at scale, for a large enterprise operating across 17 markets. This isn't a traditional data engineering role - you'll be building the data foundation for cutting-edge AI automations while using AI … itself to code faster and smarter. You'll have the freedom to identify automation opportunities across the business and build the data infrastructure to support them. In this role, you'll get to: Design and build data pipelines that feed our AI automation systems Create end-to-end automation solutions using Python and Windmill Implement data infrastructure More ❯

Europe's biggest credit management service and have begun the next phase in our growth - expansion into 17 European markets over the next two years. The Role - AI Automation & Data Engineer We're seeking a proactive, execution-focusedAI Automation & Data Engineer to join our fast-paced team focused on transforming manual processes into intelligent automation solutions. … You'll work at the intersection of data engineering and AI automation, building robust pipelines and systems that power our company-wide automation initiatives at scale, for a large enterprise operating across 17 markets. This isn't a traditional data engineering role - you'll be building the data foundation for cutting-edge AI automations while using AI … itself to code faster and smarter. You'll have the freedom to identify automation opportunities across the business and build the data infrastructure to support them. In this role, you'll get to: Design and build data pipelines that feed our AI automation systems Create end-to-end automation solutions using Python and Windmill Implement data infrastructure More ❯

Data Engineer - PowerBI Inside IR35 Fully Remote £350-£400 per day Initial 2 month contract with chance of extension We are looking for an experienced and solutions-focused Data Engineer with strong Power BI expertise. The role includes leading the delivery of scalable, high-quality data pipelines and analytics platforms that power business intelligence, visualisation … involves autonomy in contributing to architectural decisions and engineering standards, with a key focus on Power BI implementation, DAX development, and dashboard optimisation. It suits someone capable of owning data engineering and reporting workstreams, mentoring junior staff, and aligning technical output with strategic business goals. Your Responsibilities · Design, develop, and maintain production-grade data pipelines that support Power … BI dashboards and reporting models. · Implement secure, efficient, and automated data flows to feed Power BI from various structured and unstructured sources. · Develop and optimise Power BI datasets, dataflows, dashboards, and paginated reports to deliver actionable insights. · Lead robust data integration solutions (ETL/ELT) across both batch and streaming contexts using tools such as Azure Data More ❯

My client is based in the London area are currently looking to recruit for an experienced Data Engineer to join their team. They are one of the leaders within their space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by … which will allow them to implement and utilise the most in demand and cutting edge technology on the market right now. Your role will include: Building and maintaining scalable data workflows that connect various internal platforms, including customer management, HR, and financial systems.Automate data ingestion and transformation processes using contemporary cloud-based technologies.Apply rigorous data quality checks … and cleansing procedures to maintain integrity across datasets.Data Structuring & Enrichment Work closely with architecture teams to define unified data representations across business areas.Develop comprehensive datasets tailored for reporting and advanced analytics.Harmonise performance indicators to enable consistent insights across departments.Infrastructure & Workflow Automation Ensure data workflows are modular, version-controlled, and integrated with automated deployment pipelines.Enhance efficiency of data More ❯

Senior AWS Data Engineer I am working with a leading organisation that is embarking on a greenfield initiative to revolutionise how their data is accessed and utilised. As part of this transformation, they're looking for a highly skilled Senior AWS Data Engineer to join their team and help design and build a cutting-edge … data platform. This is a rare opportunity to work on a high-impact project, collaborating with multiple business units and leveraging modern technologies such as Databricks and Snowflake. You'll be at the forefront of solving complex data pipeline challenges while contributing to strategic data architecture decisions. As part of this role, you will be responsible for … some of the following areas: Design and build scalable data pipelines using AWS technologies Collaborate with cross-functional teams to deliver robust data solutions Implement best practices for data governance, quality, and security Process and analyse large datasets using Python and SQL Support the deployment and optimisation of data platforms including Databricks and Snowflake Contribute to More ❯

Senior AWS Data Engineer I am working with a leading organisation that is embarking on a greenfield initiative to revolutionise how their data is accessed and utilised. As part of this transformation, they're looking for a highly skilled Senior AWS Data Engineer to join their team and help design and build a cutting-edge … data platform. This is a rare opportunity to work on a high-impact project, collaborating with multiple business units and leveraging modern technologies such as Databricks and Snowflake. You'll be at the forefront of solving complex data pipeline challenges while contributing to strategic data architecture decisions. As part of this role, you will be responsible for … some of the following areas: Design and build scalable data pipelines using AWS technologies Collaborate with cross-functional teams to deliver robust data solutions Implement best practices for data governance, quality, and security Process and analyse large datasets using Python and SQL Support the deployment and optimisation of data platforms including Databricks and Snowflake Contribute to More ❯

doers across NYC, LDN, TLV, and other locations, where 2 of every 3 managers were promoted from within. Growing your career with Optimove is basically guaranteed. As a Customer Data Engineer, you will be a part of a strong energetic and fast-growing global team. You will be an integral part of clients' ongoing data requests and … projects. You will be working closely with internal CSM teams as well as interacting directly with clients' data teams across different business verticals. Your core responsibilities will involve playing an active role in collaborating with internal teams to construct tailored data transformations and manipulations while working with top-notch technology (Cloud tech etc.) The ideal candidate is an … technical capabilities, and highly effective time management skills. We are looking for a master multi-tasker who thrives in challenging, fast-paced environments, with agility and ease. The Customer Data Engineer is a position that brings with it an excellent opportunity to learn and grow within a rapidly expanding company on the cutting edge of Martech. Responsibilities: Develop More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior Data Engineer … all criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON, CSV … etc.) using Apache Spark, Databricks, or Hadoop Understanding modern data system architectures (Data Warehouse, Data Lakes, Data Meshes) and their use cases Creating data pipelines on cloud platforms with error handling and reusable libraries Documenting and presenting end-to-end data processing system diagrams (C4, UML, etc.) Implementing robust DevOps practices in data More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior Data Engineer … all criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON, CSV … etc.) using Apache Spark, Databricks, or Hadoop Understanding modern data system architectures (Data Warehouse, Data Lakes, Data Meshes) and their use cases Creating data pipelines on cloud platforms with error handling and reusable libraries Documenting and presenting end-to-end data processing system diagrams (C4, UML, etc.) Implementing robust DevOps practices in data More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior Data Engineer … all criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON, CSV … etc.) using Apache Spark, Databricks, or Hadoop Understanding modern data system architectures (Data Warehouse, Data Lakes, Data Meshes) and their use cases Creating data pipelines on cloud platforms with error handling and reusable libraries Documenting and presenting end-to-end data processing system diagrams (C4, UML, etc.) Implementing robust DevOps practices in data More ❯