701 to 725 of 1,003 Data Engineering Jobs in the UK

Software Engineer – Python/Data/Cloud (Mid-Level) London OR Manchester (hybrid) Salary £50k-80k We’re looking for a Mid-Level Software Engineer to join a high-performing squad building large-scale, data-intensive systems primarily in Python . You’ll work on distributed data pipelines that process hundreds of millions to billions of rows … contributing to backend development, data engineering workflows, and system performance. You’ll collaborate closely with senior engineers and an Engineering Manager. The product itself is an AI/ML driven SaaS platform and your contributions will train new models, enabling new features and have large greenfield elements to it. What You’ll Be Working On Build and … maintain backend services and data processing components in Python . Work on large-scale data pipelines operating over huge datasets (hundreds of millions to billions of records). Write performant SQL for data transformations, ETL workflows, and analytical use cases. Contribute to discussions on architecture and design, focusing on scalability, cost, reliability, and performance. Improve observability, testing More ❯

customer needs, translating them into user stories, and working closely with cross-functional Agile teams to deliver high-quality features and improvements. You have experience of managing backlogs, making data-informed decisions, and engaging a wide range of business stakeholders. Youre a strategic thinker whos comfortable being hands-on, balancing short-term delivery with long-term product goals. Must … have: 5+ years of experience in data product management, data analytics, data engineering or a related role. Product owner certification e.g. PSPO, CSPO or equivalent. Working in Agile/Scrum/SAFe (Scaled Agile Framework) environment. Experience in project delivery and/or as a senior business analyst in web and native application delivery. Prior experience … in a global matrix-driven environment, collaborating with multiple suppliers and project teams. Experience managing cross-functional teams, assessing their priorities whilst aligning to the data platform strategy. Excellent senior/executive stakeholder management skills must be extremely comfortable communicating and presenting to senior stakeholders. Comprehensive knowledge of software development principles, including governance, quality, security, and lifecycle management. Understanding More ❯

AI) , you will lead the design, integration, testing, and deployment of Agentic AI applications . This is a hands-on role requiring deep technical expertise in cloud infrastructure, APIs, data engineering, and enterprise connectivity . You will also be responsible for troubleshooting, DevOps, and facilitating cross-platform integration in a hybrid working environment. Key Responsibilities: System Integration & Architecture … Production environments. Manage CI/CD pipelines using Azure DevOps . Access & Security Management Implement authorization code flows and manage access tokens for user profile extraction. Coordinate with cloud engineering teams to provision secure access to Databricks Mosaic AI and other services. Skills, Experience, and Abilities Required: Deep knowledge of cloud infrastructure , APIs , data engineering , and enterprise … multiple environments (SIT, UAT, Production). In-depth understanding of access and security management , including authorization flows and access tokens. Ability to coordinate with cross-functional teams and cloud engineering specialists. More ❯

A fantastic opportunity has arisen for a Data Engineer specialising in Generative AI to join a developing international and transversal structure, supporting the design, build, and maintenance of data sets for internal customers across the organisation. Please note that due to the nature of the client’s business, only candidates who currently hold full sole British Citizenship (without … limitations) will be considered. This role performs the duties of a Data Engineer and reports to the IM GenAI Delivery Office Lead. Key Responsibilities: Evaluate, design, deploy, and support data pipelines and data sets to ensure they are resilient, secure, and responsive. Collaborate with internal customers to optimise and secure data for their specific needs. Provide … expertise in data management, quality, and governance to ensure compliance with organisational standards. Stay up to date with new technologies, contributing to the technology roadmap and delivering innovative solutions. Support and maintain data sets for internal customers, ensuring sustainability and long-term usability. The ideal candidate would have: Experience with SQL technologies (e.g. MS SQL, Oracle). Experience More ❯

Hybrid – Greater Manchester Excellent progression and leadership opportunities Who We Are We’re an established technology-driven organisation focused on building secure, scalable, and high-performing digital platforms. Our engineering culture promotes innovation, collaboration, and continuous improvement. As we expand our technical capabilities, we’re looking for a Lead Software Engineer to help shape the future of our engineering function. Who We’re Seeking We’re searching for an experienced technical leader to own and drive our back-end and data strategy. You’ll lead teams responsible for designing, developing, and optimising cloud-based systems, data pipelines, and APIs — ensuring our solutions are robust, secure, and aligned with modern engineering best practices. You’ll work … closely with business and technical stakeholders to translate requirements into scalable solutions, fostering a high-performance culture within the engineering team. What You’ll Be Doing Lead the design, development, and implementation of .NET back-end systems and data workflows using Databricks . Oversee the build and optimisation of data pipelines within AWS . Drive engineering More ❯

Senior Data Engineer | Hybrid (1-2 Days) | Up to £115K | Python, DBT, Airflow, BigQuery, GCP/AWS OB is partnered with a Unicorn FinTech that is building a world-class data platform to improve lending, and we’re looking for senior engineers who love solving real problems with clean, scalable engineering. If you’re passionate about data … systems, automation, and ownership end-to-end, this is a role where you’ll ship fast, learn fast, and have real impact from day one. You’ll join the Data Platform squad as an immediate contributor. On day one, you’ll write code locally and ship it to production. In your first month, you’ll probably break something, then … fix it, learn from it, and improve the system for everyone. That’s how the team works. What you’ll work on Building internal data products and shaping the data warehouse Working across the stack: ingestion, modelling, orchestration, DevOps, cloud Contributing to a greenfield data platform designed for scale and self-serve Automating pipelines, improving data More ❯

Senior Data Engineer | Hybrid (1-2 Days) | Up to £115K | Python, DBT, Airflow, BigQuery, GCP/AWS OB is partnered with a Unicorn FinTech that is building a world-class data platform to improve lending, and we’re looking for senior engineers who love solving real problems with clean, scalable engineering. If you’re passionate about data … systems, automation, and ownership end-to-end, this is a role where you’ll ship fast, learn fast, and have real impact from day one. You’ll join the Data Platform squad as an immediate contributor. On day one, you’ll write code locally and ship it to production. In your first month, you’ll probably break something, then … fix it, learn from it, and improve the system for everyone. That’s how the team works. What you’ll work on Building internal data products and shaping the data warehouse Working across the stack: ingestion, modelling, orchestration, DevOps, cloud Contributing to a greenfield data platform designed for scale and self-serve Automating pipelines, improving data More ❯

and implement critical solutions that power real-time trading decisions, while mentoring teams and driving client relationships at the highest level. You will go toe-to-toe with senior engineering stakeholders in fast-paced trading environments, influencing architecture, operating models, and data strategy. Key Responsibilities Technical Leadership Architect and deploy complex, distributed systems, with high performance data … system trading environments Lead the development of near-real time and intraday solutions pipelines supporting trading operations across multiple asset classes Architect solutions which are able to integrate market data feeds, position management systems, market fundamentals, P&L Risk and Back Office solutions. Establish software engineering best practices and coding standards for trading applications, upskilling more junior members … of our delivery teams Partner with client CTOs, Heads of Data, and Engineering Leads to align technical delivery with trading objectives and roadmaps and design and implement scalable AI and data solutions for leading trading organisations. Lead Front, Middle or Back Office transformation projects through to production delivery Act as the point of contact for all technical More ❯

TensorFlow, Keras, PyTorch Experience with model deployment and serving tools: ONNX, TensorRT, TensorFlow Serving, TorchServe Familiarity with ML lifecycle tools: MLflow, Kubeflow, Azure ML Pipelines Experience working with distributed data processing using PySpark. Solid understanding of software engineering principles and version control (e.g., Git). Excellent problem-solving skills and ability to work independently or in a team. … Collaborate with cross-functional teams to integrate AI solutions into scalable products Ensure best practices in data engineering and contribute to architectural decisions Support senior team members in identifying and addressing data science opportunities. Required Skills & Experience Proven experience in MLOps or DevOps roles within machine learning environments Strong programming skills in Python, with hands-on experience … ability to work independently or in a team. Typically, 5+ years of relevant work experience in industry, with a minimum of 2+ years in a similar role. Proficiencies in data cleansing, exploratory data analysis, and data visualization Continuous learner that stays abreast with industry knowledge and technology Why Join Us? Work on impactful AI projects with real More ❯

Senior Data Engineer (AWS Kafka) Remote UK to £80k Are you a data technologist with strong AWS and Kafka experience? You could be joining a growing games company that combines state of the art technology, gaming and luxury fashion. What's in it for you: Salary to £80k Remote working Private medical care Life Assurance 25 days holiday … plus your birthday off Impactful role with excellent career progression as the company scales Your role: As a Senior Data Engineer you'll focus on designing, implementing and maintaining scalable and reliable data pipelines that can cope with c50 million events per day, with the aim to scale that to 500 million events per day. You'll be … using Kafka for real-time data streaming and AWS to build, optimise and monitor data warehousing solutions in Amazon RedShift, owning and managing AWS based systems to ensure cost effective, secure and high performance data operations. Location/WFH: You can work from home from anywhere in the UK. Please note: you must be a UK citizen More ❯

The Senior Data/BI Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and … We serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data and reporting solutions from our Dynamics, in-house and 3rd party sources, using the latest … Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly with business users to understand and document business requirements, Undertake/support the monitoring of BAU processes as More ❯

The Senior Data/BI Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and … We serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data and reporting solutions from our Dynamics, in-house and 3rd party sources, using the latest … Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly with business users to understand and document business requirements, Undertake/support the monitoring of BAU processes as More ❯

carbon emissions for a cleaner, brighter future. The role: As a Senior SAP Functional Business Analyst, you will help drive our goals by: Acting as a bridge between the data team (e.g., SAP BW, data engineering, and BI reporting colleagues), the business, and the SAP technical team by helping to build the data foundation and develop … reporting solutions based on SAP processes and data flows. Engaging directly with business stakeholders to understand and clarify reporting and analytics requirements, primarily in the finance (Record-to-Report) domain, and translating them into technical specifications aligned with SAP Business Warehouse (BW/4HANA) and SAP Analytics Cloud (SAC) architecture and development standards. Analysing SAP ERP (ECC) transactions to … identify relevant extractors, tables, and logic for reporting, while acting as a subject matter expert in Financial and other SAP processes, transaction flows, and data structures. Collaborating with data team to design, develop, and validate robust data pipelines and models, ensuring data integrity, consistency, and completeness through validation against ECC source data. Supporting integration efforts across More ❯

decision logic ✅ What You Must Bring UK-based and either hold SC clearance or be eligible and willing to go through clearance 2+ years of experience in applied AI engineering, data engineering, or backend platform work Strong experience in Python — capable of implementing algorithms and working with APIs, data structures, and logic flows Good understanding of … FAISS), and familiarity with relational or graph stores Hands-on experience using frameworks like LangChain , Haystack , or custom orchestration layers Ability to work independently and collaboratively across delivery and engineering teams 🌟 Nice to Have Familiarity with ethical considerations, bias evaluation, and responsible AI deployment Light DevOps or scripting experience to support deployment or debugging Why This Role? This isn More ❯

decision logic ✅ What You Must Bring UK-based and either hold SC clearance or be eligible and willing to go through clearance 2+ years of experience in applied AI engineering, data engineering, or backend platform work Strong experience in Python — capable of implementing algorithms and working with APIs, data structures, and logic flows Good understanding of … FAISS), and familiarity with relational or graph stores Hands-on experience using frameworks like LangChain , Haystack , or custom orchestration layers Ability to work independently and collaboratively across delivery and engineering teams 🌟 Nice to Have Familiarity with ethical considerations, bias evaluation, and responsible AI deployment Light DevOps or scripting experience to support deployment or debugging Why This Role? This isn More ❯

PRINCIPAL DATA ENGINEER £80,000 + BENEFITS LEEDS (Hybrid) Looking for a role where you can truly influence how data engineering is done-while still getting stuck into the tech yourself? THE COMPANY: I'm working with a central data function in the financial services industry that's undergoing a full modernisation of their data platform. They've got technically advanced teams across the wider business and are now building out a core engineering team to unify, elevate and support that community. THE ROLE: It's a strategic, hands-on role where you'll work closely with DevOps, Product, and business partners to unlock the value of data through modern, secure and … work using Azure, Databricks, and Terraform (IaC) Support the migration from legacy platforms to a more modern cloud stack Act as a mentor and technical guide to the wider engineering team Implement data governance requirements Collaborate with non-technical stakeholders to ensure delivery aligns to business needs Stay close to the ML lifecycle YOUR SKILLS AND EXPERIENCE: A More ❯

Engineering Lead - Anti-Fraud Systems | Global Financial Technology | Hybrid We're partnering with a global financial asset manager on a key leadership hire - an Engineering Lead to spearhead the design, development, and modernization of cutting-edge transaction monitoring and fraud detection systems. This is a rare opportunity to lead a high-performing team and shape the future of … organizations. Paying up to £120,000 base including a package of up to £170,000 you will be based out of their City of London offices. The Role: As Engineering Lead, you'll guide a talented team of engineers within the Anti-Fraud Engineering function, part of the company's wider Security, Fraud, and Financial Crime capability. You … cross-functional team of engineers, fostering a culture of trust, inclusion, and technical excellence. Architect and deliver a bespoke fraud detection and transaction monitoring platform using modern cloud and data technologies. Collaborate closely with product, data science, and financial crime experts to define the technical strategy and vision. Champion engineering best practices - from code quality and security More ❯

Engineering Lead - Anti-Fraud Systems | Global Financial Technology | Hybrid We're partnering with a global financial asset manager on a key leadership hire - an Engineering Lead to spearhead the design, development, and modernization of cutting-edge transaction monitoring and fraud detection systems. This is a rare opportunity to lead a high-performing team and shape the future of … organizations. Paying up to £120,000 base including a package of up to £170,000 you will be based out of their City of London offices. The Role: As Engineering Lead, you'll guide a talented team of engineers within the Anti-Fraud Engineering function, part of the company's wider Security, Fraud, and Financial Crime capability. You … cross-functional team of engineers, fostering a culture of trust, inclusion, and technical excellence. Architect and deliver a bespoke fraud detection and transaction monitoring platform using modern cloud and data technologies. Collaborate closely with product, data science, and financial crime experts to define the technical strategy and vision. Champion engineering best practices - from code quality and security More ❯

Senior Data Engineer £70k - £80k Dorset/Hybrid We’re delighted to be hiring on behalf of a highly regarded brand with an ethical purpose at their core. And right now, we’re looking for an experienced Data Engineer who loves turning complex data into clear insights that actually get used to drive real business impact. You … teams across the business move faster and make smarter decisions. In our (completely non-biased) opinion, this is a great position; they have a global presence but from a data engineering perspective, there is so much that can be done. It’s certainly not a role where you will be bored and wondering what to do next. Therefore … we need someone who naturally takes ownership of: Designing and building scalable data solutions and BI platforms Automating APIs and workflows for real-time data services as well Advancing their CI/CD and DevOps maturity Ensuring platform reliability, speed and security Skills & Experience Required: Strong hands-on experience with SQL, Python, dbt, Snowflake, SSIS, AWS, and Azure More ❯

Data Scientist – B2B SaaS (Price Optimisation for Retail Banks) A fast-growing, profitable B2B SaaS company is looking for an ambitious Data Scientist to help advance its price optimisation platform used by major retail banks. Their software guides mortgage and savings pricing decisions, delivering millions in additional revenue for clients. With a strong UK & Ireland client base and … company is bootstrapped (no VC or angel investment) and is already very profitable. The Role You’ll play a key part in improving and building machine learning models and data pipelines that power the platform. This is a hands-on, proactive role focused on continuous improvement across modelling, automation, and client-facing insights. You will work on: Enhancing ML … pipelines: validation, classification, clustering, predictive models, neural networks, optimisation. Automating and streamlining data refresh processes. Producing client presentations and providing pricing insights. R&D on new modelling and optimisation approaches. Supporting business development and pitch materials. What You’ll Bring Degree in a STEM field (Maths, CS, Engineering). Experience in data science or consulting. Strong Python More ❯

Senior Data Engineer - AWS - London - £70,000 - £85,000 To be considered for this role, you must be SC cleared or eligible to obtain SC clearance. My client are seeking a Senior AWS Data Engineer to join an agile engineering team with the focus of delivering cloud-based data solutions for clients in the financial services … days in London office) 25 days annual leave plus bank holidays Performance-related bonus Private medical care And many more Role and Responsibilities Develop and maintain AWS-based data pipelines using Python, PySpark, Spark SQL, AWS Glue, Step Functions, Lambda, EMR, and Redshift. Design, implement, and optimise data architecture for scalability, performance, and security. Work closely with business … technical stakeholders to understand requirements and translate them into robust solutions. Apply best practices for cloud security, governance, and cost management. Implement and maintain CI/CD pipelines for data engineering workflows within AWS. Document and maintain architecture, pipelines, and best practices for long-term maintainability. Contribute to planning, progress reporting, and delivery of project milestones. Engage in More ❯

Senior Data Engineer - AWS - London - £70,000 - £85,000 To be considered for this role, you must be SC cleared or eligible to obtain SC clearance. My client are seeking a Senior AWS Data Engineer to join an agile engineering team with the focus of delivering cloud-based data solutions for clients in the financial services … days in London office) 25 days annual leave plus bank holidays Performance-related bonus Private medical care And many more Role and Responsibilities Develop and maintain AWS-based data pipelines using Python, PySpark, Spark SQL, AWS Glue, Step Functions, Lambda, EMR, and Redshift. Design, implement, and optimise data architecture for scalability, performance, and security. Work closely with business … technical stakeholders to understand requirements and translate them into robust solutions. Apply best practices for cloud security, governance, and cost management. Implement and maintain CI/CD pipelines for data engineering workflows within AWS. Document and maintain architecture, pipelines, and best practices for long-term maintainability. Contribute to planning, progress reporting, and delivery of project milestones. Engage in More ❯

Data Engineer - Fabric £450/day outside IR35 6-month contract London-based - hybrid working Working with a FTSE 250 organisation who are looking for a Fabric Data/BI Engineer to help create and drive analytics solutions. BI/Data Engineer, key skills: Microsoft Fabric experience Proven data engineering experience - setting up complex ETL … processes with ADF pipelines Data visualisation and reporting using PowerBI Data modelling experience - conceptual, logical and physical Proficient in SQL Extensive experience with Microsoft cloud stack Data Engineer, BI Engineer, Fabric, ADF Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built, and we welcome More ❯

methodologies. Python Development - Strong proficiency in Python programming including object-oriented design, asynchronous programming, error handling, and writing clean, maintainable code. Experience with key libraries including Pandas, NumPy for data manipulation, requests and APIs for integrations, asyncio for concurrent processing, and building robust automation scripts with proper logging, testing (pytest), and documentation. AI & Machine Learning Frameworks - Deep expertise in … Scikit-learn, and Hugging Face Transformers. Experience building, training, and deploying machine learning models for classification, regression, clustering, and NLP tasks. Understanding of model evaluation metrics, hyperparameter tuning, feature engineering, and MLOps practices for production deployment. Generative AI & LLM Integration - Proficient in working with Large Language Models including OpenAI GPT models, Anthropic Claude, Azure OpenAI, and open-source alternatives … Llama, Mistral). Experience with prompt engineering, fine-tuning, RAG (Retrieval Augmented Generation) architectures, vector databases (Pinecone, ChromaDB, FAISS), embeddings, and building AI-powered automation solutions that leverage natural language understanding. Appian BPA Platform - Strong experience with Appian low-code platform including process modelling, interface design, expression rules, integration objects, and data modelling. Skilled in building end-to More ❯

Job Title: Senior Data Engineer (Contract) Salary Range: £500–£550 per day (Outside IR35) Location/Working model: London | Hybrid (3 days on-site) Join a forward-thinking data environment where innovation meets scale. You’ll take ownership of designing and delivering high-performing data pipelines that enable smarter decisions across the organization. This contract offers autonomy … modern tools, and a platform to make real impact, ideal for a seasoned engineer who enjoys solving end-to-end challenges in the cloud. The Senior Data Engineer (Contract) will architect, build, and maintain robust data solutions within a Google Cloud Platform ecosystem. Role Highlights – Design and deliver scalable ETL and ELT pipelines using SQL and Python – Build … and optimize data architectures in Google Cloud Platform (GCP) – Partner with analysts, product owners, and developers to ensure reliable data delivery – Champion best practices for governance, lineage, and performance – Enhance data observability and automate key workflows for efficiency You Will Need – Advanced hands-on experience with SQL, Python, and core GCP tools (BigQuery, Dataflow, Pub/Sub More ❯