1 to 25 of 72 Data Engineering Jobs in East London

Databricks Architect (Contract) - Greenfield Data Platform Location: Hybrid working (London) Duration: 12-month initial contract Are you a visionary Databricks Architect with a passion for building cutting-edge data platforms from the ground up? Do you thrive on shaping strategy and driving technical excellence in a greenfield environment? Our client is embarking on a pivotal journey to establish … a brand-new, enterprise-grade data platform using the full power of Databricks. This is a unique opportunity to lead the architectural design and implementation of a truly greenfield data ecosystem that will underpin all future data-driven initiatives, from advanced analytics to AI/ML. We are looking for a hands-on architect who can translate … business needs into robust, scalable, and secure Databricks solutions. The Role: As our Databricks Architect, you will be instrumental in defining and delivering our new data strategy and architecture. This is a greenfield project, meaning you'll have the exciting challenge of building the entire Databricks Lakehouse Platform from scratch. You will provide critical technical leadership, guidance, and hands More ❯

Job Title: Principal Data Engineer Location: London, UK – Hybrid (Liverpool Street office) Department: Data & Engineering Reports To: Head of Data Science Employment Type: Permanent A leading global payments and fintech platform , empowering clients to innovate and scale. Their mission is to create frictionless, secure, and intelligent payment solutions that unlock value across banking, financial services, and … digital assets. As they continue to scale their data infrastructure , they’re seeking a seasoned Principal Data Engineer to help design, build, and optimise a modern data platform, with a focus on orchestration (Airflow), scalable data warehouse architecture, and high-performance pipelines. The ideal candidate will bring both technical depth and strategic thinking , with the ability … to communicate effectively across business and technical teams. Key Responsibilities Design and lead the development of scalable, secure, and high-performance data warehouse solutions for BI and analytics. Define and drive the long-term architecture and data strategy in alignment with business goals. Own orchestration of ETL/ELT workflows using Apache Airflow , including scheduling, monitoring, and alerting. More ❯

As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation. The Senior Data Engineer will work closely with the data, Architecture, Business Analyst, Data Stewards to integrate and … align requirements, specifications and constraints of each element of the requirement. They will also need to help identify gaps in resources, technology, or capabilities required, and work with the data engineering team to identify and implement solutions where appropriate. Work type: Contract Length: initial 6 months Work structure: hybrid 2 days a week in London. Primary Responsibilities: Integrate … data from multiple on prem and cloud sources and systems. Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and More ❯

AI, we simulate and predict how garments will perform on real bodies, eliminating poor fit before a single item is made. It’s a shift from subjective guesswork to data-driven decision-making that reduces returns, cuts waste, boosts conversions, and drives loyalty. We’re building the Fit Operating System for the modern fashion supply chain and we're … looking for a talented and experienced Senior Data Engineer to help power this transformation. THE ROLE: As a Senior Data Engineer at Fit Collective, you’ll build the infrastructure that fuels everything from AI-powered predictions to insights delivered directly to our customers. If you love designing clean, scalable pipelines and want to see your work impact both … insights across the fashion supply chain. Over the next 12 months, we’re launching a Shopify app that automatically updates product fit recommendations and descriptions, powered directly by manufacturing data, helping brands reduce returns and improve their bottom line. Our Current Stack: Data Warehouse and Tools: DBT, Snowflake, Airbyte Languages: Python, TypeScript, Node.js , React Cloud & Infra: AWS (S3 More ❯

We are supporting a fast-growing, high-performing investment firm as they expand their lean, agile technology team. This newly created role sits at the intersection of data engineering and business intelligence — offering real ownership, front-to-back exposure, and close interaction with the business. The team is small, collaborative, and strategically embedded within the firm’s data … an opportunity to have impact from day one while helping shape the future of reporting and analytics. Key Responsibilities: Maintain and extend ETL pipelines and support the firm’s data warehouse infrastructure. Work closely with business teams to understand data and reporting needs. Develop and enhance Power BI dashboards and reporting solutions. Assist with modernising and automating legacy … processes. Play a key role in the design, testing, and deployment of new data solutions. Technology Stack: Azure SQL, SSIS, Power BI, PowerShell C# (used for testing automation) Excel/Power Query CI/CD tooling What We’re Looking For: A hands-on data engineer or BI engineer with solid SQL skills and experience in building or More ❯

My client, a leading private capital asset manager, is seeking a talented Data Engineer to join their growing Technology team based in London. As a Data Engineer, you will work at the heart of the firm’s data operations, building robust pipelines, modernising reporting frameworks, and enhancing data automation across business-critical functions. This is a … collaborative, hands-on role interfacing with stakeholders across the business to deliver efficient, scalable data solutions. You’ll join a close-knit and dynamic team with direct exposure to senior leadership and the chance to influence Pollen Street’s data architecture as the firm expands its private credit and equity platforms. Responsibilities Develop and support data pipelines … to ingest, transform and manage data in the data lake and warehouse. Design and deliver insightful MI and BI reports from a variety of sources including SQL databases and Excel. Translate business needs into technical reporting requirements, liaising with users to resolve data queries. Manage and maintain ETL processes and troubleshoot data issues, including log analysis More ❯

Product Owner (Data & Analytics) London Hybrid - 3 days pw onsite £60,000 to £75,000 We currently have an exciting opportunity for a Data Product Owner to join a one-of-a-kind customer centric organisation in the not-for-profit space, whose solutions support customers and their families across the UK. In this role, you’ll drive … the evolution and implementation of data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between business stakeholders, data scientists, analysts … engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. What you'll bring... More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Additionally … you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components More ❯

twentyAI are partnering with a globally renowned law firm currently undergoing a major digital and data transformation. With a deep-rooted legacy in legal excellence and a strong global footprint, the firm is currently modernising their data capability and building a new data platform. About the Role You will be part of a diverse group of engineers … and machine learning experts, working with cutting-edge Azure cloud technologies, including Microsoft Fabric and related services. Your mission is to design reliable, efficient data pipelines that enable the business to access trusted, well-structured data. You will also focus on building and scaling the core data infrastructure that supports advanced analytics and machine learning efforts across the … business. Responsibilities Design and develop end-to-end data pipelines that ingest, transform, and prepare data for analytics and machine learning workflows. Work with Infrastructure as Code, primarily Terraform, to automate and manage cloud infrastructure, enabling repeatable and reliable deployment processes. Collaborate closely with data scientists, MLEs, and business teams in an agile environment to deliver data More ❯

Managing Partners, senior staff, and Oaktree Capital. Find out more about us by visiting our website at: http://www.hartreepartners.com/ROLE OVERVIEW: Hartree Partners is growing its data-driven analytics team and is hiring a Statistical Data Scientist to sharpen our view of weather-driven risk and support wider supply-and-demand modelling for power & gas … trading. You will play a pivotal role in shaping our data strategy and driving the development of our modelling approaches. You will collaborate with cross-functional teams to design, implement, and optimize data pipelines and predictive models that inform trading decisions and enhance operational efficiency. RESPONSIBILITIES: Primary Focus: Probabilistic Weather Modelling: Research and prototype probabilistic methods (Bayesian inference … state-space filtering, change-detection tests, etc.) that flag when fresh weather guidance materially diverges from prior outlooks. Continuous Development and Improvement: Calibrate confidence metrics with historical data and measure their value to trading & risk learning models. Continuously improve these models based on real-time data and feedback from trading activities. Model Communication: Explain uncertainty clearly, turning numbers More ❯

and highly skilled Generative AI Architect to lead the design and implementation of advanced AI solutions tailored for professional services. This role requires expertise in AI-driven decision automation , data-driven insights , and scalable architecture to enhance business processes and client outcomes. As a key member of our team, you will architect solutions that learn, reason, and make intelligent … optimize AI algorithms for predictive analytics, recommendation engines, and automation in professional services. Apply machine learning (ML) and deep learning (DL) techniques to enhance decision-making and business intelligence. Data Engineering & Integration Architect robust data pipelines to support AI model training and inference. Implement automated data collection, integration, cleansing, and transformation techniques to ensure high-quality … data inputs. Collaborate with data engineering teams to align AI solutions with real-world business applications. AI Model Training, Evaluation & Performance Optimization Train AI models using supervised, unsupervised, and reinforcement learning techniques , refining them based on business insights . Define model performance metrics to ensure AI solutions deliver tangible value. Real-Time AI Applications & System Integration Work More ❯

tools for musicians and artists to use to promote their music. At un:hurd music, we've created a music-tech platform that uses proprietary technology to turn music data into stronger promotional campaigns for artists. We've created both mobile and web applications which act as the 'digital marketing companion' for independent artists, facilitating data-led promotional … hire responsible for the software development and technical infrastructure needed to design, train, deploy and scale machine learning models in production environments. You will harness a diverse array of data sources, from streaming services to social media, revolutionizing the way artists promote their music. Our Data Team members are full stack data professionals who independently manage projects … across the complete spectrum, from raw data ingestion to deployment, monitoring, and optimization. While this role emphasizes data engineering and ML deployment, you will have the responsibility of managing projects with autonomy across the full data lifecycle. Responsibilities As an ML Engineer at Un:hurd music, you'll be: MLOps and Model Deployment : Own the deployment More ❯

About Apexon: Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation is built on a comprehensive suite of engineering services, a dedication … Goldman Sachs Asset Management and Everstone Capital, Apexon now has a global presence. About the Role We are seeking a highly motivated and experienced AI Engineer to join our Data and AI team . This role is ideal for someone who has a strong track record of designing, developing, and deploying AI/ML solutions in a business context … management channels for our Financial Services client. Key Responsibilities End-to-End AI Solution Delivery: Lead AI/ML initiatives from conceptual design to production deployment, including problem scoping, data acquisition, model development, validation, deployment, and monitoring. AI-Driven Marketing Insights: Develop predictive and generative models to support audience segmentation, personalization, channel optimization, lead scoring, and campaign measurement. Collaborative More ❯

We're looking for a skilled Cloud Engineer with experience in Cloud technologies to collaborate with our Data Platforms Engineering team, on advancing our Enterprise Data Lakehouse platform. If you're passionate about developing scalable data solutions and automating infrastructure, this role is for you. At Nationwide we offer hybrid working wherever possible. More rewarding relationships … close the advert earlier than the advertised date, so please apply as soon as you can. What you’ll be doing In this role, you'll work in the Data Platforms Engineering team, utilising cutting-edge Cloud technology within Microsoft Azure to enhance our Enterprise Data Lakehouse platform. Using tools such as Databricks, Python, and Terraform , you … ll design and develop key platform functionality and data analytics solutions. Expect a hands-on experience where you'll contribute significantly to our daily operations, making a tangible impact with your expertise. In this position, you'll be at the forefront of ensuring the efficiency and accuracy of our data platforms and processes. Your responsibilities will encompass building More ❯

Job Title: Data Engineer (with AI Engineering Experience) Location: Hybrid (UK-based) Outside IR35 Contract role - 6 months rolling Industry: Energy/Wholesale Markets & Trading We’re looking for a skilled Data Engineer with Artificial Intelligence (AI) experience to join a cutting-edge team within one of the UK’s leading energy companies. This role sits within … the organisation’s Wholesale Market Services and Trading division, a key area focused on enabling smarter, data-driven decision-making in fast-paced energy markets. You’ll play a pivotal role in designing and delivering complex, cloud-native data solutions that support trading operations, risk management, market forecasting, and AI-led optimisation initiatives. Key Responsibilities Design, build, and … maintain robust data pipelines and cloud-based infrastructure to support large-scale data processing and analytics workloads. Collaborate with data scientists and AI engineers to productionise machine learning models and support intelligent automation solutions. Contribute to the development and enhancement of the enterprise data platform with scalable, high-quality data assets. Champion data engineering More ❯

We're Hiring: AWS Data Engineer Location: London (2-3 days in office) Experience : 2+ Years Degree: STEM/Business Rate: £225 to 245 a day Umbrella Duration : 6 months contract We're looking for a Data Engineer to help power our innovation engine. You’ll design data models, build scalable ETL pipelines, codify business logic, and … drive data integration across complex systems—structured and unstructured alike. This is your chance to turn raw data into real business value using cutting-edge tech in a collaborative, forward-thinking team. What You’ll Do: Design & implement data models and scalable ETL/ELT pipelines Map data sources, codify business logic, and build data flows Develop data quality solutions & explore new technologies Collaborate with analysts, developers, and business stakeholders What You Bring: 2+ years in data engineering or related roles Bachelor’s in CS, Engineering, Mathematics, Finance, etc. Proficiency in Python, SQL , and one or more: R, Java, Scala Experience with relational/NoSQL databases (e.g., PostgreSQL, MongoDB) Familiarity More ❯

For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer requirements Previous experience with the preparation of high-quality engaging customer presentations … offer solution team, solution definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure and GCP), Cloudera, No-sql databases (Cassandra, Mongo DB), ELK … Kafka, Snowflake, etc. Past experience in Data Engineering and data quality tools (Informatica, Talend, etc.) Previous involvement in working in a Multilanguage and multicultural environment Proactive, tech passionate and highly motivated Desirable requirements: Experience in Data analysis and visualization solutions: Microstrategy, Qlik, PowerBI, Tableau, Looker,... Background in Data Governance and Data Catalog solutions More ❯

My client, a leading multi-strategy hedge fund, is seeking a mid-level Data Engineer to join their dynamic and rapidly growing team based in London. This is an exciting opportunity to join a high-performing investment firm that places technology and innovation at the core of its operations. You’ll play a key role in empowering the front … office investment team through the delivery of data solutions - enabling informed decision-making across the board. The successful individual will take ownership of MI & BI reporting and data analysis, partnering closely with front-office teams. Your work will support business-critical initiatives through the design, maintenance, and enhancement of ETL pipelines, while also contributing to the development of … automation solutions to streamline key workflows. You’ll also be responsible for: Migrating and enhancing business reports using Power BI Managing data ingestion into the firm’s data lake and data warehouse Troubleshooting data issues, performing log analysis, and owning resolution processes Supporting both manual and automated testing for new data solutions Engaging directly with More ❯

Lead Data Engineer | Location: London (Hybrid - 1-2 day a month in office) | Salary: £90,000-£110,000 | London Market Insurance The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Lead Data Engineer with Insurance experience to play … a key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the data strategy, improve … data quality, and empower the business to make data-driven decisions. As a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built to scale, incorporating the latest advancements in data More ❯

MIGRATION DATA ANALYST LONDON LIVERPOO ST – HYBRID CONTRACT TO 28/02/2026 INSIDE IR35 Purpose of Job The Data Office is looking to support all areas of the bank in making better use of data. This role is to be a Data Migration - Data Analyst who can support migrations within multiple programmes or projects … both large and small as part of the Bank’s Transformation. Working through a full lifecycle of Discovery, Definition, Design, Development, Deployment, and optimization. The Data Analyst role will contribute and establish the bank’s Data Migration framework to support multiple requests for movement and transfer of data between systems. Being part of a growing team, this … opportunity allows the Data Analyst to contribute to the change on defining the migration strategy and framework, developing new core opportunities and using new tools which ultimately ensure the execution of effective migrations The candidate must be willing to roll up their sleeves and engage in detail, as well as understand core technology and data design concepts with More ❯

Role: Cloud Data Architect Location: London, UK Duration: Contract Job Description: Key Responsibilities Provide technical leadership and strategic direction for enterprise-scale data migration and modernization initiatives. Architect end-to-end data platforms using Dataproc, Dataflow, Pub/Sub, BigQuery, Cloud Spanner, and Bigtable. Define and implement real-time and batch processing pipelines for complex use cases … involving streaming analytics, ML feature engineering, and automation. Act as a trusted advisor to senior technical and business stakeholders across industries (e.g., telecom, retail, financial services). Drive data quality, governance, lineage, and security standards across enterprise data pipelines. Mentor engineering teams and lead best practice adoption across data architecture, orchestration, and DevOps tooling. Participate … in technical workshops, executive briefings, and architecture reviews to evangelize GCP data capabilities. Required Qualifications Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related technical field. 12+ years of experience in data architecture and data engineering with proven skills and leadership in large-scale cloud data programs. 5+ years More ❯

A global, privately-owned media group with brands spanning across publishing, audio, and out-of-home advertising, is seeking an Analytics Engineer to join their growing data team. As the business matures its data capabilities, they are evolving toward a clearer separation between Data Engineering, Analytics Engineering, and Data Product disciplines. This role will … sit firmly in the Analytics Engineering function, focused on modelling and building the semantic layer that powers consistent, reliable insights across the company’s BI and data science platforms. This role will focus on the “middle layer", designing dimensional models, building reusable dbt pipelines, and ensuring the semantic layer meets the needs of Power BI, Looker, and data science teams. There’s also the opportunity to stretch into data product work, partnering with stakeholders to understand and translate business requirements into robust data models. Key Responsibilities: Build and maintain well-structured, scalable data models using dbt and Kimball/Medallion architecture. Develop and own the semantic layer, shifting calculations and business logic out of More ❯

complex business problems using creative solutions, then we wish to talk with you. As a Lead Architect (Azure), you will work in the Technology team that helps deliver our Data Engineering offerings at large scale to our Fortune clients worldwide. The role is responsible for innovating, building and maintaining technology services. Responsibilities: Be an integral part of large … client business development and delivery engagements. Develop the software and systems needed for end-to-end execution on large projects. Work across all phases of SDLC, and use Software Engineering principles to build scaled solutions. Build the knowledge base required to deliver increasingly complex technology projects. Qualifications & Experience: A bachelor’s degree in Computer Science or related field with … more than 8 years of technology experience Strong experience in System Integration, Application Development or Data-Warehouse projects, across technologies used in the enterprise space. Software development experience using: Object-oriented languages (e.g., Python, PySpark,) and frameworks Stakeholder Management Expertise in relational and dimensional modelling, including big data technologies. Exposure across all the SDLC process, including testing and More ❯

Senior Data Engineer - London - Hybrid - £85,000 - £100,000 My client are a leader in the insurance industry, and are continuing to expand their data engineering practice this year. They are now on the look out for an experienced Senior Data Engineer to join the team, bringing technical expertise in Snowflake, AWS, DBT, and Terraform. Salary … Leave + Bank Holidays Free Company Shares Private medical care And many more Role and Responsibilities: Be responsible for building and deploying full solutions from scratch Maintaining security and data best practices Duties will include product-based work as well as migration tasks Due to your seniority you will also be tasked with mentoring junior engineers Work extensively and … proficiently with Snowflake, AWS, DBT, Terraform, Airflow, SQL, and Python. Requirements: 3+ Years data engineering experience Snowflake experience Proficiency across an AWS tech stack DBT expertise Terraform experience Expert SQL and Python Data Modelling Data Vault Apache Airflow My client have very limited interview slots and they are looking to fill this vacancy ASAP. I have More ❯

Lead Data Scientist - Optimisation Location: Hybrid (1 day a week in Reading or Central London) Salary: £80,000-£110,000+ £6K Car Allowance + 10% Bonus + Excellent Benefits We’re recruiting on behalf of one of the UK’s largest and most influential automotive groups for a Lead Data Scientist . This is an outstanding opportunity for … an experienced data scientist and people leader to shape operational strategy using cutting-edge optimisation techniques across a high-impact, data-rich organisation. With a remit covering everything from vehicle logistics to refurbishment optimisation , this role is perfect for someone who’s passionate about delivering measurable business value through advanced modelling and hands-on leadership. The Role As … Lead Data Scientist for the Operations team , you will lead a growing group of data scientists focused on solving real-world operational challenges. Your team will design and deploy advanced models, applying advanced mathematical optimisation techniques (e.g., Linear Programming , Scheduling , Graph Theory ) to complex business problems, with the goal of improving supply chain efficiency, optimise vehicle movement, and More ❯