1 to 25 of 59 Data Engineer Jobs in East London

As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation. The Senior Data Engineer will work closely with the data, Architecture, Business Analyst, Data Stewards to … align requirements, specifications and constraints of each element of the requirement. They will also need to help identify gaps in resources, technology, or capabilities required, and work with the data engineering team to identify and implement solutions where appropriate. Work type: Contract Length: initial 6 months Work structure: hybrid 2 days a week in London. Primary Responsibilities: Integrate data from multiple on prem and cloud sources and systems. Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare More ❯

Job Title: Principal Data Engineer Location: London, UK – Hybrid (Liverpool Street office) Department: Data & Engineering Reports To: Head of Data Science Employment Type: Permanent A leading global payments and fintech platform , empowering clients to innovate and scale. Their mission is to create frictionless, secure, and intelligent payment solutions that unlock value across banking, financial services, and … digital assets. As they continue to scale their data infrastructure , they’re seeking a seasoned Principal Data Engineer to help design, build, and optimise a modern data platform, with a focus on orchestration (Airflow), scalable data warehouse architecture, and high-performance pipelines. The ideal candidate will bring both technical depth and strategic thinking , with the … ability to communicate effectively across business and technical teams. Key Responsibilities Design and lead the development of scalable, secure, and high-performance data warehouse solutions for BI and analytics. Define and drive the long-term architecture and data strategy in alignment with business goals. Own orchestration of ETL/ELT workflows using Apache Airflow , including scheduling, monitoring, and More ❯

AI, we simulate and predict how garments will perform on real bodies, eliminating poor fit before a single item is made. It’s a shift from subjective guesswork to data-driven decision-making that reduces returns, cuts waste, boosts conversions, and drives loyalty. We’re building the Fit Operating System for the modern fashion supply chain and we're … looking for a talented and experienced Senior Data Engineer to help power this transformation. THE ROLE: As a Senior Data Engineer at Fit Collective, you’ll build the infrastructure that fuels everything from AI-powered predictions to insights delivered directly to our customers. If you love designing clean, scalable pipelines and want to see your work … insights across the fashion supply chain. Over the next 12 months, we’re launching a Shopify app that automatically updates product fit recommendations and descriptions, powered directly by manufacturing data, helping brands reduce returns and improve their bottom line. Our Current Stack: Data Warehouse and Tools: DBT, Snowflake, Airbyte Languages: Python, TypeScript, Node.js , React Cloud & Infra: AWS (S3 More ❯

My client, a leading private capital asset manager, is seeking a talented Data Engineer to join their growing Technology team based in London. As a Data Engineer, you will work at the heart of the firm’s data operations, building robust pipelines, modernising reporting frameworks, and enhancing data automation across business-critical functions. This … is a collaborative, hands-on role interfacing with stakeholders across the business to deliver efficient, scalable data solutions. You’ll join a close-knit and dynamic team with direct exposure to senior leadership and the chance to influence Pollen Street’s data architecture as the firm expands its private credit and equity platforms. Responsibilities Develop and support data pipelines to ingest, transform and manage data in the data lake and warehouse. Design and deliver insightful MI and BI reports from a variety of sources including SQL databases and Excel. Translate business needs into technical reporting requirements, liaising with users to resolve data queries. Manage and maintain ETL processes and troubleshoot data issues, including More ❯

We are supporting a fast-growing, high-performing investment firm as they expand their lean, agile technology team. This newly created role sits at the intersection of data engineering and business intelligence — offering real ownership, front-to-back exposure, and close interaction with the business. The team is small, collaborative, and strategically embedded within the firm’s data … an opportunity to have impact from day one while helping shape the future of reporting and analytics. Key Responsibilities: Maintain and extend ETL pipelines and support the firm’s data warehouse infrastructure. Work closely with business teams to understand data and reporting needs. Develop and enhance Power BI dashboards and reporting solutions. Assist with modernising and automating legacy … processes. Play a key role in the design, testing, and deployment of new data solutions. Technology Stack: Azure SQL, SSIS, Power BI, PowerShell C# (used for testing automation) Excel/Power Query CI/CD tooling What We’re Looking For: A hands-on data engineer or BI engineer with solid SQL skills and experience in More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. … Additionally you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable More ❯

We're Hiring: AWS Data Engineer Location: London (2-3 days in office) Experience : 2+ Years Degree: STEM/Business Rate: £225 to 245 a day Umbrella Duration : 6 months contract We're looking for a Data Engineer to help power our innovation engine. You’ll design data models, build scalable ETL pipelines, codify business … logic, and drive data integration across complex systems—structured and unstructured alike. This is your chance to turn raw data into real business value using cutting-edge tech in a collaborative, forward-thinking team. What You’ll Do: Design & implement data models and scalable ETL/ELT pipelines Map data sources, codify business logic, and build … data flows Develop data quality solutions & explore new technologies Collaborate with analysts, developers, and business stakeholders What You Bring: 2+ years in data engineering or related roles Bachelor’s in CS, Engineering, Mathematics, Finance, etc. Proficiency in Python, SQL , and one or more: R, Java, Scala Experience with relational/NoSQL databases (e.g., PostgreSQL, MongoDB) Familiarity with More ❯

Senior Data Engineer/Data Analytics Engineer - Full Remote Working from anywhere in the UK SQL+Python+ETL+ Apache Airflow Our client is a global leading and fast growing high tech company: -Over 6,500 employees across 20+ offices; -300 Million+ active users on some of the platforms they developed; -Cutting edge AR and VR technologies, 3D printing … etc. They are looking for a senior Data Engineer to join their FinTech team! You will develop scalable data pipelines, ensure data quality, and support business decision-making with high-quality datasets. -Work across technology stack: SQL, Python, ETL, Big Query, Spark, Hadoop, Git, Apache Airflow, Data Architecture, Data Warehousing -Design and develop scalable … ETL pipelines to automate data processes and optimize delivery -Implement and manage data warehousing solutions, ensuring data integrity through rigorous testing and validation -Lead, plan and execute workflow migration and data orchestration using Apache Airflow -Focus on data engineering and data analytics Requirements: -5+ years of experience in SQL -5+ years of More ❯

Senior Data Engineer - Hedge Fund - London Company Overview A leading London-based systematic hedge fund managing over $8 billion in client assets. Technology is core to its operations, with a strong focus on data-driven strategies. The team is currently overhauling its data infrastructure to better support quant research and trading. Role Overview Join a lean … high-impact Data Engineering team responsible for the ingestion, transformation, and delivery of diverse datasets—from tick and time series to reference and alternative data. You’ll build modern, scalable data pipelines and platforms, support the strategic tech stack, and collaborate closely with quants and portfolio managers. This is a hands-on role with full ownership across the … development lifecycle. Qualifications 5+ years in data engineering Strong Python and data wrangling libraries Expert SQL skills and solid RDBMS understanding Experience with cloud-based data solutions (e.g. serverless ETL, data warehouses) Familiarity with Git, Docker, CI/CD pipelines, testing and monitoring Clear communicator, comfortable with cross-functional teams Desirable Experience APIs from major financial More ❯

Senior Data Engineer - London - Hybrid - £85,000 - £100,000 My client are a leader in the insurance industry, and are continuing to expand their data engineering practice this year. They are now on the look out for an experienced Senior Data Engineer to join the team, bringing technical expertise in Snowflake, AWS, DBT, and Terraform. … Leave + Bank Holidays Free Company Shares Private medical care And many more Role and Responsibilities: Be responsible for building and deploying full solutions from scratch Maintaining security and data best practices Duties will include product-based work as well as migration tasks Due to your seniority you will also be tasked with mentoring junior engineers Work extensively and … proficiently with Snowflake, AWS, DBT, Terraform, Airflow, SQL, and Python. Requirements: 3+ Years data engineering experience Snowflake experience Proficiency across an AWS tech stack DBT expertise Terraform experience Expert SQL and Python Data Modelling Data Vault Apache Airflow My client have very limited interview slots and they are looking to fill this vacancy ASAP. I have limited More ❯

My client, a leading multi-strategy hedge fund, is seeking a mid-level Data Engineer to join their dynamic and rapidly growing team based in London. This is an exciting opportunity to join a high-performing investment firm that places technology and innovation at the core of its operations. You’ll play a key role in empowering the … front-office investment team through the delivery of data solutions - enabling informed decision-making across the board. The successful individual will take ownership of MI & BI reporting and data analysis, partnering closely with front-office teams. Your work will support business-critical initiatives through the design, maintenance, and enhancement of ETL pipelines, while also contributing to the development … of automation solutions to streamline key workflows. You’ll also be responsible for: Migrating and enhancing business reports using Power BI Managing data ingestion into the firm’s data lake and data warehouse Troubleshooting data issues, performing log analysis, and owning resolution processes Supporting both manual and automated testing for new data solutions Engaging directly More ❯

London/Hybrid | £750/day | 12-Month Rolling | ✅ Outside IR35 Our client, a leading Investment Management firm, is looking for a contract Data Engineer with strong Python and Databricks skills to help drive their data platform modernisation. You’ll be working on business-critical data pipelines and analytics infrastructure, supporting both investment and operations teams. … This is a hands-on role in a fast-moving environment, ideal for someone who thrives in financial services. What you’ll be doing: Building scalable data pipelines in Python and Databricks Designing data models to support analytics, reporting & regulatory needs Working with cloud-based data platforms (Azure preferred) Partnering closely with data analysts, quants, and … tech teams Tech you’ll be using: Python (strong hands-on coding essential) Databricks/Spark Azure Data Lake/Delta Lake SQL/ETL frameworks CI/CD tools and version control (Git, Azure DevOps) What we’re looking for: Strong commercial experience as a Data Engineer Deep Python and Spark/Databricks expertise Financial services More ❯

Lead Data Engineer | Location: London (Hybrid - 1-2 day a month in office) | Salary: £90,000-£110,000 | London Market Insurance The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Lead Data Engineer with Insurance experience … to play a key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the data strategy, improve data quality, and empower the business to make data-driven decisions. As a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built to scale, incorporating the More ❯

Data Engineer - Python, SQL, DBT, DWH, Airflow, Kafka, Snowflake - Challenger Digital Bank Location: London (Hybrid, 2 days per week in office) Type: Permanent Salary: Competitive + 20% bonus + excellent benefits Are you a Data Engineer ready to shape the future of a digital-first banking experience? Join a fast-growing start-up challenger bank where … data is at the core of every decision. You’ll play a key role in building the bank’s next-generation data infrastructure and enable insight-led growth from the ground up. What you will be doing: Build and optimise robust data pipelines using Python , Kafka , Airflow , and DBT Design and manage Snowflake data warehouse objects … to support scalable analytics Write clean and efficient SQL to support reporting, dashboards and data products Collaborate across engineering, analytics and product teams to enable data-driven decisions Drive data quality, performance and governance through best practice and documentation Support A/B testing, automation, and analytics innovation projects What we are looking for: Strong hands-on More ❯

We're on the hunt for a Senior Data Engineer/Database Specialist to join our growing team at Reward, where data isn’t just a by-product — it’s at the heart of everything we do. As we scale our loyalty platform across global markets, our data infrastructure needs to be smarter, faster, and more … impactful than ever before. That’s where you come in. What you’ll be doing: Leading the design and migration of ETL pipelines and data warehouses into cloud environments (AWS) Working with technical and non-technical stakeholders to scope and build insightful reporting and data solutions Creating robust QA processes and automating repetitive data tasks Supporting and … mentoring junior analysts (1 direct report) Acting as a go-to for clean, optimised, efficient SQL Supporting second-line data queries and ensuring SLAs are met Continuously improving how we handle, transform and deliver data across the business What you bring: 5+ years of hands-on experience with relational databases (500,000+ customers) Strong SQL (including performance tuning More ❯

twentyAI are partnering with a globally renowned law firm currently undergoing a major digital and data transformation. With a deep-rooted legacy in legal excellence and a strong global footprint, the firm is currently modernising their data capability and building a new data platform. About the Role You will be part of a diverse group of engineers … and machine learning experts, working with cutting-edge Azure cloud technologies, including Microsoft Fabric and related services. Your mission is to design reliable, efficient data pipelines that enable the business to access trusted, well-structured data. You will also focus on building and scaling the core data infrastructure that supports advanced analytics and machine learning efforts across the … business. Responsibilities Design and develop end-to-end data pipelines that ingest, transform, and prepare data for analytics and machine learning workflows. Work with Infrastructure as Code, primarily Terraform, to automate and manage cloud infrastructure, enabling repeatable and reliable deployment processes. Collaborate closely with data scientists, MLEs, and business teams in an agile environment to deliver data More ❯

Data Engineer Location: London (4 days/week on-site) Type: Contract (Outside IR35) Duration: 6 months A leading physical commodities trading firm is seeking a Data Engineer for a 6-month contract (Outside IR35). You’ll work on-site in London 4 days per week, building and optimizing data pipelines in a fast … paced, data-driven trading environment. Responsibilities: Build and maintain scalable data pipelines (ETL/ELT) Support data users with ingestion, debugging, and navigation Integrate data from diverse sources (structured & unstructured) Monitor and ensure data quality Maintain and improve existing production processes Develop dashboards and visualizations Work closely with data scientists and stakeholders Follow CI …/CD and code best practices (Git, testing, reviews) Tech Stack & Experience: Strong Python (Pandas), PySpark, and SQL skills Cloud data tools (Azure Data Factory, Synapse, Databricks, etc.) Data integration experience across formats and platforms Strong communication and data literacy Nice to Have: Commodities/trading background Experience with data lakes and open-source data More ❯

Senior Data Engineer London/Hybrid 2 days per week Permanent Salary: Up to £90,000 We have partnered with a leading investment firm who are seeking a Senior Data Engineer. They have garnered a strong reputation in delivering solutions across the full investment life cycle. They are looking for a skilled and hands-on Senior Data Engineer to design and build scalable data pipelines to support evolving business and technology needs. This is a key role and will contribute significantly to the company's vision of becoming a data-centric organisation. The ideal candidate will have demonstrable experience with the modern Azure tech stack and a deep understanding of ingesting and transforming … data from diverse internal and external sources. Key Responsibilities: Design and implement robust data solutions to support a modern cloud-native data warehouse. Provide technical leadership and identify effective solutions for complex data-related challenges. Perform and participate in peer reviews of design, code, and tests, ensuring high-quality development standards. Promote clean, efficient, and maintainable More ❯

Senior Databricks Data Engineer | Energy Trading - Contract My client is an Energy Trading Client based in the UK who are looking to appoint a Senior Databricks Data Engineer to help modernise their data infrastructure and deliver end-to-end solutions that drive business value. This is a high-impact role working across data strategy … architecture, and engineering to deliver cloud-first solutions within a global trading environment. Role: Key Responsibilities: Design and build data foundations and scalable solutions to support the business in becoming data-driven. Champion and implement Data Foundation initiatives in line with strategic programmes. Translate vision and data strategy into practical, high-value engineering solutions. Serve as … a subject matter expert, mentoring junior engineers and collaborating with business and technical stakeholders. Coordinate incident, problem, and change management processes. Present data-driven insights and architectural decisions to senior stakeholders. Drive efficiency across data projects to improve speed, reduce cost, and maximize value. Contribute to internal communities of excellence and practice (CoE, CoP). Skills Needed: Experience More ❯

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work culture focused on innovation … making it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. Integrate … data management technologies and software tools into existing structures. Create data tools to support sport data modelling, prediction and analytics. Work with data and analytics experts to strive for greater functionality in our data systems. As the selected Data Engineer, your background will include: 3+ years industry experience in a Data Engineer More ❯

Are you a Data Engineer who is looking for a more purposeful career? Feel like your current role, limits you to what you can achieve and that there isn’t any more room to grow? If the answer is yes, I could have just the role for you. Recruit with Purpose are supporting one the UK’s largest … and leading housing associations to help them find a Data Engineer to join their growing team. This organisation is at the forefront for how housing associations modernise and utilise their data. Constantly evolving and leading the way within the sector. This is a fantastic opportunity for a senior/lead data engineer to come in and … put their stamp on how this organisation utilises its data. In this role, you’ll be at the heart of designing, building, and maintaining trusted, reusable data products that create better decision-making and deeper insights across the organisation. You'll help bring their data strategy to life, opening up access, enhancing quality, strengthening governance, and guiding teams More ❯

Principal Data Engineer – AWS Location : London (Hybrid) Salary : £105,000 Job Type : Permanent A top-tier digital consultancy is making a key strategic hire at the Associate Director level for a hands-on, stakeholder-savvy Principal Data Engineer. You will take the helm of public and private sector data transformation programmes, drive technical delivery, and help … shape a growing practice at scale. This is a greenfield opportunity for a high-impact leader with deep AWS expertise and a consulting mindset as an experienced Principal Data Engineer. Key Responsibilities • Lead and deliver enterprise-grade data engineering solutions using core AWS services (S3, Glue, Lambda, Redshift, Matillion, etc.). • Define architecture, mentor large technical teams, and … engage directly with senior client stakeholders. • Own technical responses for RFI/RFP processes, partnering with senior leadership and business development. • Develop scalable data pipelines and analytics solutions in compliance with UK Government standards. • Act as a hands-on engineering lead while contributing to practice development and thought leadership. • Work closely with delivery and consulting leadership (including Head of More ❯

Key Responsibilities Design and implement real-time data pipelines using tools like Apache Kafka, Apache Flink, or Spark Streaming. Develop and maintain event schemas using Avro, Protobuf, or JSON Schema. Collaborate with backend teams to integrate event-driven microservices. Ensure data quality, lineage, and observability across streaming systems. Optimize performance and scalability of streaming applications. Implement CI/… CD pipelines for data infrastructure. Monitor and troubleshoot production data flows and streaming jobs. Required Skills & Qualifications 3+ years of experience in data engineering or backend development. Strong programming skills in Python, Java, or Scala. Hands-on experience with Kafka, Kinesis, or similar messaging systems. Familiarity with stream processing frameworks like Flink, Kafka Streams, or Spark Structured … Streaming. Solid understanding of event-driven design patterns (e.g., event sourcing, CQRS). Experience with cloud platforms (AWS, GCP, or Azure) and infrastructure-as-code tools. Knowledge of data modeling, schema evolution, and serialization formats More ❯

About the Role: In this role, you will play a key part in supporting client’s High Touch Support operations—designing and maintaining scalable data pipelines and creating solutions that drive customer satisfaction and informed business decisions. This is a hands-on role with a strong focus on metric development , data visualization , and data pipeline optimization . … You’ll work cross-functionally with Engineers, Data Scientists, and Product Managers to ensure the right data is captured, modeled, and surfaced to support ongoing initiatives. Key Responsibilities: Build and maintain scalable data pipelines and architecture Develop success metrics and dashboards to measure and drive team performance. Collaborate with stakeholders (PMs, DS, Eng) to define data needs and translate them into actionable insights Support knowledge management efforts—identifying performance gaps in support tools like search and agent experience Handle ad hoc data requests including bug fixes, data pulls, and issue investigations Leverage BI and integration tools like Azure Data Factory for robust data solutions Qualifications: 5+ years of experience with SQL More ❯

Data Engineer Opportunity for a Data Engineer to join an organisation operating in the Consumer Goods space who’re on an exciting growth journey Salary up to £50,000 + some fantastic benefits including remote working, bonus opportunity, wellness days, employee assistance programmes and much more Apply online or contact Chelsea Hackett via Chelsea.hackett@searchability.com WHO … WE ARE: We collaborate with companies in the consumer goods sector to strengthen their data capabilities, unlock growth opportunities, and generate actionable insights. Our specialised technology platform is built to serve the unique needs of Consumer Goods teams, offering both flexibility and scalability. By working closely with our clients, we support them in reaching their objectives across Retail, Foodservice … Company social events Mental wellbeing and support Pension Contribution Life Insurance Flexible/remote working And more... WHAT WILL YOU BE DOING? We are looking for a self-driven Data Engineer with strong expertise in data modeling, ETL processes, and cloud-based data solutions, with a particular focus on advanced SQL for data transformation and More ❯