76 to 100 of 227 Data Engineer Jobs in London

Senior Data Engineer £75,000 to £90,000 Flexible working - Ideally 2 day a month London My Client is a market leader in the retail and e-commerce space who invest in innovation, delivering unparalleled shopping experiences to millions of customers in several formats. They are looking for … a experienced Senior Data Engineer to join their growing team and help drive their scalable Data management systems. You should come with a proven track record in managing large-scale data infrastructures and pipelines that support sophisticated analytics. The ideal candidate will be responsible for designing … building, and maintaining robust data solutions that drive strategic decision-making across multiple business units. This role is for someone who principally still loves to code, but who also feels comfortable engaging with stakeholders and mentoring others. Key Responsibilities: Design and implement scalable data architectures using modern cloud more »

Title: Data Engineer, 40 hours per week, fixed-term contract – DE001. Location: White City, London, UK. Compensation: £45-65,000 plus health insurance and free lunch! Posted date: Monday 6 th , 2024. Closing date: June 7 th , 2024. Start date: July 1 st , 2024, or before. Company: Esox … platform harnesses metagenomics to resolve this biological dark-matter and improve pathogen detection and prevention efforts for global aquaculture. Role: We are hiring a Data Engineer to join our Detect team. Our Detect platform enables clients to identify total microbiomes sampled from livestock and the environment surrounding their … farms. This data is pivotal in advancing our understanding and management of aquatic ecosystems. Our metagenomics pipelines produce significant quantities of DNA data and accompanying sample metadata. You’ll play a central role in supporting the growth of our company by designing and building the infrastructure necessary to more »

Data Engineer - London - £75,000 I am working with a hugely successful, global organisation who are looking to add a Data Engineer to their growing London based data team. This organisation have recently implemented a brand new data platform encompassing the full Microsoft Azure … Stack including leveraging Databricks in order to deliver on its goal of becoming truly data driven. In this role you will be responsible for the BI and data engineering lifecycle across the business supporting the global data needs of various business functions. This role is a split … between data engineering and data analytics and you will take a prominent role on a number of exciting projects. You will be joining a business that values its people at the centre of everything they do. They are looking to expand their close-knit data team where more »

Founding Data Engineer Role update - this role is now contract only. And really a mix of data science and engineering... Central London 3 days a week, hybrid NB – we are looking for someone with specific experience around fintech, finance, banking, eCommerce transactions, insurance, payments, fraud, consumer scams … they have validated some of the big problems to solve. The mission is big. They have a new approach tested with retail banks. The data engineer will be key to bringing some of the solutions and the early stage product to life. The role > We’re looking for … someone that really fancies building a data platform from scratch alongside some very solid technical founders > Designing, building, and maintaining scalable data pipelines. > Collaborating with various teams to understand data requirements and implement solutions. > Optimizing data workflows and processes to enhance data quality, reliability, and more »

Senior Data Engineer Financial Services London (Hybrid) £90K plus bonuses and benefits Harrington Starr has partnered with leading data and analytics firm on the forefront of capital markets innovation as they seek to hire an experienced Data Engineer. Our client extends its services to global exchange … groups, banks, brokers, asset managers, and hedge funds. They are seeking to hire a dynamic and highly motivated data engineer for its London team. This individual should have an entrepreneurial mindset and the adaptability to thrive in an extremely fast paced environment. Within this role, you will be … responsible for building data pipelines for a cloud-based warehouse using Azure and Snowflake, enhancing data capabilities for analytics and science. What you need: 3+ years of hands-on experience as a Data Engineer, building ETL pipelines and managing data lifecycle. Strong Python coding experience. more »

LEAD DATA ENGINEER London x2 days a month in office OVERVIEW Xcede are delighted to be partnered with one of the UK's most impactful HealthTech brands. The organisation have won numerous awards for their data-led approach to designing an impactful B2C product that has entirely … disrupted their domain and outperformed their competitors. With a well-established analytics, data science, and data engineering function already in place, the team is looking for a Lead Data Engineer to come in act primarily as a Principal IC while also helping with management of junior … engineers (we'd like to see some experience of this). RESPONSIBILITIES Manage and assist a team of data engineers. Design and continue to build essential data infrastructure for the organisation alongside data pipelines & ETLs. Collaborate with data scientists and machine learning engineers to design and more »

About the Role: I am looking for a talented Data Engineer to join our clients dynamic team on a 6-month contract basis. This is an exciting opportunity for a mid-level professional with 3-5 years of experience to make a significant impact on our data … remote/hybrid working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions. Optimize and troubleshoot data workflows to ensure efficiency and reliability. Implement data quality and validation checks to ensure data integrity. Contribute to the development and maintenance of our data lake and data warehouse solutions on AWS. more »

Senior Data Engineer (Inside IR35) - £700 to 825 per day Location: Remote/Hybrid (London) Rate: £825 per day Contract: Inside IR35 Are you an experienced Data Engineer with a strong background in banking? Our client are seeking Senior Data Engineers to contribute to innovative … data projects within a leading financial institution. Key Responsibilities: Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions. Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines. Distributed Processing: Work with Hadoop, Spark, and other platforms for … large-scale data processing. Real-Time Data Streaming: Develop and manage pipelines using CDC, Kafka, and Apache Spark. Database Management: Handle SQL databases like Oracle, MySQL, or PostgreSQL. Data Governance: Ensure data quality, security, and compliance with best practices. Ideal Candidate: Significant experience in data more »

Use your skills as a Data Engineer to tackle some of today's most challenging societal issues. Super flexible working setup and only a two-stage interview process SR2 is supporting a truly mission-driven organisation using data to positively impact the lives of some of society … s most vulnerable people. Job Description: Transform data into insights, facilitating informed business decisions. Execute end-to-end activities encompassing requirement analysis and design. Develop robust analysis and reporting functionalities. Continuously oversee performance and quality control plans to discern avenues for enhancement. Responsibilities: Interpret data, employing statistical techniques … to analyse results and furnish regular reports. Devise and deploy data collection systems and strategies to optimise statistical efficiency and data quality. Source data from primary or secondary sources and maintain databases/data systems. Identify, analyse, and interpret trends or patterns within intricate data more »

Data Engineer – London – Up to £120,000 I am working with a leading Blockchain start-up, whose core offering is based around the research, development and deployment of infrastructure. This VC-backed client has seen massive success in the last 12 months and are now capitalizing on their … who are ready to take on project ownership and create products that will truly disrupt their industry. Role The business is looking for a Data Engineer with a passion for new technologies/Strong analytical skills and whilst experience in a quant or trading role is not essential … beneficial. The team is highly entrepreneurial giving every new starter a great opportunity to take on project ownership straight from the off. As a Data Engineer you will be working on the company’s core analytics/Monitoring and Alerting platform alongside contributing to the research framework. Requirements more »

Senior Data Engineer (AWS) up to 90k London - 2/3 days a week My Client is an exciting scale up focused on the Art world, looking for a Senior Data Engineer to join a team of software engineers, data engineers, data scientists, and … analysts. You will be responsible for designing and constructing reliable data pipelines. You will leverage the most advanced data engineering and Python tools to ensure the most efficiency and effectiveness in your work. Responsibilities: Collaborate with the team to design, test, and implement scalable and secure data pipelines that meet business needs. Maintain the integrity of data by ensuring good quality. Monitoring pipelines for optimal performance and minimal downtime. Adapt data models to accommodate changing business requirements in collaboration with other teams. Collaborate with other teams Share expertise by mentoring and showing best practices more »

Lead Data Engineer (Director) - Individual contributor - Azure, Data Factory, Databricks, Apache Spark - London Based I am hiring for a Lead Data Engineer for a crucial role within one of my Investment Bank clients in London. This role is at Director level as they require a … likely to grow and have line management responsibilities in the future. Due to this there is an emphasis on current, hands on experience within Data & AI. Key Responsibilities: Leading data engineering practices Support current applications Introduce AI practices to the team/project Communicate key successes with stakeholders … Key Skills: Azure Databricks Apache Spark Datascience, AI, ML Certifications or continued upskilling/contribution to blog posts within Data & AI beneficial but not essential. This is a full-time role offering up to £150k salary plus bonus and benefits. 3 days minimum per week in the office in more »

Data Engineer - Fixed Term Contract About our Team At LexisNexis Intellectual Property (LNIP), our mission is to bring clarity to innovation by delivering better outcomes to the innovation community. We help innovators make more informed decisions, be more productive, and ultimately achieve superior results. By helping our customers … achieve their goals, we support the development of new technologies and processes that ultimately advance humanity About the Role As a Data Engineer at LexisNexis Intellectual Property (LNIP), you'll contribute to new product development. Your role will focus on complex natural language datasets, implementing cutting-edge data solutions like Data Lakehouses and embracing DataOps for operational excellence. Responsibilities Developing and maintaining data infrastructure supporting real-time data processing in streaming architectures Implementing scalable data ingestion and ML pipelines, incorporating Data Lakehouse concepts for unified data management Designing APIs for diverse more »

ROLE SUMMARY DATA ENGINEER REMOTE/TRAVEL TO CLIENT SITE IN LONDON Valcon UK are looking to recruit a self-motivated, highly logical and intellectually curious Data Engineer’s to join our expanding Data capability in the UK. As a growing business area, the ideal … strategy, turn it into an actionable blueprint and help the client get it done. Who have deep expertise in operationalising strategy, process design, digitisation, data and analytics, automation, technology and change. RESPONSIBILITIES: Analyse and organise raw data Build data systems and pipelines Evaluate business needs and objectives … Interpret trends and patterns Conduct complex data analysis and report on results Prepare data for prescriptive and predictive modelling Build algorithms and prototypes Combine raw information from different sources Explore ways to enhance data quality and reliability Identify opportunities for data acquisition Develop analytical tools and more »

Lead Data Engineer Permanent – Hybrid Salary up to £70,186 p/year, 35 hours p/week Join our dynamic public sector client based in Central London, where you will spearhead the technical design and implementation of transformative data integration projects. They are committed to leveraging … cutting-edge technologies and cloud components to enhance the data capabilities. As the Lead Data Engineer, you will be responsible for guiding the Engineering Team in developing and implementing data and integration solutions utilising Microsoft Azure and Integration Services, among other cloud technologies. You will ensure … the quality, performance, and security of their data integration solutions while adhering to best practices and project deadlines. Key Responsibilities the Engineering Team in developing data and integration solutions using the latest technologies and best practices. and deliver data products within specified project deadlines, maintaining high-quality more »

Principal Data Engineer London - £90k - £100k + Package 2 days per week in Office/Client Site ***Unfortuantely due to the nature of this role we cannot accept candidates who hold a Visa*** My client is seeking a Principal Data Engineer to join their dynamic team. … As a Principal Data Engineer, you'll work in multidisciplinary teams to create, support, and maintain user-focused digital solutions that deliver real value to everyone. About the Role Our Principal Data Engineers are leaders in their field. In this role, you'll serve as a principal … consultant, offering technical expertise in data engineering to both our internal team and clients. You'll guide the technical deliverables of the team, nurture client relationships, and be passionate about developing and mentoring others. Key Responsibilities Serve as a technical subject matter expert within the engineering community to develop more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices near … Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and utilising Databricks to support … the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data models to be used for analytics more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting time … to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation … and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI, though this will not be your primary focus. In more »

My client, a highly prestigious hedge fund, is seeking an elite data engineer to join their team in London. The successful individual will have hands-on experience as a data engineer, alongside building ETL pipelines, financial data processing solutions, and owning the data lifecycle … management. You should have prior experience with both Python and SQL. You will be designing and implementing large scale data processing systems, alongside leading the design and development of ETL pipelines that transform raw data into usable data sets for analysis. In addition, you should have experience … in data wrangling, data cleaning and data architecture. My client is committed to paying a substantial increase on any base salary and pay market leading bonuses. It is also worth mentioning that my client offers exceptional benefits, ranging from on-site breakfast + lunch (free for all more »

Data Engineers are responsible for aiding UK Health in developing a cleaned, validated, and discoverable data foundation to enable new analytical workflows and applications. They will need to work closely with UK Health subject matter experts to scope new data integrations, design a data model, and … perform data cleansing and transformation within the data analytics platform. Core activities Establish new integrations into the data foundation. The engineer will get to work with ontology experts and UK Health subject matter experts to map out a data model. Data cleansing and transformation … as defined with subject matter experts. Configure links to other datasets in the data foundation. Work with UK Health QA analysts and subject matter experts to test and validate the output datasets. Set up schedules to regularly update the data in analytics platform. Configure monitoring and data more »

Quantitative Data Engineer Our client is a leading Hedge Fund headquartered in London and is seeking a Quantitative Data Engineer to join their Front Office technologies team. The firms team integrates innovative technology and trading strategies, while utilizing a sophisticated research platform and development environment to … realise consistent trading alphas. As a Quant Data Engineer, you'll collaborate closely with various departments within the organization and Your primary responsibility will involve constructing and maintaining data ingestion processes of varying complexity that drive investment decisions and support critical operations. In this dynamic role, you … ideal candidate will thrive in a fast-paced environment, enjoy direct interaction with business stakeholders, and excel at delivering results under pressure. Responsibilities: Analyzing data, identifying features and issues, and effectively communicating findings to stakeholders. Constructing robust data ingestion pipelines, platforms, and systems for easy support and maintenance. more »

profitable since early 2022. FullCircl was formed in 2021 following the merger of Artesian Solutions and DueDil. In September 2023 FullCircl acquired W2 Global Data Solutions. FullCircl is backed by top-tier investors which include Octopus Investments, Notion Capital, Augmentum Fintech and notable angel investors which include Dr Steve … provide competitive compensation and benefits and believe employee ownership is a key part of cultivating the mindset we want from everyone. The Role Lead Data Engineer We realise at FullCircl that it takes a dedicated team of brilliant people to continually innovate, push boundaries and exceed expectations. We … do amazing things. Still led by our three original founders, we’re constantly on the lookout for rising stars. We are seeking a lead data engineer to join our team and to work on a variety of assignments alongside our product and commercial management teams. The role will more »

About the job My client is seeking a dynamic Lead Data Engineer with robust data architecture and warehousing skills to lead their Data Engineering team. Being a leading financial institution, data fuels their operations and growth. being pivotal in ensuring data is expertly modelled … ingested, transformed, and accessible organisation-wide. Responsibilities: Team Leadership: Mentor and develop our Data Engineering team. Strategy Development: Shape and implement our data engineering strategy. Data Architecture: Define and implement solutions within our Data Vault framework. Cross-Functional Collaboration: Partner with data science, credit risk … and analytic teams to meet their data needs. Customer Data Platform: Manage our Rudderstack-based platform for comprehensive Customer 360 views. Quality Assurance: Ensure CI/CD and test automation with robust observability. Cost Management: Optimise data platform costs within budget. Supplier Management: Maintain strong relationships with more »

We are looking for a Lead Data Engineer to join our Data Engineering Team. In this senior role, you will be responsible for managing our Enterprise Data Warehouse and ensuring the efficient flow and quality of data. Your tasks will include implementing data processes, managing … data architecture, designing ETL processes, and analyzing data for business insights. You will also make data accessible through various platforms and consult internal teams on data usage. This role is ideal for someone with extensive experience in data management, a strong background in computer science … and excellent communication skills. Responsibilities Implement data processes for the Data Warehouse and internal systems Manage and update Data Engineering architecture Implement processes for data accuracy and reconciliation Design and implement ETL processes Make data available through reporting platforms Analyze data and communicate insights more »

A highly prestigious Investment Management firm are looking to hire a Senior Cloud Data Engineer with strong Python and Snowflake experience to join their new Data & AI team in a permanent position. The Cloud Data Engineer will join alongside Data Scientists and Data Modellers to manage and improve the cloud-based Data Warehouse (Azure, Snowflake), and guide the organisation through an unprecedented period of data change. Your Key responsibilities will be: Engineering scalable and secure cloud data solutions for high-performance Data Science workloads and Generative AI applications … Enhancing and managing the cloud-based Data Warehouse (Azure, Snowflake) Designing, building and deploying data pipelines to support advanced analytics and the development of Machine Learning algorithms and Generative AI (GenAi) applications Providing technology thought leadership and supporting the business in adoption of Machine Learning and GenAI capabilities more »