101 to 125 of 239 Data Engineer Jobs in London

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting time … to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation … and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI, though this will not be your primary focus. In more »

My client, a highly prestigious hedge fund, is seeking an elite data engineer to join their team in London. The successful individual will have hands-on experience as a data engineer, alongside building ETL pipelines, financial data processing solutions, and owning the data lifecycle … management. You should have prior experience with both Python and SQL. You will be designing and implementing large scale data processing systems, alongside leading the design and development of ETL pipelines that transform raw data into usable data sets for analysis. In addition, you should have experience … in data wrangling, data cleaning and data architecture. My client is committed to paying a substantial increase on any base salary and pay market leading bonuses. It is also worth mentioning that my client offers exceptional benefits, ranging from on-site breakfast + lunch (free for all more »

Data Engineers are responsible for aiding UK Health in developing a cleaned, validated, and discoverable data foundation to enable new analytical workflows and applications. They will need to work closely with UK Health subject matter experts to scope new data integrations, design a data model, and … perform data cleansing and transformation within the data analytics platform. Core activities Establish new integrations into the data foundation. The engineer will get to work with ontology experts and UK Health subject matter experts to map out a data model. Data cleansing and transformation … as defined with subject matter experts. Configure links to other datasets in the data foundation. Work with UK Health QA analysts and subject matter experts to test and validate the output datasets. Set up schedules to regularly update the data in analytics platform. Configure monitoring and data more »

Quantitative Data Engineer Our client is a leading Hedge Fund headquartered in London and is seeking a Quantitative Data Engineer to join their Front Office technologies team. The firms team integrates innovative technology and trading strategies, while utilizing a sophisticated research platform and development environment to … realise consistent trading alphas. As a Quant Data Engineer, you'll collaborate closely with various departments within the organization and Your primary responsibility will involve constructing and maintaining data ingestion processes of varying complexity that drive investment decisions and support critical operations. In this dynamic role, you … ideal candidate will thrive in a fast-paced environment, enjoy direct interaction with business stakeholders, and excel at delivering results under pressure. Responsibilities: Analyzing data, identifying features and issues, and effectively communicating findings to stakeholders. Constructing robust data ingestion pipelines, platforms, and systems for easy support and maintenance. more »

profitable since early 2022. FullCircl was formed in 2021 following the merger of Artesian Solutions and DueDil. In September 2023 FullCircl acquired W2 Global Data Solutions. FullCircl is backed by top-tier investors which include Octopus Investments, Notion Capital, Augmentum Fintech and notable angel investors which include Dr Steve … provide competitive compensation and benefits and believe employee ownership is a key part of cultivating the mindset we want from everyone. The Role Lead Data Engineer We realise at FullCircl that it takes a dedicated team of brilliant people to continually innovate, push boundaries and exceed expectations. We … do amazing things. Still led by our three original founders, we’re constantly on the lookout for rising stars. We are seeking a lead data engineer to join our team and to work on a variety of assignments alongside our product and commercial management teams. The role will more »

About the job My client is seeking a dynamic Lead Data Engineer with robust data architecture and warehousing skills to lead their Data Engineering team. Being a leading financial institution, data fuels their operations and growth. being pivotal in ensuring data is expertly modelled … ingested, transformed, and accessible organisation-wide. Responsibilities: Team Leadership: Mentor and develop our Data Engineering team. Strategy Development: Shape and implement our data engineering strategy. Data Architecture: Define and implement solutions within our Data Vault framework. Cross-Functional Collaboration: Partner with data science, credit risk … and analytic teams to meet their data needs. Customer Data Platform: Manage our Rudderstack-based platform for comprehensive Customer 360 views. Quality Assurance: Ensure CI/CD and test automation with robust observability. Cost Management: Optimise data platform costs within budget. Supplier Management: Maintain strong relationships with more »

We are looking for a Lead Data Engineer to join our Data Engineering Team. In this senior role, you will be responsible for managing our Enterprise Data Warehouse and ensuring the efficient flow and quality of data. Your tasks will include implementing data processes, managing … data architecture, designing ETL processes, and analyzing data for business insights. You will also make data accessible through various platforms and consult internal teams on data usage. This role is ideal for someone with extensive experience in data management, a strong background in computer science … and excellent communication skills. Responsibilities Implement data processes for the Data Warehouse and internal systems Manage and update Data Engineering architecture Implement processes for data accuracy and reconciliation Design and implement ETL processes Make data available through reporting platforms Analyze data and communicate insights more »

A highly prestigious Investment Management firm are looking to hire a Senior Cloud Data Engineer with strong Python and Snowflake experience to join their new Data & AI team in a permanent position. The Cloud Data Engineer will join alongside Data Scientists and Data Modellers to manage and improve the cloud-based Data Warehouse (Azure, Snowflake), and guide the organisation through an unprecedented period of data change. Your Key responsibilities will be: Engineering scalable and secure cloud data solutions for high-performance Data Science workloads and Generative AI applications … Enhancing and managing the cloud-based Data Warehouse (Azure, Snowflake) Designing, building and deploying data pipelines to support advanced analytics and the development of Machine Learning algorithms and Generative AI (GenAi) applications Providing technology thought leadership and supporting the business in adoption of Machine Learning and GenAI capabilities more »

DATA ENGINEER Location: Remote Hybrid (1 day per month in London) Job Type: Contract - 6 Months Daily Rate: £(Apply online only) per day INSIDE IR35 Concept Resourcing are currently working with one of the UK's leading IT consultancies. We are seeking an experienced Data Engineer to join their team and contribute to the success of various IT salesforce projects. Key Responsibilities: Architecture, modelling and leadership skills Strong Azure data skills, including: Azure Data Factory V2, Azure Data Lake Storage V2, Azure Databricks, Azure Function Apps& Logic Apps, Azure Stream Analytics, Azure … understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc. Strong repositories, CI/CD skills. Strong knowledge of Kimball data modelling, such as star schema, snowflake, etc. Strong SQL skills. Strong data analysis skills. Excellent written and verbal communication skills If you're more »

Principal Data Engineer London (hybrid) Up to £100,000 base + package Here at Anson McCade we are partnering with a leading Digital Transformation Consultancy who are in need of an experienced Data Engineer to join a multi-disciplinary team building, supporting and maintaining User-Centred … databases is also desirable. Solid experience of at least one Cloud provider such as AWS, Azure or GCP. Strong experience of working with different data formats, e.g., CSV, JSON and XML Building reliable Data Pipelines Broader knowledge of IT — e.g., Security and Networking Working in an Agile Environment … office Salary up to £100,000 per annum Professional growth and career development Collaborative and inclusive work environment Health and well-being initiatives Principal Data Engineer London (hybrid) Up to £100,000 base + package If this position is of interest please don't hesitate and apply down more »

Senior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great … opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely with … a fantastic Head of Software Engineering. What you'll be up to?: Data Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL more »

Lead Data Engineer. What’s it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. As the Lead Data Engineer you will also oversee the quality, performance, and security of the data integration solutions. How you’ll make a difference? By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data-driven decisions that improve the … services the client provides for their customers. How you’ll do it? Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data development lifecycle that meet the quality more »

DATA ENGINEER LONDON HYBRID - 3 DAYS IN THE OFFICE UP TO £60K This role does not have the ability to sponsor THE COMPANY A leading provider in accommodation focused on taking advantage of their raw data sources to provide a nurturing environment facilitating personal growth and vibrant … communities THE ROLE AND RESPONSIBILITIES You will be responsible for bringing together all data sources into an Azure Cloud Data Warehouse to be leveraged for BI reporting and analytics In this role you will: Designing, implementing, and maintaining data pipelines across multiple data pipelines across multiple … cloud SQL environments to ensure data integrity, security, and performance are maintained to a high standard Work with the BI team to design and build best-in-class data warehouse components Designing, building, and maintaining quality ETLs and ELTs to make corporate data accessible for reporting, analytics more »

Senior Data Platform Engineer Up to £80,000 1 day a week in office (flexible) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly Azure ML. Data Engineering … Guarantee data access, Data quality, ETL, Data pipelines Platform administration: Help set up accesses, infrastructure, create new storage, enforce best practices Production: Help the preparation of the data science pipelines, interact with data scientists, re-shape code, support towards some ML Ops principles, make the more »

of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with … a fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion more »

Purview is hiring Senior SAS Data Engineerwith one of our valued clients. If you're interested, please reply for more details. Job Details: Role: Senior SAS Data Engineer Location: London & Edinburgh Duration: Permanent and Contract Work Mode: Fully remote with openness to travel occasionally when required We … are looking for strong Senior SAS Data Engineer Job Description: Senior Data Engineer (SAS) – They want to rewrite existing pipelines (SAS, Info, pear, shell scripts) to target state which will be Python and DBT transformation based to be then loaded to SF on Azure. SAS (primary … pearl, shell scripts (secondary) engineers who has experience to convert to Python , DBT based pipelines and load data to Snowflake. Converting SAS based module to python based Candidates who have data management experience in Snowflake with expertise in Python, DBT, Airflow or similar technologies Must have hands on more »

Senior Data Engineer (No Sponsorship Available) I am seeking an experienced Data Engineer who has experience managing green field projects and implementing modern data platforms that connect business systems and data sources to drive insights through data analytics. The ideal candidate will have … experience using Azure Platforms for consolidating data sources and making them accessible to the wider business to support growth and business strategy. Must have strong communication skills and be comfortable liaising with key stakeholders and other business units to understand business needs and gather requirements. Required Experience Track record … of designing and building data infrastructure and ETL pipelines Experience with Azure Platform including Data Factory, Synapse, and Data Lake DB development experience with SQL Software development experience in relevant languages like Python or C# Experienced with T-SQL and RESTful APIs Experience with Data Modelling more »

We are seeking a qualified Data Engineer to join our team, where your responsibilities will include: Designing, optimizing, and maintaining scalable data pipelines and ETL processes using Spark, ensuring streamlined data processing and integration. Collaborating cross-functionally to translate complex data requirements into actionable technical … solutions that drive business objectives. Leveraging Microsoft Azure and Databricks to architect robust data solutions, prioritizing performance optimization for enhanced operational efficiency. Conducting data modeling, profiling, and quality assessments to uphold the integrity and reliability of our data assets. Executing data governance, transformation, and integration initiatives … to support advanced analytics and reporting requirements. Integrating machine learning models seamlessly into data pipelines to facilitate predictive and prescriptive analytics. Ensuring adherence to data security protocols and regulatory compliance standards, maintaining the highest levels of database integrity and operational excellence. This position is available at either our more »

Leading eCommerce client are now searching for a Lead Data Engineer to play a pivotal role in delivering their innovative data strategy. This role will shape our client’s data function, delivering end to end data requirements and designing data pipelines/warehouses to … ensure data is streamlined and enhances overall business success. The role: Design, develop and test an array of data migration processes to streamline the conversation from existing system to a new Snowflake infrastructure. Manage the end-to-end data lifecycle, enabling the use of data to … influence overall business decisions. Streamline our client’s data processes to ensure that customer journeys are personalised. Ensure the accuracy and reliability of data. Collaborate on business projects, advising on data and data structures. Assess the commercial potential of our client’s data and use this more »

Azure Data Engineer - Contract - Inside IR35 This is an Azure Data Engineer position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having strong Azure Data Factory and … Databricks experience. Work Involved: Implementing and delivering data pipelines Providing mentorship to junior members of the team Working with the Platform team defining capabilities for the lake framework Developing business conceptual data models Producing new frameworks using design patterns and data ingestion Requirements: Strong Data Pipeline … experience Databricks Azure Data Factory Spark Azure cloud Financial Services If you're interested get in touch ASAP more »

Lead Data Engineer. What's it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. The Lead Data Engineer will also oversee the quality, performance, and security of the data integration solutions. How you'll make a difference By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data-driven decisions that improve the services the client … provides for their customers. How you'll do it Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data development lifecycle that meet the quality and security standards more »

Client: A global financial services company About the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability, and … efficiency. Key Responsibilities: Design, develop, and maintain scalable data pipelines using BigQuery, Python, and CloudRun. Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions. Implement best practices for data modeling, ETL processes, and data governance. Optimize and fine-tune … data processes to improve performance and reliability. Stay up-to-date with the latest technologies and trends in data engineering and recommend innovative solutions to enhance our data infrastructure. Required Skills: Strong proficiency in BigQuery, Python, and CloudRun. Experience with building and optimizing data pipelines for more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices near … Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and utilising Databricks to support … the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data models to be used for analytics more »

Full Stack Developer/Data Engineer opportunity. Full time permanent position. Fully remote or hybrid - office just outside of London. My client is a dynamic and rapidly growing electrification company dedicated to the decarbonisation of heat transport and induction. They have years of experience from across the energy … sector in integrating and connecting renewable generation, EV charging and the digitalisation of energy. They are seeking a Full Stack Developer/Data Engineer with Data bricks expertise to help tackle exciting challenges in the energy sector. In this role, you will: Develop and scale energy solutions … Bring ideas to life, building robust and scalable applications from proof-of-concept to deployment, working alongside the Energy Solutions team. Design data pipelines for smarter energy: Craft and manage data pipelines using Databricks, integrating best-in-class demand forecasts to optimize energy use. Enhance user applications for more »

Unfortunately, my client is not able to sponsor, so candidates must have the right to work in the UK. I'm seeking a Principal Data Engineer to join a public and Private sector-focused consultancy. People are at the heart of everything this organisation does, from utilising a … bottom-up approach internally to ensure all services they deliver are evidence-based and human-centred. A Principal Data Engineer to spearhead our collaborative efforts. As a Principal Data Engineer, you'll be instrumental in crafting and maintaining cutting-edge digital solutions that resonate with users … relationships with your team and stakeholders, you'll foster a supportive environment where challenges are tackled head-on and successes are celebrated. As a data and engineering community champion, you'll help shape the strategic direction and seize new business opportunities through technical bids and proposals. To thrive in more »