101 to 125 of 221 Permanent Data Engineer Jobs in London

Lead Data Engineer. What’s it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. As the Lead Data Engineer you will also oversee the quality, performance, and security of the data integration solutions. How you’ll make a difference? By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data-driven decisions that improve the … services the client provides for their customers. How you’ll do it? Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data development lifecycle that meet the quality more »

DATA ENGINEER LONDON HYBRID - 3 DAYS IN THE OFFICE UP TO £60K This role does not have the ability to sponsor THE COMPANY A leading provider in accommodation focused on taking advantage of their raw data sources to provide a nurturing environment facilitating personal growth and vibrant … communities THE ROLE AND RESPONSIBILITIES You will be responsible for bringing together all data sources into an Azure Cloud Data Warehouse to be leveraged for BI reporting and analytics In this role you will: Designing, implementing, and maintaining data pipelines across multiple data pipelines across multiple … cloud SQL environments to ensure data integrity, security, and performance are maintained to a high standard Work with the BI team to design and build best-in-class data warehouse components Designing, building, and maintaining quality ETLs and ELTs to make corporate data accessible for reporting, analytics more »

Senior Data Platform Engineer Up to £80,000 1 day a week in office (flexible) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly Azure ML. Data Engineering … Guarantee data access, Data quality, ETL, Data pipelines Platform administration: Help set up accesses, infrastructure, create new storage, enforce best practices Production: Help the preparation of the data science pipelines, interact with data scientists, re-shape code, support towards some ML Ops principles, make the more »

of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with … a fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion more »

means that we’ve got one of the widest, most diverse, and most exciting datasets to work within the UK.The role responsibilities The Principal Data Engineer is a new role that will support the newly created Product Data Domain teams. You will help to build ETL pipelines … to ingest and transform data to develop the data products that will power key value use cases across the BBC. You will work in an agile multi-disciplinary team alongside product analytics developers, product data managers, data modelers and data operations managers, ensuring that all … work delivers maximum value to the BBC.Role and responsibilities will comprise of:· Leads and architects on developing robust and scalable complex data pipelines to ingest, transform, and analyse large volumes of structured and unstructured data from diverse data sources. Pipelines must be optimised for performance, reliability, and more »

Purview is hiring Senior SAS Data Engineerwith one of our valued clients. If you're interested, please reply for more details. Job Details: Role: Senior SAS Data Engineer Location: London & Edinburgh Duration: Permanent and Contract Work Mode: Fully remote with openness to travel occasionally when required We … are looking for strong Senior SAS Data Engineer Job Description: Senior Data Engineer (SAS) – They want to rewrite existing pipelines (SAS, Info, pear, shell scripts) to target state which will be Python and DBT transformation based to be then loaded to SF on Azure. SAS (primary … pearl, shell scripts (secondary) engineers who has experience to convert to Python , DBT based pipelines and load data to Snowflake. Converting SAS based module to python based Candidates who have data management experience in Snowflake with expertise in Python, DBT, Airflow or similar technologies Must have hands on more »

Senior Data Engineer (No Sponsorship Available) I am seeking an experienced Data Engineer who has experience managing green field projects and implementing modern data platforms that connect business systems and data sources to drive insights through data analytics. The ideal candidate will have … experience using Azure Platforms for consolidating data sources and making them accessible to the wider business to support growth and business strategy. Must have strong communication skills and be comfortable liaising with key stakeholders and other business units to understand business needs and gather requirements. Required Experience Track record … of designing and building data infrastructure and ETL pipelines Experience with Azure Platform including Data Factory, Synapse, and Data Lake DB development experience with SQL Software development experience in relevant languages like Python or C# Experienced with T-SQL and RESTful APIs Experience with Data Modelling more »

We are seeking a qualified Data Engineer to join our team, where your responsibilities will include: Designing, optimizing, and maintaining scalable data pipelines and ETL processes using Spark, ensuring streamlined data processing and integration. Collaborating cross-functionally to translate complex data requirements into actionable technical … solutions that drive business objectives. Leveraging Microsoft Azure and Databricks to architect robust data solutions, prioritizing performance optimization for enhanced operational efficiency. Conducting data modeling, profiling, and quality assessments to uphold the integrity and reliability of our data assets. Executing data governance, transformation, and integration initiatives … to support advanced analytics and reporting requirements. Integrating machine learning models seamlessly into data pipelines to facilitate predictive and prescriptive analytics. Ensuring adherence to data security protocols and regulatory compliance standards, maintaining the highest levels of database integrity and operational excellence. This position is available at either our more »

Leading eCommerce client are now searching for a Lead Data Engineer to play a pivotal role in delivering their innovative data strategy. This role will shape our client’s data function, delivering end to end data requirements and designing data pipelines/warehouses to … ensure data is streamlined and enhances overall business success. The role: Design, develop and test an array of data migration processes to streamline the conversation from existing system to a new Snowflake infrastructure. Manage the end-to-end data lifecycle, enabling the use of data to … influence overall business decisions. Streamline our client’s data processes to ensure that customer journeys are personalised. Ensure the accuracy and reliability of data. Collaborate on business projects, advising on data and data structures. Assess the commercial potential of our client’s data and use this more »

Lead Data Engineer. What's it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. The Lead Data Engineer will also oversee the quality, performance, and security of the data integration solutions. How you'll make a difference By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data-driven decisions that improve the services the client … provides for their customers. How you'll do it Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data development lifecycle that meet the quality and security standards more »

Client: A global financial services company About the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability, and … efficiency. Key Responsibilities: Design, develop, and maintain scalable data pipelines using BigQuery, Python, and CloudRun. Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions. Implement best practices for data modeling, ETL processes, and data governance. Optimize and fine-tune … data processes to improve performance and reliability. Stay up-to-date with the latest technologies and trends in data engineering and recommend innovative solutions to enhance our data infrastructure. Required Skills: Strong proficiency in BigQuery, Python, and CloudRun. Experience with building and optimizing data pipelines for more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices near … Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and utilising Databricks to support … the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data models to be used for analytics more »

Full Stack Developer/Data Engineer opportunity. Full time permanent position. Fully remote or hybrid - office just outside of London. My client is a dynamic and rapidly growing electrification company dedicated to the decarbonisation of heat transport and induction. They have years of experience from across the energy … sector in integrating and connecting renewable generation, EV charging and the digitalisation of energy. They are seeking a Full Stack Developer/Data Engineer with Data bricks expertise to help tackle exciting challenges in the energy sector. In this role, you will: Develop and scale energy solutions … Bring ideas to life, building robust and scalable applications from proof-of-concept to deployment, working alongside the Energy Solutions team. Design data pipelines for smarter energy: Craft and manage data pipelines using Databricks, integrating best-in-class demand forecasts to optimize energy use. Enhance user applications for more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting time … to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation … and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI, though this will not be your primary focus. In more »

Unfortunately, my client is not able to sponsor, so candidates must have the right to work in the UK. I'm seeking a Principal Data Engineer to join a public and Private sector-focused consultancy. People are at the heart of everything this organisation does, from utilising a … bottom-up approach internally to ensure all services they deliver are evidence-based and human-centred. A Principal Data Engineer to spearhead our collaborative efforts. As a Principal Data Engineer, you'll be instrumental in crafting and maintaining cutting-edge digital solutions that resonate with users … relationships with your team and stakeholders, you'll foster a supportive environment where challenges are tackled head-on and successes are celebrated. As a data and engineering community champion, you'll help shape the strategic direction and seize new business opportunities through technical bids and proposals. To thrive in more »

Data Engineer | Java | SQL | GCP/AWS | London | £100k-£350k (DOE) Albert Bow are looking for a Data Engineer to join a market maker in London. They have over 200 employees across the globe and provide billions of dollars in liquidity daily. Our client works with … veterans who come from top tier firms to build a vast range of knowledge. Responsibilities: Work closely with the quantitative teams to understand their data requirements Build analytical datasets with business development, finance, and legal teams. Develop high-throughput, near real-time event-driven datasets from live trade and … market data. Create solutions for efficient and reliable market data analysis. Integrate external APIs for market data, balances, trades, etc. Build dashboards using BI tools for business teams and maintain essential databases. Qualifications: 3-8 years of relevant experience. Passion for data analytics and understanding of order more »

A global company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team based in their London office – this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It’s a really exciting time … to join the team, as they look to leverage the latest Microsoft Azure data technologies, having recently launched a brand-new Azure Data Platform and introduced the use of Databricks. The role is predominantly back-end Data Engineering focused, where you’ll develop various solutions for data collection, integration, transformation and modelling, to support the ongoing development of their global data platform. This will include developing data pipelines, to automate data collection and integration across various sources, with the use of Azure Data Factory and Databricks. You will also do a little more »

Data Engineer Paddington, London (Hybrid) Overview Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on this ambition set by this OGSM we require the very highest level of technical/engineering … expertise within Global Petcare Data & Analytics. There is a need to expand this high performing team of creative, skilled individuals – to help build out new capabilities and bring fresh ideas to the table. Key Responsibilities Engineer and orchestrate data flows & pipelines in a cloud environment using a … progressive tech stack e.g. Databricks, Spark, Python, PySpark, Delta Lake, SQL, Logic Apps, Azure Functions, ADLS, Parquet, Neo4J, Flask Ingest and integrate data from a large number of disparate data sources Design and build complex data models for analytical insight Write high quality code contributing to a more »

Senior Azure Data Engineer - 6 Month Contract - Inside IR35 This is an Azure Data Engineer 6 month contract position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having … strong Azure Data Factory and Databricks experience. Work Involved: Implementing and delivering data pipelines Providing mentorship to junior members of the team Working with the Platform team defining capabilities for the lake framework Developing business conceptual data models Producing new frameworks using design patterns and data ingestion Requirements: Strong Data Pipeline experience Databricks Azure Data Factory Spark Azure cloud Financial Services If you're interested get in touch ASAP more »

to understand client requirements and provide technical expertise during pre-sales engagements. Design and implement Proof of Concepts (POCs) to showcase the potential of data integration solutions and demonstrate value to clients. Prepare technical proposals and cost estimates for data integration projects. Conduct client presentations and answer technical … questions effectively. Design, develop, and deploy data pipelines for ingesting, transforming, and loading data from various sources into target systems (cloud and on-premises). Implement data cleansing, quality checks, and transformation logic to ensure data integrity and accuracy. Configure and manage data integration tools … including cloud-based platforms and on-premises solutions. Automate workflows and schedule data pipeline execution for efficient data processing. Monitor data pipelines for performance and troubleshoot any issues. Collaborate with data analysts, scientists, and other stakeholders to ensure data accessibility and meet their analysis needs. more »

Data Engineer London £85,000 Harrington Starr is currently working with a leading AI-based SAAS business that is looking to hire multiple Data Engineers to help them further grow their already exciting business. Within this role, you will be responsible for Maintaining, supporting and expanding existing … data pipelines using DBT, Snowflake and S3. You will also be tasked with implementing standardised data ingress/egress pipelines coupled with onboarding new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from daily to real-time. To … you must be able to work and build relationships with internal teams as you will be working with the quant teams to streamline the data to make it easier to use on the platform. You will also be working with external client to help them onboard their data more »

SENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office. Commutable from London.) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly Azure ML. Contribute to MLOps … the organisation. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years of commercial work as a Senior Data Engineer (responsible for taking decisions, rather than just writing code) An ability to write production quality Python code. Strong SQL Skills Experienced creating more »

SENIOR DATA ENGINEER LONDON/HYBRID £65,000-75,000 PER ANNUM This fast-growing E-commerce company are searching for a new Senior Data Engineer. You will be responsible for building out and maintaining the company's Azure platform. You will also be involved in building … Data Pipelines using Python. THE COMPANY This company is growing exponentially and hiring a new Senior Data Engineer from their recent success. They have recently invested heavily into growing their Data and Analytics team, to provide a great service to their clients. THE ROLE You will … be joining an expanding data team currently working with many different clients, building a next-generation data platform using Azure. You will be responsible for working with stakeholders to help them understand the data collected. Research and implement new tools in the data space. Maintain and more »

Actuarial Data Engineer | London | Hybrid (3 Days in the Office) | upto £60,000 per annum Please only apply if you are based in the UK with a valid working visa and do not require sponsorship. Are you passionate about building robust data solutions for actuarial teams? Do … you have a knack for developing strong databases/data marts in SQL Server? Our London Market insurance client are seeking an Actuarial Data Engineer/Quant Developer to join their Actuary team in London! You will: Utilise your SQL Skills in T-SQL, SSIS and SSAS … to build out database solutions Have some knowledge and experience in Python Be able to code stored procedures Extract, import and update risk modelling data Understand Database and Data Warehousing principles as you’ll be managing data within an Azure analytics platform Collaborate with cross-functional teams more »

Data Engineer required for a 6 month initial contract with a leading commodities trading firm. Outside of IR35 Hybrid working - 2/3 days in London office Experience Required: - Commodities industry experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »