101 to 125 of 202 Permanent Data Engineer Jobs in London

A highly prestigious Investment Management firm are looking to hire a Senior Cloud Data Engineer with strong Python and Snowflake experience to join their new Data & AI team in a permanent position. The Cloud Data Engineer will join alongside Data Scientists and Data Modellers to manage and improve the cloud-based Data Warehouse (Azure, Snowflake), and guide the organisation through an unprecedented period of data change. Your Key responsibilities will be: Engineering scalable and secure cloud data solutions for high-performance Data Science workloads and Generative AI applications … Enhancing and managing the cloud-based Data Warehouse (Azure, Snowflake) Designing, building and deploying data pipelines to support advanced analytics and the development of Machine Learning algorithms and Generative AI (GenAi) applications Providing technology thought leadership and supporting the business in adoption of Machine Learning and GenAI capabilities more »

Lead Data Engineer. What’s it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. As the Lead Data Engineer you will also oversee the quality, performance, and security of the data integration solutions. How you’ll make a difference? By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data-driven decisions that improve the … services the client provides for their customers. How you’ll do it? Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data development lifecycle that meet the quality more »

DATA ENGINEER LONDON HYBRID - 3 DAYS IN THE OFFICE UP TO £60K This role does not have the ability to sponsor THE COMPANY A leading provider in accommodation focused on taking advantage of their raw data sources to provide a nurturing environment facilitating personal growth and vibrant … communities THE ROLE AND RESPONSIBILITIES You will be responsible for bringing together all data sources into an Azure Cloud Data Warehouse to be leveraged for BI reporting and analytics In this role you will: Designing, implementing, and maintaining data pipelines across multiple data pipelines across multiple … cloud SQL environments to ensure data integrity, security, and performance are maintained to a high standard Work with the BI team to design and build best-in-class data warehouse components Designing, building, and maintaining quality ETLs and ELTs to make corporate data accessible for reporting, analytics more »

Senior Data Platform Engineer Up to £80,000 1 day a week in office (flexible) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly Azure ML. Data Engineering … Guarantee data access, Data quality, ETL, Data pipelines Platform administration: Help set up accesses, infrastructure, create new storage, enforce best practices Production: Help the preparation of the data science pipelines, interact with data scientists, re-shape code, support towards some ML Ops principles, make the more »

Data Engineer - London/Hybrid - £70,000 I am currently working with a market-leading organisation in the legal industry who are looking for a Data Engineer to join their team. The organisation are currently focused on the development of their Azure data platform and … you will play a key part in this project alongside other data driven Data Engineers. You will play a vital role in helping implement the organisations data strategy and transformation roadmap and will become the organisations SME on data related projects and best practice. This is … an opportunity to join a team who are serious about the way that they use data and work within an organisation who are providing significant investment into all of their data teams. As part of this role, you will be responsible for some of the following areas. Plan more »

Data Engineer - London/Hybrid - £70,000 I am currently working with a market-leading organisation in the legal industry who are looking for a Data Engineer to join their team. The organisation are currently focused on the development of their Azure data platform and … you will play a key part in this project alongside other data driven Data Engineers. You will play a vital role in helping implement the organisations data strategy and transformation roadmap and will become the organisations SME on data related projects and best practice. This is … an opportunity to join a team who are serious about the way that they use data and work within an organisation who are providing significant investment into all of their data teams. As part of this role, you will be responsible for some of the following areas. Plan more »

We are seeking a qualified Data Engineer to join our team, where your responsibilities will include: Designing, optimizing, and maintaining scalable data pipelines and ETL processes using Spark, ensuring streamlined data processing and integration. Collaborating cross-functionally to translate complex data requirements into actionable technical … solutions that drive business objectives. Leveraging Microsoft Azure and Databricks to architect robust data solutions, prioritizing performance optimization for enhanced operational efficiency. Conducting data modeling, profiling, and quality assessments to uphold the integrity and reliability of our data assets. Executing data governance, transformation, and integration initiatives … to support advanced analytics and reporting requirements. Integrating machine learning models seamlessly into data pipelines to facilitate predictive and prescriptive analytics. Ensuring adherence to data security protocols and regulatory compliance standards, maintaining the highest levels of database integrity and operational excellence. This position is available at either our more »

Data Engineer – SQL, Python, PySpark, Azure, Databricks, Lloyds, Insurance, Permanent – London A fast-growing global Insurance broker situated in the City of London is searching for x2 Data Engineers to join their newly formed Data & Analytics team and play a pivotal role in their data … At present, they’re looking to transition from a program-based structure into a balanced operation through embracing agile methodologies to augment efficiency. The Data Engineer will be tasked with creating a Lakehouse platform in Azure by managing and implementing data engineering pipelines within Azure Databricks to … ingest both structured and unstructured data from the global business. Skills Required Prior experience working with large datasets and a proficiency in SQL, Python and PySpark is required. An understanding of medallion architecture and experience working within the framework in a Lakehouse platform. Experience of pipeline deployment within Azure more »

Role: Staff Data Engineer 💾 Stack: Python/Scala/Java/C#, AWS/Azure, Spark etc Want to take the next big step in your journey as a Data Engineering Lead? 🤔 This company is in need of a Staff Data Engineer who will lead … and scale their existing Data Engineering team to meet business needs and quality-assure their data services across the company. ️ ⚡ Industry: Energy 🏢 Location: London 🏠 Working Policy: Hybrid - 2/3 days in the office per week 👥 Size of org: 1000+ 💸 Salary: up to £200k+ (Total Compensation) As a … Staff/Principal Data Engineer (7+ years experience), you'll help the team solve complex problems and scale their complex distributed systems working alongside non-technical stakeholders to make vital improvements continuously throughout the development process. Want to find out more? Hit Apply or you can reach me more »

Lead Data Engineer. What's it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. The Lead Data Engineer will also oversee the quality, performance, and security of the data integration solutions. How you'll make a difference By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data-driven decisions that improve the services the client … provides for their customers. How you'll do it Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data development lifecycle that meet the quality and security standards more »

Junior/Mid Data Engineer - London (Hybrid) - Permanent - £35,000-£45,000 Market Research, e-commerce, AWS, Python, ETL, SQL *You must be based in London, and have full permanent right to work in the UK to apply for this role* I'm currently working with an exciting … leading market research and analytics company specialising in data analysis on the alcohol and beverages market. They provide data to a range of major multinational beverage corporations, to provide essential market insights. They're looking to strengthen their team with a Data Engineer, with: Experience building … this opportunity matches your ability and expectations, please apply through the job advert above ASAP and I will be in touch. Junior/Mid Data Engineer - London (Hybrid) - Permanent - £35,000-£45,000 Market Research, e-commerce, AWS, Python, ETL, SQL more »

Client: A global financial services company About the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability, and … efficiency. Key Responsibilities: Design, develop, and maintain scalable data pipelines using BigQuery, Python, and CloudRun. Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions. Implement best practices for data modeling, ETL processes, and data governance. Optimize and fine-tune … data processes to improve performance and reliability. Stay up-to-date with the latest technologies and trends in data engineering and recommend innovative solutions to enhance our data infrastructure. Required Skills: Strong proficiency in BigQuery, Python, and CloudRun. Experience with building and optimizing data pipelines for more »

Data Engineer Location: London, 3 days per week in the office Salary range: £50,000-£70,000 + benefits Purpose: Design, build, and maintain scalable data architectures, including pipelines and cloud-based data warehouses. Tech: Python (NumPy, Pandas), SQL, ETL, Cloud (AWS, Azure or GCP), Snowflake … specialist consultancy who solely specialise in the Maritime trading industry. You will work onsite with 1 specific client to design, build and maintain scalable data architectures working with key stakeholders in their business to shape their data-driven strategies. The Company: They have a long history providing IT … services to the Maritime industry and are looking to provide its Data Insights services to key business partners who require Data Engineering expertise to support data management activities. The Role: The successful candidate will work on all aspects of our client's data architecture, collection, pipelining more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices near … Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and utilising Databricks to support … the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data models to be used for analytics more »

Full Stack Developer/Data Engineer opportunity. Full time permanent position. Fully remote or hybrid - office just outside of London. My client is a dynamic and rapidly growing electrification company dedicated to the decarbonisation of heat transport and induction. They have years of experience from across the energy … sector in integrating and connecting renewable generation, EV charging and the digitalisation of energy. They are seeking a Full Stack Developer/Data Engineer with Data bricks expertise to help tackle exciting challenges in the energy sector. In this role, you will: Develop and scale energy solutions … Bring ideas to life, building robust and scalable applications from proof-of-concept to deployment, working alongside the Energy Solutions team. Design data pipelines for smarter energy: Craft and manage data pipelines using Databricks, integrating best-in-class demand forecasts to optimize energy use. Enhance user applications for more »

Data Engineer - Python, Snowflake, Azure Contract hire £700 per day inside IR35 London - 3 days WFH Job Details: As the data engineer, you will help build a data analytics platform on cloud native Azure using Python and Snowflake. Migrating the current Databrick platforms into our … new cloud environment. Key skills required. Python Scripting 3+ years of commercial use of Snowflake Experience in building data warehouses Cloud Services experience - We use MS Azure Technical strength in working with Azure Data Factory (ADF) Strong API knowledge Ability to perform advanced database queries using SQL, MySQL more »

Unfortunately, my client is not able to sponsor, so candidates must have the right to work in the UK. I'm seeking a Principal Data Engineer to join a public and Private sector-focused consultancy. People are at the heart of everything this organisation does, from utilising a … bottom-up approach internally to ensure all services they deliver are evidence-based and human-centred. A Principal Data Engineer to spearhead our collaborative efforts. As a Principal Data Engineer, you'll be instrumental in crafting and maintaining cutting-edge digital solutions that resonate with users … relationships with your team and stakeholders, you'll foster a supportive environment where challenges are tackled head-on and successes are celebrated. As a data and engineering community champion, you'll help shape the strategic direction and seize new business opportunities through technical bids and proposals. To thrive in more »

A well-known insurance company are looking for a Lead Data Engineer with skills in Snowflake to join their team in London - this is a permanent role with hybrid working arrangements, requiring 2 days per week in the office on average. In this role you will be working … within a new, greenfield division of the business, using a brand-new technology stack including Snowflake, dbt, Airflow and AWS. This function provide data for Machine Learning and Artificial Intelligence capabilities, helping them to provide the best possible service offering to their customers. As a Lead Data Engineer, you will lead a high-performing team to develop data architectures and design brand-new solutions in collaboration with IT Architects and external suppliers. This is a unique opportunity for an experienced Data Engineer to join a new function of this well-established business - combining a more »

A well-known insurance company are looking for a Lead Data Engineer with skills in Snowflake to join their team in London - this is a permanent role with hybrid working arrangements, requiring 2 days per week in the office on average. In this role you will be working … within a new, greenfield division of the business, using a brand-new technology stack including Snowflake, dbt, Airflow and AWS. This function provide data for Machine Learning and Artificial Intelligence capabilities, helping them to provide the best possible service offering to their customers. As a Lead Data Engineer, you will lead a high-performing team to develop data architectures and design brand-new solutions in collaboration with IT Architects and external suppliers. This is a unique opportunity for an experienced Data Engineer to join a new function of this well-established business - combining a more »

Data Engineer London £85,000 Harrington Starr is currently working with a leading AI-based SAAS business that is looking to hire multiple Data Engineers to help them further grow their already exciting business. Within this role, you will be responsible for Maintaining, supporting and expanding existing … data pipelines using DBT, Snowflake and S3. You will also be tasked with implementing standardised data ingress/egress pipelines coupled with onboarding new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from daily to real-time. To … you must be able to work and build relationships with internal teams as you will be working with the quant teams to streamline the data to make it easier to use on the platform. You will also be working with external client to help them onboard their data more »

SENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office. Commutable from London.) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement both Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly Azure ML. Contribute to … the organisation. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years of commercial work as a Senior Data Engineer (responsible for taking decisions, rather than just writing code) An ability to write production quality Python code. Strong SQL Skills Experienced creating more »

Senior Data Engineer - AWS Location: London, United Kingdom Industry: Art Salary: Up to £80000 per annum Work Model: Hybrid (2-3 days a week in London) My client a art-tech business is seeking a highly skilled and experienced Senior Data Engineer to join their diverse … team of around 20 which includes software and data engineers, data scientists, and analysts. This role provides an opportunity to work in a fast-paced and collaborative environment. Your main duties will include designing and constructing robust data pipelines using the best of open-source data … stakeholders across the business. The role is Hybrid 2-3 days in the London Office. This role will give you a unique approach into data in the creative industry. If this role is of interest to you apply now with your latest CV. more »

We are currently seeking a Snr Data Engineer who has experience with the Azure Data stack to join the Business Intelligence team. The team is part of a wider team that includes the MS D365 implementation team (on-going project), Oracle ERP team and Digital Applications team. … requirement to deliver MI reporting to our Finance stakeholders. Main responsibilities Collaborate with business stakeholders, process owners and BAs to understand requirements. To build data pipelines, reading data from various on-premise or cloud services to the Azure datalake. To design and build data models suitable for … reporting. To design and build Reports. Implementation of Data Quality, Data Governance, Data Security processes as part of the solution design About the Candidate Essential experience Experience with the following technologies Azure Synapse, Data Factory, Databricks, SQL Db, Datalake, Key Vault Azure Dev Ops and CI more »

SENIOR DATA ENGINEER LONDON/HYBRID £65,000-75,000 PER ANNUM This fast-growing E-commerce company are searching for a new Senior Data Engineer. You will be responsible for building out and maintaining the company's Azure platform. You will also be involved in building … Data Pipelines using Python. THE COMPANY This company is growing exponentially and hiring a new Senior Data Engineer from their recent success. They have recently invested heavily into growing their Data and Analytics team, to provide a great service to their clients. THE ROLE You will … be joining an expanding data team currently working with many different clients, building a next-generation data platform using Azure. You will be responsible for working with stakeholders to help them understand the data collected. Research and implement new tools in the data space. Maintain and more »

On behalf of a fantastic client, we are resourcing for an experienced Data Engineer The role is permanent and is a hybrid role with 1 day a week in office. Skills required Extensive SQL and T-SQL skills Extensive experience in building optimised data pipelines Extensive experience … of data mapping and data transformation Experience in building optimised data pipelines Experience of data mapping and data transformation Experience of ETL tools (Azure Data Factory highly desirable) Experience of commercial off the shelf database packages e.g. Microsoft SQL Server Experience of Microsoft Power … Platform Working knowledge of Data Protection regulation Working knowledge of data modelling and data architecture For the full role and client details please apply with your full CV and contact details There is no Visa Sponsorship for the role and all applicants must have full working rights more »