101 to 125 of 218 Data Engineer Jobs in London

Lead Data Engineer Permanent - Hybrid Join our dynamic public sector client based in Central London, where you will spearhead the technical design and implementation of transformative data integration projects. They are committed to leveraging cutting-edge technologies and cloud components to enhance the data capabilities. As … the Lead Data Engineer, you will be responsible for guiding the Engineering Team in developing and implementing data and integration solutions utilising Microsoft Azure and Integration Services, among other cloud technologies. You will ensure the quality, performance, and security of their data integration solutions while adhering … to best practices and project deadlines. Key Responsibilities Lead the Engineering Team in developing data and integration solutions using the latest technologies and best practices. Create and deliver data products within specified project deadlines, maintaining high-quality and security standards. Establish and uphold best practice standards, design patterns more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices near … Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and utilising Databricks to support … the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data models to be used for analytics more »

Lead Big Data Engineer - Hybrid - £120K My client is a leading trading platform that is looking to add a talented Senior Big Data Engineer You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives. … design, processes, and implementation to improve operational management, scalability, and extensibility. The following skills/experience is essential: -Proven experience as a Lead Big Data Engineer with excellent knowledge of Big Data -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc -Excellent … experience of ETL, data warehousing and handling a variety of data types -Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI) -Experience implementing data visualisation and reporting tools -Excellent communication and business-facing skills more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting time … to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation … and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI, though this will not be your primary focus. In more »

Quantitative Data Engineer Our client is a leading Hedge Fund headquartered in London and is seeking a Quantitative Data Engineer to join their Front Office technologies team. The firms team integrates innovative technology and trading strategies, while utilizing a sophisticated research platform and development environment to … realise consistent trading alphas. As a Quant Data Engineer, you'll collaborate closely with various departments within the organization and Your primary responsibility will involve constructing and maintaining data ingestion processes of varying complexity that drive investment decisions and support critical operations. In this dynamic role, you … ideal candidate will thrive in a fast-paced environment, enjoy direct interaction with business stakeholders, and excel at delivering results under pressure. Responsibilities: Analyzing data, identifying features and issues, and effectively communicating findings to stakeholders. Constructing robust data ingestion pipelines, platforms, and systems for easy support and maintenance. more »

profitable since early 2022. FullCircl was formed in 2021 following the merger of Artesian Solutions and DueDil. In September 2023 FullCircl acquired W2 Global Data Solutions. FullCircl is backed by top-tier investors which include Octopus Investments, Notion Capital, Augmentum Fintech and notable angel investors which include Dr Steve … provide competitive compensation and benefits and believe employee ownership is a key part of cultivating the mindset we want from everyone. The Role Lead Data Engineer We realise at FullCircl that it takes a dedicated team of brilliant people to continually innovate, push boundaries and exceed expectations. We … do amazing things. Still led by our three original founders, we’re constantly on the lookout for rising stars. We are seeking a lead data engineer to join our team and to work on a variety of assignments alongside our product and commercial management teams. The role will more »

Stott and May has partnered with a global healthcare organisation within the private sector, to source a senior data engineer to join their growing tech team. Hybrid (3/4 days per month in London or Manchester) Salary: Circa £80k p/annum Key Responsibilities: Lead the consolidation … and migration of legacy data to our new cloud-based data platform. Design and implement master and transactional data models to ensure data integrity and consistency. Develop ETL pipelines and cloud data storage solutions that meet business requirements and non-functional needs. Collaborate closely with … data analysts, visualization engineers, and project managers to deliver data solutions. Surface data for analytical consumption and prepare data for ML/predictive and prescriptive models. What we are looking for: Proficiency with Databricks and building data pipelines on Azure cloud platforms. Strong data more »

and brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Lead Data Engineer role sits within the Data Services department, you will work actively to unlock the value of data by building and enabling product teams and data practitioners to use the data platform … passionate about building value-creating and innovative solutions for the company and colleagues. You will have the chance to work with product managers and data scientists on building the best technical solutions. You will have the opportunity to rotate on the products you develop, pair programs and contribute to more »

Lead Data Engineer. What’s it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. As the Lead Data Engineer you will also oversee the quality, performance, and security of the data integration solutions. How you’ll make a difference? By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data-driven decisions that improve the … services the client provides for their customers. How you’ll do it? Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data development lifecycle that meet the quality more »

Senior Data Platform Engineer Up to £80,000 1 day a week in office (flexible) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly Azure ML. Data Engineering … Guarantee data access, Data quality, ETL, Data pipelines Platform administration: Help set up accesses, infrastructure, create new storage, enforce best practices Production: Help the preparation of the data science pipelines, interact with data scientists, re-shape code, support towards some ML Ops principles, make the more »

6x Cabling Engineer/Data Engineer- May/June 24start date- Heathrow - 2 months work- £180PD - £190PD - 8 hour working day **** Location - Heathrow Rate: - £180-£190PD Duration - 2 months + Certs - ECS, DBS Check (Active) Online applicdations to be completed - GSAT - Online 2/3 hours (Video … If you are interested in the above contract role please apply and I will be in contact to disucss in more detail. **** 6x Cabling Engineer/Data Engineer- May/June 24start date- Heathrow - 2 months work- £180PD - £190PD - 8 hour working day more »

Data Engineer - London/Hybrid - £70,000 I am currently working with a market-leading organisation in the legal industry who are looking for a Data Engineer to join their team. The organisation are currently focused on the development of their Azure data platform and … you will play a key part in this project alongside other data driven Data Engineers. You will play a vital role in helping implement the organisations data strategy and transformation roadmap and will become the organisations SME on data related projects and best practice. This is … an opportunity to join a team who are serious about the way that they use data and work within an organisation who are providing significant investment into all of their data teams. As part of this role, you will be responsible for some of the following areas. Plan more »

Data Engineer - London/Hybrid - £70,000 I am currently working with a market-leading organisation in the legal industry who are looking for a Data Engineer to join their team. The organisation are currently focused on the development of their Azure data platform and … you will play a key part in this project alongside other data driven Data Engineers. You will play a vital role in helping implement the organisations data strategy and transformation roadmap and will become the organisations SME on data related projects and best practice. This is … an opportunity to join a team who are serious about the way that they use data and work within an organisation who are providing significant investment into all of their data teams. As part of this role, you will be responsible for some of the following areas. Plan more »

We are seeking a qualified Data Engineer to join our team, where your responsibilities will include: Designing, optimizing, and maintaining scalable data pipelines and ETL processes using Spark, ensuring streamlined data processing and integration. Collaborating cross-functionally to translate complex data requirements into actionable technical … solutions that drive business objectives. Leveraging Microsoft Azure and Databricks to architect robust data solutions, prioritizing performance optimization for enhanced operational efficiency. Conducting data modeling, profiling, and quality assessments to uphold the integrity and reliability of our data assets. Executing data governance, transformation, and integration initiatives … to support advanced analytics and reporting requirements. Integrating machine learning models seamlessly into data pipelines to facilitate predictive and prescriptive analytics. Ensuring adherence to data security protocols and regulatory compliance standards, maintaining the highest levels of database integrity and operational excellence. This position is available at either our more »

Our client is a leading UK based Fintech that is disrupting consumer finance. They are looking for a Lead Data Engineer to manage their 4 person strong Data Engineering team and report into their Head of Data. This position is based in their London offices and you … will need to get to their central London office twice a week. Role Overview As the Lead Data Engineer, you will play a crucial role in driving our data engineering efforts forward. You will lead and inspire our Data Engineering team, ensuring effective data modelling … ingestion, transformation, and availability across the organisation. Key Responsibilities Lead and develop a team of Data Engineers, fostering their skills through coaching and mentorship. Own the data engineering strategy, devising solutions to current and future challenges. Act as a data architect, defining solutions within our Data more »

Data Engineer – SQL, Python, PySpark, Azure, Databricks, Lloyds, Insurance, Permanent – London A fast-growing global Insurance broker situated in the City of London is searching for x2 Data Engineers to join their newly formed Data & Analytics team and play a pivotal role in their data … At present, they’re looking to transition from a program-based structure into a balanced operation through embracing agile methodologies to augment efficiency. The Data Engineer will be tasked with creating a Lakehouse platform in Azure by managing and implementing data engineering pipelines within Azure Databricks to … ingest both structured and unstructured data from the global business. Skills Required Prior experience working with large datasets and a proficiency in SQL, Python and PySpark is required. An understanding of medallion architecture and experience working within the framework in a Lakehouse platform. Experience of pipeline deployment within Azure more »

Role: Staff Data Engineer 💾 Stack: Python/Scala/Java/C#, AWS/Azure, Spark etc Want to take the next big step in your journey as a Data Engineering Lead? 🤔 This company is in need of a Staff Data Engineer who will lead … and scale their existing Data Engineering team to meet business needs and quality-assure their data services across the company. ️ ⚡ Industry: Energy 🏢 Location: London 🏠 Working Policy: Hybrid - 2/3 days in the office per week 👥 Size of org: 1000+ 💸 Salary: up to £200k+ (Total Compensation) As a … Staff/Principal Data Engineer (7+ years experience), you'll help the team solve complex problems and scale their complex distributed systems working alongside non-technical stakeholders to make vital improvements continuously throughout the development process. Want to find out more? Hit Apply or you can reach me more »

Lead Data Engineer. What's it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. The Lead Data Engineer will also oversee the quality, performance, and security of the data integration solutions. How you'll make a difference By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data-driven decisions that improve the services the client … provides for their customers. How you'll do it Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data development lifecycle that meet the quality and security standards more »

Junior/Mid Data Engineer - London (Hybrid) - Permanent - £35,000-£45,000 Market Research, e-commerce, AWS, Python, ETL, SQL *You must be based in London, and have full permanent right to work in the UK to apply for this role* I'm currently working with an exciting … leading market research and analytics company specialising in data analysis on the alcohol and beverages market. They provide data to a range of major multinational beverage corporations, to provide essential market insights. They're looking to strengthen their team with a Data Engineer, with: Experience building … this opportunity matches your ability and expectations, please apply through the job advert above ASAP and I will be in touch. Junior/Mid Data Engineer - London (Hybrid) - Permanent - £35,000-£45,000 Market Research, e-commerce, AWS, Python, ETL, SQL more »

Data Engineer Location: London, 3 days per week in the office Salary range: £50,000-£70,000 + benefits Purpose: Design, build, and maintain scalable data architectures, including pipelines and cloud-based data warehouses. Tech: Python (NumPy, Pandas), SQL, ETL, Cloud (AWS, Azure or GCP), Snowflake … specialist consultancy who solely specialise in the Maritime trading industry. You will work onsite with 1 specific client to design, build and maintain scalable data architectures working with key stakeholders in their business to shape their data-driven strategies. The Company: They have a long history providing IT … services to the Maritime industry and are looking to provide its Data Insights services to key business partners who require Data Engineering expertise to support data management activities. The Role: The successful candidate will work on all aspects of our client's data architecture, collection, pipelining more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices near … Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and utilising Databricks to support … the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data models to be used for analytics more »

Data Engineer - Python, Snowflake, Azure Contract hire £700 per day inside IR35 London Job Details: As the data engineer, you will help build a data analytics platform on cloud native Azure using Python and Snowflake. Migrating the current Databrick platforms into our new cloud environment. … Key skills required. Python Scripting 3+ years of commercial use of Snowflake Experience in building data warehouses Cloud Services experience - We use MS Azure Technical strength in working with Azure Data Factory (ADF) Strong API knowledge Ability to perform advanced database queries using SQL, MySQL or similar Good more »

Unfortunately, my client is not able to sponsor, so candidates must have the right to work in the UK. I'm seeking a Principal Data Engineer to join a public and Private sector-focused consultancy. People are at the heart of everything this organisation does, from utilising a … bottom-up approach internally to ensure all services they deliver are evidence-based and human-centred. A Principal Data Engineer to spearhead our collaborative efforts. As a Principal Data Engineer, you'll be instrumental in crafting and maintaining cutting-edge digital solutions that resonate with users … relationships with your team and stakeholders, you'll foster a supportive environment where challenges are tackled head-on and successes are celebrated. As a data and engineering community champion, you'll help shape the strategic direction and seize new business opportunities through technical bids and proposals. To thrive in more »

A well-known insurance company are looking for a Lead Data Engineer with skills in Snowflake to join their team in London - this is a permanent role with hybrid working arrangements, requiring 2 days per week in the office on average. In this role you will be working … within a new, greenfield division of the business, using a brand-new technology stack including Snowflake, dbt, Airflow and AWS. This function provide data for Machine Learning and Artificial Intelligence capabilities, helping them to provide the best possible service offering to their customers. As a Lead Data Engineer, you will lead a high-performing team to develop data architectures and design brand-new solutions in collaboration with IT Architects and external suppliers. This is a unique opportunity for an experienced Data Engineer to join a new function of this well-established business - combining a more »

A well-known insurance company are looking for a Lead Data Engineer with skills in Snowflake to join their team in London - this is a permanent role with hybrid working arrangements, requiring 2 days per week in the office on average. In this role you will be working … within a new, greenfield division of the business, using a brand-new technology stack including Snowflake, dbt, Airflow and AWS. This function provide data for Machine Learning and Artificial Intelligence capabilities, helping them to provide the best possible service offering to their customers. As a Lead Data Engineer, you will lead a high-performing team to develop data architectures and design brand-new solutions in collaboration with IT Architects and external suppliers. This is a unique opportunity for an experienced Data Engineer to join a new function of this well-established business - combining a more »