201 to 225 of 385 Data Engineer Jobs in London

Full Stack Developer/Data Engineer opportunity. Full time permanent position. Fully remote or hybrid - office just outside of London. My client is a dynamic and rapidly growing electrification company dedicated to the decarbonisation of heat transport and induction. They have years of experience from across the energy … sector in integrating and connecting renewable generation, EV charging and the digitalisation of energy. They are seeking a Full Stack Developer/Data Engineer with Data bricks expertise to help tackle exciting challenges in the energy sector. In this role, you will: Develop and scale energy solutions … Bring ideas to life, building robust and scalable applications from proof-of-concept to deployment, working alongside the Energy Solutions team. Design data pipelines for smarter energy: Craft and manage data pipelines using Databricks, integrating best-in-class demand forecasts to optimize energy use. Enhance user applications for more »

Unfortunately, my client is not able to sponsor, so candidates must have the right to work in the UK. I'm seeking a Principal Data Engineer to join a public and Private sector-focused consultancy. People are at the heart of everything this organisation does, from utilising a … bottom-up approach internally to ensure all services they deliver are evidence-based and human-centred. A Principal Data Engineer to spearhead our collaborative efforts. As a Principal Data Engineer, you'll be instrumental in crafting and maintaining cutting-edge digital solutions that resonate with users … relationships with your team and stakeholders, you'll foster a supportive environment where challenges are tackled head-on and successes are celebrated. As a data and engineering community champion, you'll help shape the strategic direction and seize new business opportunities through technical bids and proposals. To thrive in more »

Data Engineer | Java | SQL | GCP/AWS | London | £100k-£350k (DOE) Albert Bow are looking for a Data Engineer to join a market maker in London. They have over 200 employees across the globe and provide billions of dollars in liquidity daily. Our client works with … veterans who come from top tier firms to build a vast range of knowledge. Responsibilities: Work closely with the quantitative teams to understand their data requirements Build analytical datasets with business development, finance, and legal teams. Develop high-throughput, near real-time event-driven datasets from live trade and … market data. Create solutions for efficient and reliable market data analysis. Integrate external APIs for market data, balances, trades, etc. Build dashboards using BI tools for business teams and maintain essential databases. Qualifications: 3-8 years of relevant experience. Passion for data analytics and understanding of order more »

Data Engineer | Java | SQL | GCP/AWS | London | £100k-£350k (DOE) Albert Bow are looking for a Data Engineer to join a market maker in London. They have over 200 employees across the globe and provide billions of dollars in liquidity daily. Our client works with … veterans who come from top tier firms to build a vast range of knowledge. Responsibilities: Work closely with the quantitative teams to understand their data requirements Build analytical datasets with business development, finance, and legal teams. Develop high-throughput, near real-time event-driven datasets from live trade and … market data. Create solutions for efficient and reliable market data analysis. Integrate external APIs for market data, balances, trades, etc. Build dashboards using BI tools for business teams and maintain essential databases. Qualifications: 3-8 years of relevant experience. Passion for data analytics and understanding of order more »

A global company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team based in their London office – this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It’s a really exciting time … to join the team, as they look to leverage the latest Microsoft Azure data technologies, having recently launched a brand-new Azure Data Platform and introduced the use of Databricks. The role is predominantly back-end Data Engineering focused, where you’ll develop various solutions for data collection, integration, transformation and modelling, to support the ongoing development of their global data platform. This will include developing data pipelines, to automate data collection and integration across various sources, with the use of Azure Data Factory and Databricks. You will also do a little more »

A global company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team based in their London office – this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It’s a really exciting time … to join the team, as they look to leverage the latest Microsoft Azure data technologies, having recently launched a brand-new Azure Data Platform and introduced the use of Databricks. The role is predominantly back-end Data Engineering focused, where you’ll develop various solutions for data collection, integration, transformation and modelling, to support the ongoing development of their global data platform. This will include developing data pipelines, to automate data collection and integration across various sources, with the use of Azure Data Factory and Databricks. You will also do a little more »

Data Engineer Paddington, London (Hybrid) Overview Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on this ambition set by this OGSM we require the very highest level of technical/engineering … expertise within Global Petcare Data & Analytics. There is a need to expand this high performing team of creative, skilled individuals – to help build out new capabilities and bring fresh ideas to the table. Key Responsibilities Engineer and orchestrate data flows & pipelines in a cloud environment using a … progressive tech stack e.g. Databricks, Spark, Python, PySpark, Delta Lake, SQL, Logic Apps, Azure Functions, ADLS, Parquet, Neo4J, Flask Ingest and integrate data from a large number of disparate data sources Design and build complex data models for analytical insight Write high quality code contributing to a more »

Data Engineer Paddington, London (Hybrid) Overview Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on this ambition set by this OGSM we require the very highest level of technical/engineering … expertise within Global Petcare Data & Analytics. There is a need to expand this high performing team of creative, skilled individuals – to help build out new capabilities and bring fresh ideas to the table. Key Responsibilities Engineer and orchestrate data flows & pipelines in a cloud environment using a … progressive tech stack e.g. Databricks, Spark, Python, PySpark, Delta Lake, SQL, Logic Apps, Azure Functions, ADLS, Parquet, Neo4J, Flask Ingest and integrate data from a large number of disparate data sources Design and build complex data models for analytical insight Write high quality code contributing to a more »

Senior Azure Data Engineer - 6 Month Contract - Inside IR35 This is an Azure Data Engineer 6 month contract position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having … strong Azure Data Factory and Databricks experience. Work Involved: Implementing and delivering data pipelines Providing mentorship to junior members of the team Working with the Platform team defining capabilities for the lake framework Developing business conceptual data models Producing new frameworks using design patterns and data ingestion Requirements: Strong Data Pipeline experience Databricks Azure Data Factory Spark Azure cloud Financial Services If you're interested get in touch ASAP more »

Senior Azure Data Engineer - 6 Month Contract - Inside IR35 This is an Azure Data Engineer 6 month contract position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having … strong Azure Data Factory and Databricks experience. Work Involved: Implementing and delivering data pipelines Providing mentorship to junior members of the team Working with the Platform team defining capabilities for the lake framework Developing business conceptual data models Producing new frameworks using design patterns and data ingestion Requirements: Strong Data Pipeline experience Databricks Azure Data Factory Spark Azure cloud Financial Services If you're interested get in touch ASAP more »

Job Title: AWS Data Engineer Work Arrangement: Hybrid (London) 2 to 3 days Rate: £400 - £420/day Duration: 6 months Number of Positions: 2 Role Description: We are seeking an experienced AWS Data Engineer with a minimum of 8 years' experience in Big Data platforms. This role will involve working with cutting-edge technology to build and maintain Big Data pipelines in the cloud. Key Responsibilities: Develop code according to given requirements. Create and execute unit test cases. Assist in backlog grooming. Key Skills/Experience: Extensive experience in developing Big Data pipelines in the cloud using technologies such as Apache Spark. Expertise in performing complex data transformations using Spark SQL queries. Experience orchestrating data pipelines using Apache Airflow. Proficiency in Git-based version control tools. Proficiency with Linux commands and Bash Scripting. Working experience with AWS Big Data more »

Job Title: AWS Data Engineer Work Arrangement: Hybrid (London) 2 to 3 days Rate: £400 - £420/day Duration: 6 months Number of Positions: 2 Role Description: We are seeking an experienced AWS Data Engineer with a minimum of 8 years' experience in Big Data platforms. This role will involve working with cutting-edge technology to build and maintain Big Data pipelines in the cloud. Key Responsibilities: Develop code according to given requirements. Create and execute unit test cases. Assist in backlog grooming. Key Skills/Experience: Extensive experience in developing Big Data pipelines in the cloud using technologies such as Apache Spark. Expertise in performing complex data transformations using Spark SQL queries. Experience orchestrating data pipelines using Apache Airflow. Proficiency in Git-based version control tools. Proficiency with Linux commands and Bash Scripting. Working experience with AWS Big Data more »

A well-known insurance company are looking for a Lead Data Engineer with skills in Snowflake to join their team in London - this is a permanent role with hybrid working arrangements, requiring 2 days per week in the office on average. In this role you will be working … within a new, greenfield division of the business, using a brand-new technology stack including Snowflake, dbt, Airflow and AWS. This function provide data for Machine Learning and Artificial Intelligence capabilities, helping them to provide the best possible service offering to their customers. As a Lead Data Engineer, you will lead a high-performing team to develop data architectures and design brand-new solutions in collaboration with IT Architects and external suppliers. This is a unique opportunity for an experienced Data Engineer to join a new function of this well-established business - combining a more »

A well-known insurance company are looking for a Lead Data Engineer with skills in Snowflake to join their team in London - this is a permanent role with hybrid working arrangements, requiring 2 days per week in the office on average. In this role you will be working … within a new, greenfield division of the business, using a brand-new technology stack including Snowflake, dbt, Airflow and AWS. This function provide data for Machine Learning and Artificial Intelligence capabilities, helping them to provide the best possible service offering to their customers. As a Lead Data Engineer, you will lead a high-performing team to develop data architectures and design brand-new solutions in collaboration with IT Architects and external suppliers. This is a unique opportunity for an experienced Data Engineer to join a new function of this well-established business - combining a more »

Data Engineer | Integration | SSIS | SSRS | Azure Logic Apps | Azure API management | DevOps | Azure Data Factory | SQL | Oracle Database | Systems Integration | Integration Architecture We are thrilled to be partnering with a university who is in the market for a Data Engineer who has strong experience working … implementation of an ERP system that will manage their HR and Finance, due to go live in a year. Summary of the role: Role: Data & Integration Architect Employment Type: Permanent - 2-year FTC but one of the team member will be retiring so there will be an extension Location … of working. Essential skills: System integrations experience (rather than BI Analytics) Strong understanding of SQL OR oracle databases Microsoft integration tools (SSIS, SSRS, Azure data factory) Good level of communication Desirable skills: Experience with administration and deployment of Azure Logic Apps, Azure Function, Azure API management, ARM templates in more »

Data Engineer London £85,000 Harrington Starr is currently working with a leading AI-based SAAS business that is looking to hire multiple Data Engineers to help them further grow their already exciting business. Within this role, you will be responsible for Maintaining, supporting and expanding existing … data pipelines using DBT, Snowflake and S3. You will also be tasked with implementing standardised data ingress/egress pipelines coupled with onboarding new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from daily to real-time. To … you must be able to work and build relationships with internal teams as you will be working with the quant teams to streamline the data to make it easier to use on the platform. You will also be working with external client to help them onboard their data more »

Data Engineer London £85,000 Harrington Starr is currently working with a leading AI-based SAAS business that is looking to hire multiple Data Engineers to help them further grow their already exciting business. Within this role, you will be responsible for Maintaining, supporting and expanding existing … data pipelines using DBT, Snowflake and S3. You will also be tasked with implementing standardised data ingress/egress pipelines coupled with onboarding new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from daily to real-time. To … you must be able to work and build relationships with internal teams as you will be working with the quant teams to streamline the data to make it easier to use on the platform. You will also be working with external client to help them onboard their data more »

SENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office. Commutable from London.) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement both Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly Azure ML. Contribute to … the organisation. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years of commercial work as a Senior Data Engineer (responsible for taking decisions, rather than just writing code) An ability to write production quality Python code. Strong SQL Skills Experienced creating more »

We are currently seeking a Snr Data Engineer who has experience with the Azure Data stack to join the Business Intelligence team. The team is part of a wider team that includes the MS D365 implementation team (on-going project), Oracle ERP team and Digital Applications team. … requirement to deliver MI reporting to our Finance stakeholders. Main responsibilities Collaborate with business stakeholders, process owners and BAs to understand requirements. To build data pipelines, reading data from various on-premise or cloud services to the Azure datalake. To design and build data models suitable for … reporting. To design and build Reports. Implementation of Data Quality, Data Governance, Data Security processes as part of the solution design About the Candidate Essential experience Experience with the following technologies Azure Synapse, Data Factory, Databricks, SQL Db, Datalake, Key Vault Azure Dev Ops and CI more »

SENIOR DATA ENGINEER LONDON/HYBRID £65,000-75,000 PER ANNUM This fast-growing E-commerce company are searching for a new Senior Data Engineer. You will be responsible for building out and maintaining the company's Azure platform. You will also be involved in building … Data Pipelines using Python. THE COMPANY This company is growing exponentially and hiring a new Senior Data Engineer from their recent success. They have recently invested heavily into growing their Data and Analytics team, to provide a great service to their clients. THE ROLE You will … be joining an expanding data team currently working with many different clients, building a next-generation data platform using Azure. You will be responsible for working with stakeholders to help them understand the data collected. Research and implement new tools in the data space. Maintain and more »

On behalf of a fantastic client, we are resourcing for an experienced Data Engineer The role is permanent and is a hybrid role with 1 day a week in office. Skills required Extensive SQL and T-SQL skills Extensive experience in building optimised data pipelines Extensive experience … of data mapping and data transformation Experience in building optimised data pipelines Experience of data mapping and data transformation Experience of ETL tools (Azure Data Factory highly desirable) Experience of commercial off the shelf database packages e.g. Microsoft SQL Server Experience of Microsoft Power … Platform Working knowledge of Data Protection regulation Working knowledge of data modelling and data architecture For the full role and client details please apply with your full CV and contact details There is no Visa Sponsorship for the role and all applicants must have full working rights more »

Lead Data Engineer (Azure/SQL) - London - £70k 2-3 days per week in office My client is looking for a Data Lead to take responsibility for the technical design and implementation of data integration projects using Azure and Integration Services. Core duties will include technical … of the team whilst ensuring the overall performance of the solutions utilising the latest technologies, processes and best practice. You will design and build data pipelines, ETL processes and data workflows that enable data to be transferred seamlessly across a variety of platforms Required Skills: - Effective experience … leading, motivating and developing a team - Demonstrable experience in designing and deploying Azure Integration Services solutions - Proven experience of building data solutions and products in Azure - Data pipelines - SQL knowledge - Agile/Scrum Lead Data Engineer (Azure/SQL) - London - £70k 2-3 days per week more »

Lead Data Engineer (Azure/SQL) - London - £70k 2-3 days per week in office My client is looking for a Data Lead to take responsibility for the technical design and implementation of data integration projects using Azure and Integration Services. Core duties will include technical … of the team whilst ensuring the overall performance of the solutions utilising the latest technologies, processes and best practice. You will design and build data pipelines, ETL processes and data workflows that enable data to be transferred seamlessly across a variety of platforms Required Skills: - Effective experience … leading, motivating and developing a team - Demonstrable experience in designing and deploying Azure Integration Services solutions - Proven experience of building data solutions and products in Azure - Data pipelines - SQL knowledge - Agile/Scrum Lead Data Engineer (Azure/SQL) - London - £70k 2-3 days per week more »

Leading ecommerce client are now searching for a Senior Data Engineer to contribute towards the delivery of their data strategy. This engineer will shape our client’s data function, delivering end to end solutions for an array of customer data projects. The role: Designing … data pipelines, managing data warehouses, and implementing complex ETL processes. Work closely with data scientists, analysts, and stakeholders to optimise our client’s infrastructure. Optimise data driven products, personalisation, reporting and overall business success. Manage the whole data lifecycle (End to End). Ensure the … reliability and quality of data. Key Requirements: Strong experience designing data pipelines/warehouses using AWS and Snowflake. Exposure to big data technologies such as Kafka, Spark, or Hadoop. Solid experience with Snowflake, including performance optimisation and cost management. Strong experience with SQL and Data modelling. Excellent more »

Leading ecommerce client are now searching for a Senior Data Engineer to contribute towards the delivery of their data strategy. This engineer will shape our client’s data function, delivering end to end solutions for an array of customer data projects. The role: Designing … data pipelines, managing data warehouses, and implementing complex ETL processes. Work closely with data scientists, analysts, and stakeholders to optimise our client’s infrastructure. Optimise data driven products, personalisation, reporting and overall business success. Manage the whole data lifecycle (End to End). Ensure the … reliability and quality of data. Key Requirements: Strong experience designing data pipelines/warehouses using AWS and Snowflake. Exposure to big data technologies such as Kafka, Spark, or Hadoop. Solid experience with Snowflake, including performance optimisation and cost management. Strong experience with SQL and Data modelling. Excellent more »