276 to 300 of 1,717 Data Engineering Jobs

The Job As Principle Data Engineer, your responsibilities will include designing, developing, and implementing high-performance data pipelines using Azure Data Factory, Databricks, and other Azure data services. You will architect and manage data solutions using Azure Data Lake Storage, Databricks, Databricks DLT and Streaming and Event Based Architectures. This role will see you … collaborating with data scientists, analysts and other engineers to translate data requirements into technical solutions. You will also be responsible for driving best practices for data governance, data quality, data security and data lineage. About You You are a Data Engineer with extensive experience using Azure data platform services: Azure Databricks, Azure … Data Factory, Azure Data Lake Storage, Azure SQL Database and/or Azure Synapse Analytics. You will have strong SQL and excellent programming skills in Python (Scala is a strong advantage) as well as a solid understanding of data governance, quality, and security principles. You will be an excellent communicator with some exposure to Infrastructure as Code More ❯

The Job As Principle Data Engineer, your responsibilities will include designing, developing, and implementing high-performance data pipelines using Azure Data Factory, Databricks, and other Azure data services. You will architect and manage data solutions using Azure Data Lake Storage, Databricks, Databricks DLT and Streaming and Event Based Architectures. This role will see you … collaborating with data scientists, analysts and other engineers to translate data requirements into technical solutions. You will also be responsible for driving best practices for data governance, data quality, data security and data lineage. About You You are a Data Engineer with extensive experience using Azure data platform services: Azure Databricks, Azure … Data Factory, Azure Data Lake Storage, Azure SQL Database and/or Azure Synapse Analytics. You will have strong SQL and excellent programming skills in Python (Scala is a strong advantage) as well as a solid understanding of data governance, quality, and security principles. You will be an excellent communicator with some exposure to Infrastructure as Code More ❯

Lead Data Engineer Location: South England x2 days a month in office! Package: Competitive salary + strong benefits We’re representing a major financial services organisation that is investing heavily in next-generation data and digital platforms. They are building a modern, cloud-native data ecosystem to power AI, analytics, and customer-facing innovation and now seek … a Lead Data Engineer to guide this transformation. The company have an incredible Data Leadership team with good tenure, and alongside impactful Data Science projects, they have multiple AI/LLM based projects in production due to their mature Data offering. This is a rare opportunity to join the team at an impactful, senior level due … to the typically very long tenure. The role This position blends technical leadership with hands-on engineering. You’ll oversee the design and delivery of scalable data solutions, lead and mentor a small engineering group, and set the standards for how data is built, managed, and consumed across the organisation. It’s a chance to make architectural More ❯

Data Product Manager Fully Remote (In The UK) £90,000-£100,000 The Company A market-leading, AI-driven search intelligence platform focused on helping enterprise brands and agencies reduce paid search costs, protect brand equity, and stay ahead of competitor movements is seeking a Data Product Manager! Their patented technology delivers transparency and actionable insights to marketing … teams that operate in the largely blind world of paid search auctions; trusted by hundreds of global brands, they’ve built a business where data science meets marketing performance, delivering intelligent, automated insights that transform how customers approach search! The Role This is a strategic and highly technical Data Product Manager role, sitting within the Product team and … reporting directly to the Product Lead. You’ll drive the evolution of the company’s data platform and machine learning ecosystem, which underpins its core search intelligence products. You’ll manage the roadmap for data integrity, quality, and scalability, working closely with Data Engineering and Data Science teams to ensure the underlying data models More ❯

Lead Data Engineer Maximise your chances of a successful application to this job by ensuring your CV and skills are a good match. Location: South England x2 days a month in office! Package: Competitive salary + strong benefits We're representing a major financial services organisation that is investing heavily in next-generation data and digital platforms. They … are building a modern, cloud-native data ecosystem to power AI, analytics, and customer-facing innovation and now seek a Lead Data Engineer to guide this transformation. The company have an incredible Data Leadership team with good tenure, and alongside impactful Data Science projects, they have multiple AI/LLM based projects in production due to … their mature Data offering. This is a rare opportunity to join the team at an impactful, senior level due to the typically very long tenure. The role This position blends technical leadership with hands-on engineering. You'll oversee the design and delivery of scalable data solutions, lead and mentor a small engineering group, and set the More ❯

Data Engineer Job Type : Permanent Location: Hub Location (London/Reading/Birmingham/Leeds/Glasgow) Full time (35 hours) with 3 days per week in the office Excellent career opportunity! TDRC are excited to be once again working with one of the UKs leading Wealth Management firms. Through their robust infrastructure, cutting edge technology, and exceptional support … they are delivering an excellent and reliable service to their continuously expanding client base. They are providing the utmost level of quality and security in everything they do. The Data Engineer will play a key role in developing and maintaining Power BI reports and dashboards to support the businesss operational MI, while contributing to broader data initiatives within … Azure Data Factory, Synapse Analytics, and the ongoing migration to Microsoft Fabric. This is a hands-on delivery role suited to a mid-level engineer with strong technical ability and a desire to grow within a modern cloud data environment. Build and maintain Power BI reports and dashboards that deliver accurate and timely insights for operational and business More ❯

we are hiring for Technical Data Architect location: Central London Type : Permanent Hybrid role (2-3 days from client location) We are seeking a highly skilled TechnicalData Architect- with expertise in Databricks, PySpark, and modern data engineering practices. The ideal candidate will lead the design, development, and optimization of scalable data pipelines, while ensuring data … platform. This role requires strong leadership, technical depth, and the ability to collaborate with cross-functional teams. ________________________________________ Key Responsibilities Lead the design, development, and maintenance of scalable, high-performance data pipelines on Databricks. Architect and implement data ingestion, transformation, and integration workflows using PySpark, SQL, and Delta Lake. Guide the team in migrating legacy ETL processes to modern … cloud-based data pipelines. Ensure data accuracy, schema consistency, row counts, and KPIs during migration and transformation. Collaborate with Data engineer , BI Engineers, and Security teams to define data standards, governance, and compliance. Optimize Spark jobs and Databricks clusters for performance and cost efficiency. Support real-time and batch data processing for downstream systems (e.g. More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and build next-generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data-driven solutions that enable smarter decision … scalable technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and build next-generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data-driven solutions that enable smarter decision … scalable technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and build next-generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data-driven solutions that enable smarter decision … scalable technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and build next-generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data-driven solutions that enable smarter decision … scalable technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and build next-generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data-driven solutions that enable smarter decision … scalable technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and More ❯

Lead Data Engineer (Ab Initio/AWS/Data Pipelines) Location: Reston, VA (Hybrid - onsite roughly once every 1-2 months) Duration: 12-Month Contract About the Role We're looking for a Lead Data Engineer to build and optimize cloud-based data pipelines supporting large-scale AI and analytics initiatives. You'll lead the design … and implementation of data integration solutions using Ab Initio and AWS services, helping modernize how enterprise data is moved, transformed, and leveraged for AI/ML applications. What You'll Do Design, develop, and maintain ETL/ELT data pipelines using Ab Initio. Move structured and unstructured data from on-prem to AWS cloud for AI … and analytics workloads. Work with AWS services such as S3, Athena, Kendra, and Aurora to ensure scalable data storage and access. Collaborate with architects, data scientists, and developers to deliver reliable and performant data solutions. Apply best practices for data quality, performance, reliability, and automation. Lead technical design reviews, mentor engineers, and ensure compliance with enterprise More ❯

We are seeking a highly skilled ML Ops Engineer to join our growing data team. This role is critical in designing and implementing robust, scalable, and efficient data systems that power analytics, machine learning models, and business insights. The ideal candidate will have expertise in data pipeline orchestration (e.g., Airflow), data lake and warehouse architecture and … development, infrastructure as code (IaC) using Terraform , and data extraction from both structured and unstructured data sources (e.g. websites). Knowledge using the Microsoft Azure ecosystem, MLOps, Kubernetes , and other modern data engineering practices. Core Responsibilities Data Architecture & Development: Leverage best practices in schema design, partitioning, and optimisation for efficient storage and retrieval. Build and … maintain data models to support analytics and machine learning workflows. Design and implement scalable, secure, and high-performance data lake and data warehouse solutions. Pipeline Orchestration: Develop, monitor, and optimize ETL/ELT workflows using Apache Airflow. Ensure data pipelines are robust, error-tolerant, and scalable for real-time and batch processing. Data Scraping & Unstructured More ❯

Data Engineer - C#/SQL/Azure DevOps/Kubernetes/Docker/Clickhouse. Data consumption, Data discovery, fast retrieval. £700/Day Inside IR35. 6 month rolling. Hybrid London. My client is a top tier commodities trading house. They are building a repository of gas data for analysts. It’s all about data, data consumption, data discovery, fast retrieval. Clickhouse (and potentially a lakehouse) is key in this. They are looking for candidates that have strong: Data Engineering experience across Data consumption, Data discovery, fast retrieval Strong C#.NET experience Strong experience with Azure DevOps strong Kubernetes and Docker experience Experience with Clickhouse database is desirable but not essential. More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a Sr Technology Architect, you … capability building. You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities Define the overall data architecture strategy aligned with business transformation goals · Design scalable, secure, and integrated data models/assets · Define and build Data Modelling and architecture Framework. · Ensure data governance, quality, and compliance across all assets · Experience developing and deploying data intensive application across multiple projects · Involve in Discovery/solution planning discussions to define the solution roadmap. · Guide the integration of legacy systems with new data pipelines and reporting/Analytics tools Required · Should have hands on experience in Information Technology in technical design and More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a Sr Technology Architect, you … capability building. You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities Define the overall data architecture strategy aligned with business transformation goals · Design scalable, secure, and integrated data models/assets · Define and build Data Modelling and architecture Framework. · Ensure data governance, quality, and compliance across all assets · Experience developing and deploying data intensive application across multiple projects · Involve in Discovery/solution planning discussions to define the solution roadmap. · Guide the integration of legacy systems with new data pipelines and reporting/Analytics tools Required · Should have hands on experience in Information Technology in technical design and More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a Sr Technology Architect, you … capability building. You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities Define the overall data architecture strategy aligned with business transformation goals · Design scalable, secure, and integrated data models/assets · Define and build Data Modelling and architecture Framework. · Ensure data governance, quality, and compliance across all assets · Experience developing and deploying data intensive application across multiple projects · Involve in Discovery/solution planning discussions to define the solution roadmap. · Guide the integration of legacy systems with new data pipelines and reporting/Analytics tools Required · Should have hands on experience in Information Technology in technical design and More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a Sr Technology Architect, you … capability building. You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities Define the overall data architecture strategy aligned with business transformation goals · Design scalable, secure, and integrated data models/assets · Define and build Data Modelling and architecture Framework. · Ensure data governance, quality, and compliance across all assets · Experience developing and deploying data intensive application across multiple projects · Involve in Discovery/solution planning discussions to define the solution roadmap. · Guide the integration of legacy systems with new data pipelines and reporting/Analytics tools Required · Should have hands on experience in Information Technology in technical design and More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a Sr Technology Architect, you … capability building. You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities Define the overall data architecture strategy aligned with business transformation goals · Design scalable, secure, and integrated data models/assets · Define and build Data Modelling and architecture Framework. · Ensure data governance, quality, and compliance across all assets · Experience developing and deploying data intensive application across multiple projects · Involve in Discovery/solution planning discussions to define the solution roadmap. · Guide the integration of legacy systems with new data pipelines and reporting/Analytics tools Required · Should have hands on experience in Information Technology in technical design and More ❯

days per week onsite) We are currently working with a leading Midlands based services provider who require a technically strong Senior BI Manager with a good understanding of Azure Data and Data Engineering tools. Working as a key member of a newly formed Data Engineering team, the successful candidate will lead the design, development, and … ongoing enhancement of the client's data and reporting infrastructure. You will be the strategic owner of the Azure Data Platform, overseeing services such as Azure Data Lake, Data Warehouse, Data Factory, Databricks, and Power BI. The technical focus is all Microsoft, primarily Azure so any Fabric experience would be very beneficial. Our client is … looking for someone who is going to lead the function, and has previous experience doing this. Someone who really understands data and what it can be used for and challenge the business on what they need from the data and challenge the teams to produce the most effective data outputs for the business need so that it More ❯

Head of Data Engineering Location : West Midlands Hybrid Policy : 3 days per week in the office (flexible on which days) Salary : £120,000 - £130,000 + £7,500 car allowance + exceptional bonus & benefits An established, financial services group is on the lookout for a Head of Data Engineering to lead their data platform transformation … smooth delivery and long-term modernization. This is a hands-on leadership role - ideal for someone who thrives in both strategy and delivery. Ideal Candidate: Proven leadership of large data engineering teams (UK and offshore) Deep expertise in SQL Server, and experience migrating to Azure cloud Experience managing third-party partners/vendors Ability to stay hands-on … to mentor teams on technical delivery Background in the banking/financial services sector Strategic mindset with a delivery-focused leadership style Tech Environment: Azure Data Stack (Synapse, Databricks, Azure SQL, Power BI) SQL, Python Legacy systems primarily in SQL Server Interview Process: Initial 30-minute informal converdation 60-minute technical/competency interview with Engineering Managers Final More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a Sr Technology Architect, you … building. You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities . Define the overall data architecture strategy aligned with business transformation goals Design scalable, secure, and integrated data models/assets Define and build Data Modelling and architecture Framework. Ensure data governance, quality, and compliance across all assets Experience developing and deploying data intensive application across multiple projects Involve in Discovery/solution planning discussions to define the solution roadmap. Guide the integration of legacy systems with new data pipelines and reporting/Analytics tools Required Should have minimum 14-15 years of experience in Information Technology with More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a Sr Technology Architect, you … building. You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities . Define the overall data architecture strategy aligned with business transformation goals Design scalable, secure, and integrated data models/assets Define and build Data Modelling and architecture Framework. Ensure data governance, quality, and compliance across all assets Experience developing and deploying data intensive application across multiple projects Involve in Discovery/solution planning discussions to define the solution roadmap. Guide the integration of legacy systems with new data pipelines and reporting/Analytics tools Required Should have minimum 14-15 years of experience in Information Technology with More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a Sr Technology Architect, you … building. You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities . Define the overall data architecture strategy aligned with business transformation goals Design scalable, secure, and integrated data models/assets Define and build Data Modelling and architecture Framework. Ensure data governance, quality, and compliance across all assets Experience developing and deploying data intensive application across multiple projects Involve in Discovery/solution planning discussions to define the solution roadmap. Guide the integration of legacy systems with new data pipelines and reporting/Analytics tools Required Should have minimum 14-15 years of experience in Information Technology with More ❯