1 to 25 of 58 Azure Data Factory Jobs in London

Data Architect - Azure Data Factory – SC Cleared - Part Time - Remote - Inside IR35 Lead the migration of data capabilities from a legacy stack onto a newly delivered Azure Data Factory platform for a major UK public sector programme. You’ll set the target data … a part-time role, offering 3 days per week. Due to the nature of the role, we require candidates with an active SC Clearance. Responsibilities Own the target data architecture (ingest transform serve) and standards/guardrails. Plan and govern migration from Oracle/PL-SQL to Azure (e.g. Azure SQL/T-SQL … including cutover and risk. Define conceptual/logical/physical data models and interfaces. Oversee ETL/ELT in Azure Data Factory , ensuring reliability, observability and cost optimisation. Guide PL/SQL T-SQL conversion, recommending tooling (e.g. SSMA ). Champion DevOps practices (Git/GitHub, CI/CD) and produce clear More ❯

Our Client has a requirement for a Data Engineer , who will be required to work on a contract basis Remote working . Role Purpose: We are seeking an experienced Data Engineer to design, build, and optimize data solutions using the Microsoft technology stack. The role focuses on developing scalable ETL pipelines, data models, and cloud-based solutions leveraging Azure Data Factory, Azure Synapse, Azure SQL, and Azure Functions . The ideal candidate will have a proven background in data engineering, cloud architecture, and enterprise data systems . Job Role Responsibilities: Design and implement robust … ETL pipelines using Azure Data Factory . Develop and maintain data models and warehouses with Azure Synapse and Azure SQL . Build scalable data processing solutions using Azure Functions . Create interactive dashboards and reports with Power BI . Collaborate with business and technical More ❯

that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … re underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure More ❯

Data Engineer - Azure/Microsoft Fabric City of London - Hybrid Working Circa £60k-70k + Bonus & Benefits Our client, a forward-thinking and globally connected staffing & consulting organization is seeking a skilled and driven Data Engineer to join their growing Data & Analytics team. Based in the City of London, this … role presents a fantastic opportunity for someone with 2-3 years of data engineering experience who is passionate about building robust data solutions using Microsoft Azure and Microsoft Fabric technologies. This is a hands-on technical role where you'll work closely with the Lead Data Architect and collaborate across the business … to design, build, and support scalable data infrastructure that powers business intelligence, reporting, and analytics. The ideal candidate will be eager to grow their skills and take ownership of impactful data projects within a fast-paced, modern tech environment. Key Responsibilities: Design, develop, and maintain data pipelines and data warehousing solutions using More ❯

Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Essential Skills & Experience: 10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks. Strong proficiency in Python and Spark (PySpark) or Scala. Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns. Extensive experience with Azure data services, including Azure Data Factory, Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and … data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality and data governance processes. Experience with version control systems (e.g., Git). Experience with Agile development methodologies. Excellent communication, interpersonal, and problem-solving skills. Experience with streaming data More ❯

Company Description Hitachi Solutions Europe is a global Digital, Data and Technology consultancy, Microsoft Gold partner and Cloud Services partner, specialising in end-to-end transformation. As a global consultancy firm working across the private and public sectors, we specialise in Dynamics 365 Business Applications, Power Platform, including Azure, Application Modernisation and Data & Analytics. … practices, ensuring delivery of scalable and efficient solutions. Define high-value business scenarios that can benefit from AI solutions (Machine Learning and Gen AI). Explore and analyse data from various sources and formats using tools such as Microsoft Fabric, Azure Databricks, Azure Synapse Analytics, and Azure Machine Learning Implement data pipelines and workflows to automate and operationalize machine learning solutions using tools such as Azure ML Pipelines, Azure DevOps. Run experiments and monitor performance of machine learning solutions using tools such as Azure Azure ML, and Azure Application Insights. Operationalise and deploy AI solutions, ensuring that coding, security More ❯

Hitachi Solutions Europe is a global Digital, Data and Technology consultancy, Microsoft Gold partner and Cloud Services partner, specialising in end-to-end transformation. As a global consultancy firm working across the private and public sectors, we specialise in Dynamics 365 Business Applications, Power Platform, including Azure, Application Modernisation and Data & Analytics. Our highly … from requirements gathering to solution design and implementation. Define high-value business scenarios that can benefit from AI solutions (Machine Learning and Gen AI). Explore and analyse data from various sources and formats using tools such as Microsoft Fabric, Azure Databricks, Azure Synapse Analytics, and Azure Machine Learning Implement data pipelines and workflows to automate and operationalize machine learning solutions using tools such as Azure ML Pipelines, Azure DevOps. Run experiments and monitor performance of machine learning solutions using tools such as Azure Azure ML, and Azure Application Insights. Operationalise and deploy AI solutions, ensuring that coding, security More ❯

Lead Azure Data Consultant/Engineer Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises in modern data platforms. You’ll be working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Lead Data Engineer , you will be designing and delivering cutting-edge solutions across Azure Data services, Microsoft Fabric, and Databricks. This is a hands … on role where you’ll lead from the front, working on enterprise projects that shape the future of data platforms. What you’ll be doing: Leading the design and implementation of modern data platform solutions for enterprise customers. Building and optimising data pipelines using Azure Data Factory , Microsoft More ❯

Lead Azure Data Consultant/Engineer Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises in modern data platforms. You’ll be working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Lead Data Engineer , you will be designing and delivering cutting-edge solutions across Azure Data services, Microsoft Fabric, and Databricks. This is a hands … on role where you’ll lead from the front, working on enterprise projects that shape the future of data platforms. What you’ll be doing: Leading the design and implementation of modern data platform solutions for enterprise customers. Building and optimising data pipelines using Azure Data Factory , Microsoft More ❯

Lead Azure Data Consultant/Engineer Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises in modern data platforms. You’ll be working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Lead Data Engineer , you will be designing and delivering cutting-edge solutions across Azure Data services, Microsoft Fabric, and Databricks. This is a hands … on role where you’ll lead from the front, working on enterprise projects that shape the future of data platforms. What you’ll be doing: Leading the design and implementation of modern data platform solutions for enterprise customers. Building and optimising data pipelines using Azure Data Factory , Microsoft More ❯

Lead Azure Data Consultant/Engineer Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises in modern data platforms. You’ll be working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Lead Data Engineer , you will be designing and delivering cutting-edge solutions across Azure Data services, Microsoft Fabric, and Databricks. This is a hands … on role where you’ll lead from the front, working on enterprise projects that shape the future of data platforms. What you’ll be doing: Leading the design and implementation of modern data platform solutions for enterprise customers. Building and optimising data pipelines using Azure Data Factory , Microsoft More ❯

This newly created Data Engineer Managers position is an excellent opportunity for a hands-on Senior Data Engineer/Technical Lead/Engineering Team Lead etc looking to move into a management position. The postholder will lead and mentor a team of 3 Data Engineers whilst overseeing data platform development and optimisation. … Our client is a well-established and rapidly growing global ecommerce business with its headquarters based in London. The Data Engineer Manager will play a pivotal role at the heart of our clients data & analytics operation. Having implemented a new MS Fabric based Data platform, the need is now to scale up and meet … the demand to deliver data driven insights and strategies right across the business globally. Therell be a hands-on element to the role as you'll be troubleshooting, doing code reviews, steering the team through deployments and acting as the escalation point for data engineering. This is a hybrid role based in Central/West London More ❯

The role of Lead Data Scientist is a new role that will work across North London Foundation Trust and the postholder will play a key role in leading on the development of a new data science function that will contribute to the delivery of the NLFT Digital Strategy. The postholder will be responsible … for the design, development, testing, deployment and maintenance of machine learning and artificial intelligence models that will be trained on data held in the Partnership's Microsoft Azure data platform. The post-holder will take a lead in the exploratory development of Generative AI models that will include close working with industry and academic … all MS Office products Experience/Knowledge In-depth specialist knowledge of healthcare and life sciences data science and AI development and application. Experience working with Microsoft Azure technologies Extensive experience of performing complex information analysis to support decision making In depth knowledge of current IT development tools and methodologies (programming; relational database design) Strong experience More ❯

Lead Azure Cloud Engineer Location: Hybrid (London-based preferred) Start Date: 06/10 Finish Date: 30/01 SC Clearance: Yes Key Responsibilities Azure Cost Optimisation: Analyse current Azure spend using native tools (Cost Management + Billing, Advisor, etc.) Identify cost inefficiencies and implement strategies such as reserved instances, autoscaling, and workload reallocation … Develop forecasting models and savings plans in collaboration with finance teams Infrastructure Engineering & Automation: Design and deploy scalable Azure infrastructure using Infrastructure as Code (ARM templates, Bicep, Terraform) Build and maintain CI/CD pipelines using Azure DevOps or GitHub Actions Integrate monitoring and alerting via Azure Monitor, Log Analytics, and Application Insights Data Provisioning & Governance: Optimise data pipelines and storage solutions (e.g., Azure Data Factory, Synapse, Blob Storage) for cost and performance Ensure compliance with data governance policies including RBAC, encryption, and audit logging Collaborate with data engineering teams to streamline provisioning and reduce overhead Stakeholder Engagement: Liaise with More ❯

skills and experience, we're looking for people who are innovative, commercial and value the work that they do. Our London office is currently looking for a Senior Data Engineer. The Role The Senior Data Engineer will be responsible for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and … analysis. They play a crucial role in building and managing the data pipelines that enable efficient and reliable data integration, transformation, and delivery for all data users across the enterprise. Key Responsibilities Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and … load it into the appropriate data storage systems Collaborates with data scientists and analysts to optimize models and algorithms for data quality, security, and governance Integrates data from different sources, including databases, data warehouses, APIs, and external systems Ensures data consistency and integrity during the integration process, performing More ❯

Data Services Manager, Must live within 2 hours of London and be able to come in for ad-hoc meetings when required. Primarily home based though. Role 90% management and 10% technical and you will manage a team of 6. Salary £ 80000 - 85000 + good benefits. Expanding financial services client are looking for a Data Services … years and is looking to further develop their management career. Guiding a team of 6 you will be responsible for supporting the day to day operations of the data function, with a focus on leading and mentoring data engineers to deliver high quality, scaleable data solutions. Working across the business with multiple stakeholders you … will design and continually improve data solutions A critical aspect of this role is Data Governance, Data Quality and Data Management practices, ensuring the business meet regulatory obligations and manage risk. You must have therefore worked in a regulated environment, ideally financial services. Accountabilities include - Technical leadership - provide technical leadership for the More ❯

Data Services Manager, Must live within 2 hours of London and be able to come in for ad-hoc meetings when required. Primarily home based with occasional office meetings. Role 90% management and 10% technical and you will manage a team of 6. Salary £ 80000 - 85000 + good benefits. Expanding financial services client are looking for a Data … years and is looking to further develop their management career. Guiding a team of 6 you will be responsible for supporting the day to day operations of the data function, with a focus on leading and mentoring data engineers to deliver high quality, scaleable data solutions. Working across the business with multiple stakeholders you … will design and continually improve data solutions A critical aspect of this role is Data Governance, Data Quality and Data Management practices, ensuring the business meet regulatory obligations and manage risk. Accountabilities include - Technical leadership - provide technical leadership for the high performing data engineering and BI function. Team leadership - manage More ❯

FDM is a global business and technology consultancy seeking a Senior Data Analyst to work for our client within the IT services sector. This is initially a 3-month contract with the potential to extend and will be a fully remote role with occasional travel to London, Edinburgh or Yeovil. Our client is looking for a Senior Data Analyst who will act as a subject matter expert (SME) in technical data delivery. You will lead solution discovery, data modelling, the development of pipelines and visual reporting solutions. You’ll also collaborate closely with data architects, engineers, business analysts, and client stakeholders to shape how data is integrated, transformed … and consumed across the organisation. Responsibilities Design, implement, and manage a repeatable and scalable Data Operations model, integrating data engineering, discovery, modelling, and reporting functions across projects Analyse structured and semi-structured data such as JSON, XML, SQL exports and SAP CDS views to inform data integration strategies, mapping, and solution wireframes More ❯

About The Role FDM is a global business and technology consultancy seeking a Data Architect to work for our client within the public sector. This is initially a 5-month contract with the potential to extend and will be a hybrid role based in any one of the client's offices around England. Our client is seeking a … Data Architect, who will play a critical role in shaping their data infrastructure, ensuring they have scalable, flexible, and sustainable architecture to support their business intelligence, analytics, and operational systems. This role will require close collaboration with stakeholders across the business, from technology and data teams to senior leaders. Responsibilities Lead the design and … including conceptual, logical, and physical modelling Strong expertise in Kimball methodology and dimensional modelling (e.g. star schema design) Experience with modern cloud data platforms, ideally including Microsoft Azure, Databricks, and associated tools (e.g., Azure Data Factory, Azure SQL, Synapse) Familiarity with modern data engineering practices including More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … optimization. Hands-on experience migrating data from Mainframes to AWS, including transformation and validation of legacy formats. Proficiency in reading and processing VSAM data using Copybooks and the Cobrix library. Experience implementing data retention and archival strategies in cloud environments. Strong understanding and practical implementation of Medallion Architecture (Bronze, Silver, Gold layers) for structured More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … optimization. Hands-on experience migrating data from Mainframes to AWS, including transformation and validation of legacy formats. Proficiency in reading and processing VSAM data using Copybooks and the Cobrix library. Experience implementing data retention and archival strategies in cloud environments. Strong understanding and practical implementation of Medallion Architecture (Bronze, Silver, Gold layers) for structured More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … optimization. Hands-on experience migrating data from Mainframes to AWS, including transformation and validation of legacy formats. Proficiency in reading and processing VSAM data using Copybooks and the Cobrix library. Experience implementing data retention and archival strategies in cloud environments. Strong understanding and practical implementation of Medallion Architecture (Bronze, Silver, Gold layers) for structured More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … optimization. Hands-on experience migrating data from Mainframes to AWS, including transformation and validation of legacy formats. Proficiency in reading and processing VSAM data using Copybooks and the Cobrix library. Experience implementing data retention and archival strategies in cloud environments. Strong understanding and practical implementation of Medallion Architecture (Bronze, Silver, Gold layers) for structured More ❯

Contract Role: Data Engineer - Azure Migration Project Location: Hybrid (2 days/week onsite in London) Contract Length: 6 months Day Rate: £450/day (Outside IR35) Start Date: ASAP Sector: Consultancy Overview We are recruiting on behalf of a consultancy client for an experienced Data Engineer to support a strategic data migration project . The role involves migrating legacy data systems to a modern Azure-based architecture, with a focus on performance, scalability, and reliability. Responsibilities Design and implement robust data migration pipelines using Azure Data Factory, Synapse Analytics, and Databricks Develop scalable ETL processes using PySpark … and Python Collaborate with stakeholders to understand legacy data structures and ensure accurate mapping and transformation Ensure data quality, governance, and performance throughout the migration lifecycle Document technical processes and support knowledge transfer to internal teams Required Skills Strong hands-on experience with Azure Data Factory, Synapse, Databricks, PySpark, Python More ❯

Digital Transformation Manager - Low Code Development and Data Engineering - Full time permanent role - Hybrid (West London 3 days a week) - Salary up to £70,000 plus 25 days holiday and travel paid A successful West London business is currently looking for an experienced Digital Transformation Manager to join its IT function. This exciting new role will focus on … the design and development of low code applications as well as data warehouses/pipelines. Duties will include: - Leading on the design and implementation of low-code applications across the Microsoft Power Platform - Improving efficiency through automating solutions - Driving AI strategy - Oversee system enhancements and API integrations - Oversee data engineering process - ETL/ELT pipelines with … Azure Data Factory - Drive development of Snowflake Data Warehouse - Team management and leading Data Engineers/Developers - Digital roadmap development - IT projects To be considered suitable you will need the following skills/experience: - Experience of development with the Microsoft Power Platform - Knowledge of Azure Data More ❯