76 to 100 of 100 Azure Data Factory Jobs in London

Leading Financial Services client is currently going through a large Data transformation and is looking for Data Solution Manager to join them on this exciting journey. The roles are offering a base between £80,0000 to £85,000pa + a strong benefits package and flexible working. … One day in office in every 3 months in East Sussex As a Data Solution Manager you will report to our Head of Data Delivery and lead a small team of some of the best engineers in the industry to deliver, improve and maintain robust data pipelines within our ambitious data architecture. Requirements: You will have a strong background in data engineering, with experience in managing and mentoring other engineers. You should have significant experience with Snowflake and Microsoft Azure, particularly Azure Data Factory More ❯

demonstrated. Your expertise must include design and development experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to MSFT suites, Azure tools, integration, and data. Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Experience with healthcare industry … regulations, data security and compliance standards (e.g. GDPR), and EDI standards (e.g. FHIR, HL7) is very valuable. Developer certifications of Azure and/or Microsoft suite technologies is a big plus. A degree in computer science, software engineering, or a related field is required. Technical skills … Office/MS Office 365 suite, SharePoint Online, Power Apps/Power Automate, GitHub, MS Teams, etc. In-depth knowledge & development experience using Azure integration tools like Data Factory, Logic Apps, along with knowledge of utilizing Azure SQL Server, Data More ❯

Data Engineer - Leading Energy Company - London (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) Company Overview: Join a dynamic team, a leading player in the energy sector, committed to innovation and sustainable solutions. Our client is seeking a talented … Data Engineer to help build and optimise our data infrastructure, enabling them to harness the power of data-driven insights to drive our business forward. Responsibilities: Design and develop a cutting-edge data warehouse capable of efficiently ingesting and organising large volumes … of data from multiple sources. Champion best practices in data architecture governance, ensuring compliance with security and privacy regulations. Implement automated, scalable data migration processes across various project phases. Conduct rigorous data quality assessments, employing cleansing and validation techniques as needed. Construct More ❯

A well respected Insurance firm is looking to hire a Data Science Manager to be responsible for defining the strategic data requirements for delivery of data consumption use cases. You will be comfortable interacting with all front-line underwriters, data engineers and … of automated, optimised and highly effective analytics solutions. This all-round knowledge will be key to ensure effective communication and collaboration with the Data Analytics and Actuarial teams. You will also need to contribute to management and board level reports and demonstrate strong team management skills. KEY REQUIREMENTS … Have strong management track record Have proven stakeholder management including engagement with technical experts and senior management Be an expert in data science techniques Advanced programming skills (Python an advantage) Strong statistical, data manipulation and data analysis skills Strong academic background Experience in dealing More ❯

Data Science Manager London (Lloyd's Market) About the Company Our client is a high-performing, diversified insurer operating in the Lloyd's market. Known for strong underwriting performance and a collaborative culture, they are a long-term, solution-driven partner to brokers and clients worldwide. They offer … where empowered decision-making, innovation, and mutual success are at the heart of their business. About the Role We're looking for a Data Science Manager to lead the development and integration of machine learning and advanced analytics solutions that support underwriting, risk selection, pricing, and automation. This … role will drive key data science initiatives including algorithmic risk ranking, profitability analysis, pricing model enhancement, and digital rule-based trading strategies. The ideal candidate will collaborate closely with underwriters, actuaries, data engineers, and senior stakeholders to translate data into action and insights. Key More ❯

Clarksons, visit us at www.clarksons.com Role Summary As part of the Digital Transformation team, you will be helping us build the best shipping data platform and reporting, enabling us to provide accurate and timely insights to the business and our clients. We’ve been building out a central … data platform for the last year and have proved its worth. We are now looking for an individual to help scale the platform and accelerate its roll out across the business. What you’ll be doing Work with data engineers & analysts to problem solve, build & deliver … data products from ideation to production. Lead and own the full lifecycle of data engineering deliverables. Deliver complex data flows to process external data sources to provide the company with a competitive edge. Act as a consultant to the business to meet More ❯

Clarksons, visit us at www.clarksons.com Role Summary As part of the Digital Transformation team, you will be helping us build the best shipping data platform and reporting, enabling us to provide accurate and timely insights to the business and our clients. We’ve been building out a central … data platform for the last year and have proved its worth. We are now looking for an individual to help scale the platform and accelerate its roll out across the business. What you’ll be doing Work with data engineers & analysts to problem solve, build & deliver … data products from ideation to production. Lead and own the full lifecycle of data engineering deliverables. Deliver complex data flows to process external data sources to provide the company with a competitive edge. Act as a consultant to the business to meet More ❯

aiding Governments, Nations and Societies to defend themselves in an ever-evolving world of cyber crime. We are currently looking for an experienced Data Engineer to join us in helping a crucial public sector client in carrying out a full POC solution transformation. The Ideal Data Engineer will have; Full eligibility for SC Clearance. Demonstrable experience with Azure Data Factory, showcasing ability in creating dimensions incrementally, reducing processing and data needs. Knowledge in changing authentication methods between ADF and SQL Server to use either a managed … identity or service principal. Expertise in Azure SQL, including transitioning data processing from PowerBI to Azure SQL. Data Engineer key details: Up to £55k salary Performance bonus. Based out of London office. Flexible hybrid working. Must be eligible for SC, or higher More ❯

aiding Governments, Nations and Societies to defend themselves in an ever-evolving world of cyber crime. We are currently looking for an experienced Data Engineer to join us in helping a crucial public sector client in carrying out a full POC solution transformation. The Ideal Data Engineer will have; Full eligibility for SC Clearance. Demonstrable experience with Azure Data Factory, showcasing ability in creating dimensions incrementally, reducing processing and data needs. Knowledge in changing authentication methods between ADF and SQL Server to use either a managed … identity or service principal. Expertise in Azure SQL, including transitioning data processing from PowerBI to Azure SQL. Data Engineer key details: Up to £55k salary Performance bonus. Based out of London office. Flexible hybrid working. Must be eligible for SC, or higher More ❯

often (in days) to receive an alert: As part of the Digital Transformation team, you will be helping us build the best shipping data platform and reporting, enabling us to provide accurate and timely insights to the business and our clients. We've been building out a central … data platform for the last year and have proved its worth. We are now looking for an individual to help scale the platform and accelerate its roll out across the business. What you'll be doing Work with data engineers & analysts to problem solve, build & deliver … data products from ideation to production. Lead and own the full lifecycle of data engineering deliverables. Deliver complex data flows to process external data sources to provide the company with a competitive edge. Act as a consultant to the business to meet More ❯

create modern systems by using Microsoft Fabric Act as a consultant, understanding the client requirements and deliver the best solutions. Building and optimising data pipelines. Debugging issues Keep costs under control Skills Microsoft Fabric - Lakehouse and warehouse models Azure Tools (Data Factory, Synapse, SQL) Python experience for programming Databases, SQL and NoSQL (CosmosDB, KQL) Data Modelling: Kimball frameworks and 3NF Nice To Have Databricks Power BI AI/ML Azure Infrastructure DevOps Certifications Microsfot certified: fabric Analytics Engineer Associate DP-203 Azure data Engineering AZ-305 Azure Solutions Architect. If this sounds like you then please get in touch and apply. More ❯

Senior .NET Core Developer (Core 6/8, IBM MQ, Rabbit MQ or similar AZURE) - Brussels Location Duration: 6-12 months Rate: Flexible 2 days onsite in the office per week - the rest can be remote (Mandatory) You will be part of an Agile team based in London … Nuget Back-end: .NET Core 6+8, C# Java 8 and above, Spring Boot Messaging technologies, IBM MQ, Rabbit MQ or similar Entity Framework Azure services such as Logic Apps, Azure Functions, APIM, Entra ID, AKS RESTful API experience. Microservice design (Azure Function, Azure Web App) Azure SQL Server, package integration + Toolchain setup experience + stub design & development Knowledge of Splunk, WCF, Azure Data Factory, Kafka, Java, OAuth is a plus. Located in offices in a variety of vibrant European cities, we will More ❯

users (trade entry, exchange interfaces, STP, etc) Designing new bespoke views Customising Trading System user interface using ClassEvents (C#.NET) Modifying the Trading System data model directly in the SQLServer database Enhancing test automation and ability to unit test custom code Developing customised applications (APIs, loaders, reports, data pipelines, BI tools) Quickly acquiring new technical skills (Azure IaaS/PaaS, Crystal Reports, Python, Azure Databricks, Azure Data Factory, Power BI, etc.) Requirements of the Senior Developer (ETRM) Proven experience within trading environments (hedge funds, investment banks More ❯

users (trade entry, exchange interfaces, STP, etc) Designing new bespoke views Customising Trading System user interface using ClassEvents (C#.NET) Modifying the Trading System data model directly in the SQLServer database Enhancing test automation and ability to unit test custom code Developing customised applications (APIs, loaders, reports, data pipelines, BI tools) Quickly acquiring new technical skills (Azure IaaS/PaaS, Crystal Reports, Python, Azure Databricks, Azure Data Factory, Power BI, etc.) Requirements of the Senior Developer (ETRM) Proven experience within trading environments (hedge funds, investment banks More ❯

The ideal candidate should have expertise in designing and developing with various Microsoft platforms, tools, technologies, patterns, and techniques related to MSFT suites, Azure, integration, and data management. Experience in industries such as pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Knowledge of healthcare … industry regulations, data security, compliance standards (e.g., GDPR), and EDI standards (e.g., FHIR, HL7) is highly valuable. Certifications in Azure and/or Microsoft suite technologies are a significant plus. A degree in computer science, software engineering, or a related field is required. Technical Skills Deep … configuration, and integration with MS Office/MS Office 365, SharePoint Online, Power Apps/Power Automate, GitHub, MS Teams, etc. Experience with Azure integration tools like Data Factory, Logic Apps, and utilizing Azure SQL Server, Data Lake, etc. Proficiency More ❯

A large utility client is seeking a highly skilled Senior Data Engineer to join their European Trading team. This role involves leading and participating in the design, development, testing, implementation, and maintenance of data-driven software solutions. The ideal candidate will possess expert-level knowledge of … Python, C#, .NET, Databricks, and Azure, ensuring alignment with business objectives. They will identify and champion innovation in technology and processes to unlock new commercial opportunities. Collaborating closely with the trading team, the Senior Data Engineer will shape quantitative strategies and ensure data/… with minimal guidance, exercising broad latitude in decision-making. Key responsibilities include migrating an existing Python-based reporting/analytics application and its data workflows from Azure SQL to Databricks, creating and optimizing data pipelines in Databricks, and leveraging scheduling, job orchestration, and optionally More ❯

A large utility client is seeking a highly skilled Senior Data Engineer to join their European Trading team. This role involves leading and participating in the design, development, testing, implementation, and maintenance of data-driven software solutions. The ideal candidate will possess expert-level knowledge of … Python, C#, .NET, Databricks, and Azure, ensuring alignment with business objectives. They will identify and champion innovation in technology and processes to unlock new commercial opportunities. Collaborating closely with the trading team, the Senior Data Engineer will shape quantitative strategies and ensure data/… with minimal guidance, exercising broad latitude in decision-making. Key responsibilities include migrating an existing Python-based reporting/analytics application and its data workflows from Azure SQL to Databricks, creating and optimizing data pipelines in Databricks, and leveraging scheduling, job orchestration, and optionally More ❯

Responsibilities: Oversee data and software testers, including offshore resources. Ensure testing team has the tools/access required. Ensure assigned work is completed as scheduled. Outline end-to-end test strategy ensuring execution for data pipelines across different layers of medallion architecture ensuring accuracy and compliance … with validation strategies. Be the contact for all testing within program business: works directly with project manager and agile team. Perform in-depth data analysis to gather and validate business requirement and contribute to effective target to source mapping including traceability matrix. Ensure test case execution and analyse … test data to improve pipelines including data governance. Assign and follow up on tickets assigned to other data testers. Identify process improvement opportunities and operationalize solutions for same. Follow established guidelines and processes for project methodologies - MR Essentials and ensure compliance with necessary IT More ❯

with Microsoft Dynamics 365, specializing in developing Power Pages, Power Apps, and Dataverse-based solutions, with a strong understanding of Dataverse application and data structures. Confident in creating and managing solution CI/CD pipelines using Azure DevOps. Extensive experience in customizing Dynamics 365, with a … and user experience. Knowledge of end-to-end connectivity (network/proxy) between devices and cloud services to support seamless integration. Understanding of Azure security principles and best practices to ensure compliance and data protection. Strong attention to detail and a customer-focused approach to solution … delivery. Microsoft certifications related to Dynamics 365, Power Platform, or Azure are highly valued. Experience with Azure Data Factory and MS Fabric is an advantage. Competencies & Aptitude: Fast learner with the ability to quickly adapt to new technologies and implement solutions effectively. More ❯

Modelling & Storage Relational (PostgreSQL, SQL Server), NoSQL (MongoDB, Cassandra), Dimensional modelling. DevOps & Automation Docker, Kubernetes, Terraform, CI/CD pipelines for data flows. Architectural Competencies Data Modelling: Designing dimensional, relational, and Document data lineage and recommend improvements for data ownership and stewardship. … Qualifications Programming: Python, SQL, Scala, Java. Big Data: Apache Spark, Hadoop, Databricks, Snowflake, etc. Cloud: AWS (Glue, Redshift), Azure (Synapse, Data Factory More ❯

the design and development of a highly available, low latency Event Driven platform as well as deploying Microservice APIs. Experience needed: C# .Net Azure/AWS Azure Suite - Data Factory, Event Hubs, Bicep, Cognitive etc. Message brokers - Kafka, RabbitMQ etc. Please apply More ❯

Transact-SQL/MS SQL Server, Visual Studio 2015+ Proficiency in writing SQL, stored procedures (e.g. PL/SQL code) and working with data in relational databases like DB2, SQL Server Experience with MS SQL SSIS/SSRS Experience with use and configuration of Application Monitoring tools Client … Basic understanding of application design and application security concepts Experience of software development on a Microsoft technology stack Basic insurance knowledge Experience supporting Azure-based applications and familiarity with Azure Monitor, Data Factory and Logic Apps Familiarity with Microsoft Cloud technologies - Power More ❯

Senior Data Engineer SC Clearance Needed Outside IR35 Remote London £550 p/d Key Responsibilities: Migrate data, transform and model into ETL pipelines. Key Technical Skills Necessary: Azure AWS Synapse Data Factory SQL DBT You need active SC Clearance More ❯

Job Title: Senior Data Engineer Location: London - twice a week Salary/Rate: Up to £549 a day Inside IR35 Start Date: April Job Type: 6 month contract (with scope to extend) Company Introduction We are looking for a Senior Data Engineer to join our client … in the Culture and Sports industry. Our client is looking for an SME/Consultant with hands-on experience in Azure Service Bus and heavy DB architecture experience who can take a lead in developing a near real time ingestion framework. Job Responsibilities/Objectives Undertake system design … within a project. Work closely with offshore developers, assuring their work meets the required quality and best practice. Experience in message-based integration - Azure Service Bus. Design, develop and maintain MS SQL Server relational databases with change tracking/CDC. Keep multiple applications in sync - real time/ More ❯

. ExperiencewithperformancemonitoringtoolssuchasAzureMonitor,AppInsights,Prometheus,Grafana,orSolarWinds. FamiliaritywithAzureNetworking,includingHub&Spoketopology. Experiencewithnetworkandfirewallconfiguration(AzureFirewall,ApplicationGateway,etc.). Asolidunderstandingofnetworkanddatasecurityprinciples. KnowledgeofITILv3processes,ideallywithcertifications. ExperiencewithServiceManagementprocesses(Incident,Problem,ChangeManagement). DesirableknowledgeofAzureDataServices(e.g.,AzureDataFactory,AzureSynapse). FamiliaritywithDevOpsconceptslikecontinuousintegration,continuousdeployment,andinfrastructureascode. EducationalRequirements: ABScorMaster'sdegreeinComputerScience/IT(2:1oraboveforBSc,MeritforMaster's). IfyouhaveapassionforMicrosoftAzuretechnologiesandadesiretomakeapositiveimpactinthehealthcaresector,wewouldlovetohearfromyou More ❯