1 to 25 of 26 Azure Data Factory Jobs in London

Azure Databricks Data Engineer - UK Wide - Hybrid Salary: £85,000 - £95,000 - Bonus + Pension + Private Healthcare Location: London/UK Wide Location - Hybrid working The Role: As a Databricks Data Engineer with an Azure focus, you will be an integral … part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations. Your Role Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Develop and maintain secure data more »

An industry-leading insights organisation are looking for a Data Architect who is well-versed in Microsoft SQL Server, Data Lake technologies, and has experience implementing solutions around Azure including Databricks, as they look to strengthen and build upon their modern data … with 2 days per week in their Central London office to collaborate with the wider team, and 3 days working from home. With data being absolutely central to their service offering, they're now aiming to expand their efforts into advanced data analytics, and are looking … for a Data Architect to play a vital role in the design and development of their future data-estate. Working within their Architecture team, and collaborating with the Data Engineering team, the focus of your role will be designing and implementing effective solutions to more »

An industry-leading insights organisation are looking for a Data Architect who is well-versed in Microsoft SQL Server, Data Lake technologies, and has experience implementing solutions around Azure including Databricks, as they look to strengthen and build upon their modern data … with 2 days per week in their Central London office to collaborate with the wider team, and 3 days working from home. With data being absolutely central to their service offering, they're now aiming to expand their efforts into advanced data analytics, and are looking … for a Data Architect to play a vital role in the design and development of their future data-estate. Working within their Architecture team, and collaborating with the Data Engineering team, the focus of your role will be designing and implementing effective solutions to more »

An industry-leading insights organisation are looking for a Data Architect who is well-versed in Microsoft SQL Server, Data Lake technologies, and has experience implementing solutions around Azure including Databricks, as they look to strengthen and build upon their modern data … with 2 days per week in their Central London office to collaborate with the wider team, and 3 days working from home. With data being absolutely central to their service offering, they're now aiming to expand their efforts into advanced data analytics, and are looking … for a Data Architect to play a vital role in the design and development of their future data-estate. Working within their Architecture team, and collaborating with the Data Engineering team, the focus of your role will be designing and implementing effective solutions to more »

Data Engineer Role Overview: As a vital member of the team, the Data Engineer will be responsible for managing and optimising diverse data sets from various systems, extracting valuable business insights. This role involves developing raw data pipelines and using Azure … Cloud tools to ensure seamless integration and optimisation. The candidate will also play a key role in migrating on-premises databases to the Azure Cloud, utilising their expertise in cloud architecture, database management, and change management to ensure a smooth transition for stakeholders. Responsibilities: Data Architecture … Develop, build, test, and maintain data architectures within large-scale data processing systems. Cloud Migration: Migrate existing on-premises databases to the Azure Cloud. Pipeline Management: Develop and manage data pipelines using Azure Data Factory, Delta more »

to further utilise modern technologies and methods. The post-holder will be expected to work closely with all members of the digital team, data engineering team, and other key stakeholders, providing dynamic and creative support within the teams, as well as, for the wider organisation. This is an … team, utilising cloud technology platforms and modern development tools. The post-holder will serve as a senior member of the Digital, Information and data Warehousing departments, taking responsibility for designing, building, maintaining and optimising data infrastructures, creating pipelines which collate data from multiple sources … making it available for analysis by other stakeholders Main duties of the job o To contribute towards continual improvements to the Trust's Azure based Data engineering environment o Contribute towards aspects of Data engineering solution designs, SQL code, and the overall cloud architecture more »

Bromcom is looking for a passionate Senior Database Team Leader to lead our team of developers and navigate the exciting world of data! About the Role: In this hands-on leadership role, you'll leverage your expertise in Microsoft SQL Server to manage a team, troubleshoot complex database … issues, and guide migration strategies. You'll be instrumental in ensuring optimal database performance and keeping our data pipelines flowing smoothly. Key Responsibilities: Provide leadership and mentorship to a team of database developers Review and provide constructive feedback on SQL code Troubleshoot and resolve database deployment and performance … challenges Develop and implement comprehensive database migration strategies Design and configure data pipelines using Azure Data Factory and Azure Pipelines Fine-tune SQL Server performance for optimal efficiency You're a Perfect Fit If You Have: Extensive experience in Microsoft more »

Senior Azure/Databricks Data Engineer c£90k + car allowance - (1-2 days in the office a month) - London no sponsorship provided - applicants will need to be a British Citizen or have ILR status. We're working with a global organisation who have grown rapidly … and are expecting to double in size, mainly through M&A over the next 2 years, and are looking to recruit a Senior Azure Databricks Engineer. Reporting to the Group Director of Data and Architecture you'll play a key role in the Azure Databricks platform capability build-out and operation. You'll play a key role in designing, developing and managing data ingestion processes and transformation pipelines within Azure and Databricks environments and you'll create well-defined and governed data consumption models, adopting a more »

Data Architect La Fosse are partnered with a research & insights firm to recruit a Data Architect to support the company's growth. The successful candidate will craft, refine, and manage data systems and models, ensuring they align with the strategic vision, while prioritizing security … regulatory compliance. This individual will join a small architecture team (currently have a Solution and Technical Architect) and work closely with the wider data engineering team, in addition to engaging with senior CxO level stakeholders including the COO and CTO. Main Duties and Responsibilities: Design and implement database … solutions, including Data Lakes and Warehousing. Design data models and flowcharts. Ensure systems align with data architecture designs. Document and manage the current data platform landscape. Set the technical direction for the data platform. Ensure effective delivery of data more »

Our client who is a house hold UK name branded business are urgently looking for a Data Engineering manager to lead a small team of Azure data engineers. Responsibilities: Manage a team of data engineers. (must have managed before, not looking for … senior data engineers looking to make the next step. Oversee the design, development, and maintenance of data pipelines. Collaborate with cross-functional teams to ensure data quality and availability. Lead projects related to data integration, transformation, and storage. Implement best practices for … data engineering processes. Requirements: Previous experience managing a team of data engineers. Proficiency in Azure (including services like Azure Data Factory, Azure Databricks, etc.). Strong programming skills in Python and SQL Familiarity with data more »

Data Analyst – IT Data Analyst – IT – Our niche client is looking for a Data Analyst to join their small but motivated team to help enhance their systems. You will be involved with project migration and business-critical upgrades. You must have experience with Azure Data Factory – Google Cloud – Airflow, along with SQL and ETL experience. This could be a great career move with personal development plans to grow your career. You will require a blend of the following: - Strong SQL Query experience Knowledge of Azure Data Factory is desirable Python Development knowledge Knowledge of Apache Airflow. Experience with enterprise DBMS and, ideally, Google BigQuery. Experience in Google Cloud Platform services. Any knowledge of Power BI and Tableau is useful. In return, our client offers a competitive salary, hybrid working and the following more »

Data Scientist London Hybrid Excellent salary + Bonus + Career Development Overview An exciting opportunity has arisen with a global insurance company for a Data Scientist (Machine Learning). You will develop cutting edge solutions that put analytics at the heart of decision-making. You will … you will extend the capacity to deliver and push the team forward. Role & Responsibilities Lead Orchestration of real-time predictive analytic solutions leveraging Azure Data Factory, Function Apps and other tools Manage deployments of real time analytics services Use SQL, Python and Snowflake to … understand underlying data, and suggest improvements for performance and best practices Lead collaboration with project stakeholders and other developers Manage code development and deployment using Azure Data Factory, VS Code and GitHub Contribute and promote evolving best practices Document and manage technical more »

you will extend the capacity to deliver and push the team forward. Role & Responsibilities Lead Orchestration of real-time predictive analytic solutions leveraging Azure Data Factory, Function Apps and other tools Manage deployments of real time analytics services Use SQL, Python and Snowflake to … understand underlying data, and suggest improvements for performance and best practices Lead collaboration with project stakeholders and other developers Manage code development and deployment using Azure Data Factory, VS Code and GitHub Contribute and promote evolving best practices Document and manage technical … workflows and implementation processes Essential skills and experience 2+ years of leading data/implementation engineering projects 2+ years of Python development experience 2+ years of API development experience Demonstrated experience building data structures to support analytics/research/actuarial functions in an insurance company more »

of high quality, efficient and effective solutions in Microsoft SQL Server T-SQL and related tools to support and extend various large-scale data migration projects. Provide database performance-tuning expertise for internal and third-party systems in SQL Server. Provide technical knowhow on projects and work with … third parties to understand how their software works to support data migration. Job requirements Responsibilities will include designing, developing, and maintaining appropriately scaled, effective solutions to support data cleansing, migration and reconciliation activity in Microsoft SQL Server T-SQL and related tools. Defining technical requirements, working … with non-technical members of the Data Migration Team. The role requires you to manage MS SQL Server database environments that support data migration and backups and recoveries in test environments. Demonstrating a logical and structured approach to time management and task prioritisation. Working within project more »

hands-on talented background in trouble shooting database deployment and performance issues > have extensive experience in database migration strategies > have good knowledge on Azure data factory and Azure pipelines. > hands-on talented experience in performance tuning of SQL Server Desirable skills: > Azure data bricks > Data warehousing and SSIS reports We are happy to consider a person who is a hands-on talented Senior Database engineer and is looking to move on to the next stage in their career. We have a hybrid environment. We work in more »

low-code and ideally pro-code developer with significant MS PowerApps experience . Microsoft Power Platform MS Fabric MS PowerApps Microsoft Power Automate Data Warehousing Microsoft - SQL Server Microsoft - SQL Server Management Studio (SSMS) MS Azure - SQL Database Desirable Qualifications Dual qualification (software development and civil … sector experience, degree qualified Civil Engineer. Useful skills to have: Python, PHP, PostgreSQL, Java, C#.net, Microsoft PowerBI, Microsoft - Visual Studio, Microsoft SharePoint, MS Azure - Data Factory, MS Azure Synapse, MS Azure DataBricks, MS Azure DevOps, PowerShell, MS Azure - Logic Apps, MS AI Builder/Azure ML more »

low-code and ideally pro-code developer with significant MS PowerApps experience . Microsoft Power Platform MS Fabric MS PowerApps Microsoft Power Automate Data Warehousing Microsoft - SQL Server Microsoft - SQL Server Management Studio (SSMS) MS Azure - SQL Database Desirable Qualifications Dual qualification (software development and civil … sector experience, Degree qualified Civil Engineer. Useful skills to have: Python, PHP, PostgreSQL, Java, C#.net, Microsoft - PowerBI, Microsoft - Visual Studio, Microsoft - SharePoint, MS Azure - Data Factory, MS Azure - Synapse, MS Azure - DataBricks, MS Azure - DevOps, PowerShell, MS Azure - Logic Apps, MS AI Builder/Azure ML more »

About the roleA Payments FinTech are currently seeking a Data Engineering Lead (Python, Hadoop & SQL) to lead and mentor a talented team of data engineers and scientists as they look to simplify the bank through developing innovative data driven solutions, allowing them to be … ideal candidate will work in autonomous, cross functional teams entrusted with business-critical platforms.Desirable skills & experienceWorking to an Agile methodology and familiarity with Azure DevOpsDeep automation knowledge with PythonSkilled in Pyspark and SynapseExperience with data modelling and visualisation in Power BI (or alternative)A strong understanding … of architecting data platforms, BI, MI, or analytics solutionsStrong experience using Azure Data Lake, Azure Data FactoryDeliver the automation data pipelines and building of a scalable data architecture. more »

ML Ops Engineer - MS Azure London - Flexible Working Salary negotiable dep on experience between £30,000 - £45,000 J12808 An exciting opportunity has arisen within a Data Consultancy for a MS Azure ML Ops Engineer. You will play a vital role in delivering operational … scalable data and AL solutions, giving technical guidance across a variety of projects. As an ML Ops Engineer, you will be a self-starter, keen to further develop your technical and consultancy experience with a rewarding and collaborative environment. Responsibilities: Design, implement and maintain the ML platform and … Support the growth of our dynamic boutique consultancy across a wide variety of areas Requirements: Experience building ML and AI production solutions on Microsoft Azure preferably with certifications Proficiency in Python and SQL Spark engines (e.g. Databricks or Microsoft Fabric) Orchestration tools (Azure Data more »

Leading Financial Services client in London is now seeking an experienced Data Platform Manager to join on a permanent basis. This role is offering a base of £90,000 + a strong benefits package and very flexible working. The ideal Data Platform Manager will enjoy being … hands on and takes a very pragmatic approach to Data Platform Management. They must understand Operations, know how to maintain platform stability, control costs, add true value, have good knowledge in contingency planning, be very process minded and knows what matters most when running the Data Platform function. To be considered for this role you will need the following: Experience running Data Platforms and managing teams Experience with Snowflake engineering - SQL scripting DDL and DML, task orchestration and integration management. Knowledge of Snowflake administration - RBAC, warehouse provision, cost management, time-travel and more »

Leading Financial Services client in London is now seeking an experienced Data Warehouse Manager on a permanent basis. The role is offering a base of £85,000 + a strong benefits package and very flexible working. The ideal Data Warehouse Manager will enjoy taking a very … pragmatic approach to Data Management and knows what good looks like. They must understand Operations, know how to maintain platform stability, control costs, have good knowledge in contingency planning, be very process minded and knows what matters most when running the Data Platform. To be considered … for this role you will need the following: Experience running Data Platforms and managing teams Extensive experience in data warehousing, ETL processes, and database management Strong background in developing ETL processes Familiarity with SSIS and Azure Data Factory (ADF) Has more »

The Database Administrator Role : As our Database Administrator, you will beresponsible for managing, optimising, and securing our critical databases in both on premises & Microsoft Azure cloud environments. You will play a key role in ensuring the performance, scalability, and availability of our databases so that our clients' experience … Thrive in an agile team Must-Have Skills: We are looking for the following skills: Minimum 3-5 years of experience working with Azure SQL. Provision, configure, and manage Azure SQL (managed instances and databases). Implement and maintain high availability and disaster recovery solutions for … Azure SQL databases. Knowledge of backup and recovery processes, including point-in-time recovery. Monitor and optimize database performance using Azure monitoring tools. Proficiency in T-SQL programming and stored procedures. Ability to create advanced reports using Power BI. Experience with data lakes and more »

Key programming languages: Proven hands on experience in writing complex SQL scripts, powershell scripting Tools: Good proven technical hands-on skills in a) Azure cloud (Storage accounts, logic app, Azure data factory, SQL DB, key vault, Azure API management) or … tool Experience in supporting mobile/website applications Basic understanding of service operations (Incident, problem management, change management, event management) Good understanding of data warehousing concepts Devops tools Understanding to perform deployment operations Knowledge about Messaging queue systems (rabbit MQ or any other tool), azure service more »

Key programming languages: Proven hands on experience in writing complex SQL scripts, powershell scripting Tools: Good proven technical hands-on skills in a) Azure cloud (Storage accounts, logic app, Azure data factory, SQL DB, key vault, Azure API management) or … tool Experience in supporting mobile/website applications Basic understanding of service operations (Incident, problem management, change management, event management) Good understanding of data warehousing concepts Devops tools Understanding to perform deployment operations Knowledge about Messaging queue systems (rabbit MQ or any other tool), azure service more »

Agile best practices and working within the SAFe Agile framework You will also have the following technical and architectural skills: Strong skills in data technologies such as Microsoft Fabric including Azure Data Factory and Blob Storage, Synapse, Power BI) Knowledge of cloud … It is an urgent contract role, so please apply without delay for a chance to speak to the client! Key words: "Solution Architect", Azure, ASP.Net, Node JS, APIs, Salesforce, Dynamics 365, "Power Platform", TOGAF, ITIL, Agile, SAFe If you are interested in this position please click 'apply'. more »