101 to 125 of 142 Permanent Azure Data Factory Jobs

infrastructure investments. Be part of a dynamic team driving growth and maximizing value in the alternative asset management industry. Key Responsibilities: Support the Data Team Lead in system updates. Develop, modify, and maintain software components. Resolve data/software issues and suggest technical solutions. Collaborate with … Conduct peer reviews and offer technical guidance. Identify process improvements and adhere to IT policies. Essential Technical Skills: 2-3 years' experience in Azure data systems. Proficiency in Data Warehouse technologies and SQL. Familiarity with Azure services like Data Lake … and Data Factory. Essential Experience: Supporting traditional Data Warehouses. Building Azure data pipelines and data lakes. Agile development experience. Strong problem-solving skills. Awareness of industry trends and stakeholder interaction. Desired Experience: Familiarity with Business Objects Reporting and Power BI. more »

Senior Data Engineering Lead - Analytics & Infrastructure Financial Services £120,000 + 20% Bonus 3 days in the office per week (Central London) A leading global financial service firm is on a transformative journey to become the benchmark for quality across all its insurance markets. Leveraging a state-of … the-art Data and Analytics strategy, we are redefining client intimacy and decision-making accuracy through a unified data ecosystem. As the Chapter Lead for Data Engineering, you will spearhead the creation and implementation of a comprehensive data strategy that empowers our … business users across the globe. Your role is crucial in turning complex data into actionable insights and ensuring data assets are robust, reliable, and ready for strategic use. Key Responsibilities: Develop and execute data strategies in alignment with the company's goals. Lead the more »

Data Engineer | Yorkshire | up to £45,000 basic | Flexible Working A regular feature in the "UK's Top 10 places to work", my client is an award-winning business with a reputable brand and is widely respected for investing in their employees, placing importance on personal development and … career progression. The Environment you'll be joining: You'll join a friendly 10+ Data Engineering team as the business undergoes a complete greenfield re-architecture from the ground up in Microsoft Azure. The Tech you'll be playing with: Azure Data Factory Azure Databricks PySpark SQL DBT What you need to bring: 1-3 year's experience in building Data Pipelines SQL experience in data warehousing Python experience would be desirable Experience in Azure/GCP/AWS is a bonus Why more »

promotion that seen the Head of Engineering promoted into the CTO role there’s an opportunity to join the business as the Lead Data Engineer. Working hand in hand with the CTO you will play an instrumental part in shaping and leading the Data Engineering function … used on those days. This is a rare opportunity to work with a well liked and respected CTO and a great business. Lead Data Engineer £80k-£90k Hybrid working 2 days in Glasgow office a week Your New Role: Platform Development: Build the foundations of the new data platform, leveraging extensive business data for both automation and analytics. Pipeline Design: Create and develop data processing pipelines to support the ingestion, enrichment, and quality control of client and partner data. Data Warehouse Design: Design and develop a data warehouse more »

Senior Data Engineer | Full Time | On-Site | Python | SQL | DataBricks| Azure| As a Senior Data Engineer, you will play a key technical role in design, implementation, and continuous refinement of data pipelines and architectures within Microsoft’s Azure ecosystem. This … role involves leveraging Azure’s diverse data services, such as Data Factory, Databricks, Azure SQL and Synapse Analytics, among others, to build scalable and secure data solutions that support complex onward processing by both operational and analytical teams. … What will this role look like? - Develop and maintain scalable, efficient, and robust data architectures. This involves creating 3NF and dimensional data models, designing and developing robust batch processing pipelines, and working with the operational and analytical teams to solve complex business problems. - Monitor system performance more »

and insurance businesses, we’re a fast-growing division with big, customer-centred ambitions. Job Description Legal and General Retail’s Group Protection Data team are currently hiring for a Data Engineer as they begin the journey of delivering a new, modernised data platform … the business to gather requirements, working with the team to identify potential tools and through the migration on to a centralised platform consolidate data sources. What you'll be doing: Contributing towards improvements to database systems and linking the understanding of source data to value-adding … data engineering solutions (across storage, transformation, and data quality) Continuously developing processes so that deliverables are created in the most efficient way to improve performance, ensuring code is scalable, portable, and reusable, ensuring timely and accurate delivery of data solutions to the business Developing more »

Data Engineer - Databricks - Power BI - London - Up to £75k My client is a multinational organisation who is a leader within their industry. Their projects which have been secured and completed are some of the most impressive projects and put them so far ahead of their competitors. If you … business, put this down to not just their skilled work force but also their head office support team. This role is for a Data Engineer/BI developer who wants to continue to excel using the latest Data technologies. The role is primarily focused around building … then also created some awesome dashboards and reports using Power BI. The successful applicants will be helping to really utilise the power of data to help them across a range of projects. This ranges from internal projects to improve the business but also, external projects that lead to more »

+ bonus up to 20%) I am currently recruiting for a business within the Lloyds of London space who are building out a Data Analytics and Science practise from the ground up. As part of this, I am currently recruiting for a Enterprise Data Architect. The … successful candidate will play a critical role, being responsible for the overall strategic design of the company's applications, systems infrastructure, and data architecture. You will ensure that the design frameworks, governance, and processes that underpin them are aligned with the business strategy. Responsibilities Define the target data … goals and objectives Provide technical leadership and guidance by driving the technical vision and roadmap. Evaluate, standardize, and implement technologies and products for data architecture. Mentor and lead a small team of architects and engineers Manage architecture projects and initiatives, including solution design, system integration, and technology upgrades. more »

your team's documentation. You’ll have strong mentoring skills, to support team members and the wider Innovation team. Our Tech Stack Infrastructure: Microsoft Azure, Terraform, Docker, Linux, Git, Azure DevOps Databases: Azure SQL, MongoDB Backends: Java/Spring, C#/.NET Core Frontends … Typescript/ReactJS Search and AI: Apache Lucene, Huggingface Data: Azure Data Factory, Apache Hop Test: Playwright Legacy: Windows, .NET Framework What is in it for you? We offer an intrapreneurial environment where people are supported to do their best work, and more »

business, put this down to not just their skilled work force but also their head office support team. This role is for a Data Engineer/BI developer who wants to continue to excel using the latest Data technologies. The role is primarily focused around building … then also created some awesome dashboards and reports using Power BI. The successful applicants will be helping to really utilise the power of data to help them across a range of projects. This ranges from internal projects to improve the business but also, external projects that lead to … extensive career development plans which are built specifically around each individual and their aspirations. Required skills: ADF; ability to build pipelines from scratch Azure Databricks Power BI; Ability to build reports from scratch Stakeholder management This is a great opportunity to join outstanding organisation who pride themselves on more »

developers when they require support. This role requires someone with excellent problem solving skills, using creativity to find resolutions. Our Tech Stack Infrastructure: Microsoft Azure, Terraform, Docker, Linux, Git, Azure DevOps Databases: Azure SQL, MongoDB Backends: Java/Spring, C#/.NET Core Frontends … Typescript/ReactJS Search and AI: Apache Lucene, Huggingface Data: Azure Data Factory, Apache Hop Test: Playwright Legacy: Windows, .NET Framework What is in it for you? We offer an intrapreneurial environment where people are supported to do their best work, and more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … is currently on-prem, but the direction of travel is cloud engineering, and you'll be executing code across the following tech stack: Azure, Databricks, PySpark and Pandas. DWP Digital is a great place to work, we offer a supportive and inclusive environment where you can grow your … career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … is currently on-prem, but the direction of travel is cloud engineering, and you'll be executing code across the following tech stack: Azure, Databricks, PySpark and Pandas. DWP Digital is a great place to work, we offer a supportive and inclusive environment where you can grow your … career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … is currently on-prem, but the direction of travel is cloud engineering, and you'll be executing code across the following tech stack: Azure, Databricks, PySpark and Pandas. DWP Digital is a great place to work, we offer a supportive and inclusive environment where you can grow your … career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … is currently on-prem, but the direction of travel is cloud engineering, and you'll be executing code across the following tech stack: Azure, Databricks, PySpark and Pandas. DWP Digital is a great place to work, we offer a supportive and inclusive environment where you can grow your … career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data more »

our users. Through science, technology, and maintaining a clear focus on people, we make mobility possible. We have an exciting opportunity for a Data Engineer to join our growing IT team. The role As Data Engineer you will develop and construct data products and … services and integrate them into systems and business processes. Key duties: Implementing data flows to connect operational systems, data for analytics and business intelligence (BI) systems. Re-engineering manual data flows to enable scaling and repeatable use. Supporting the build of data streaming systems. Writing ETL/ELT scripts and code to make sure the process performs optimally. Developing data models to support self-service business intelligence reporting that can be re-used to enforce data standards and quality. Building accessible data for analysis. more »

Senior Data Engineer (No Sponsorship Available) I am seeking an experienced Data Engineer who has experience managing green field projects and implementing modern data platforms that connect business systems and data sources to drive insights through data analytics. The ideal … candidate will have experience using Azure Platforms for consolidating data sources and making them accessible to the wider business to support growth and business strategy. Must have strong communication skills and be comfortable liaising with key stakeholders and other business units to understand business needs and … gather requirements. Required Experience Track record of designing and building data infrastructure and ETL pipelines Experience with Azure Platform including Data Factory, Synapse, and Data Lake DB development experience with SQL Software development experience in relevant languages like Python or more »

Development team. You will engage in all phases of the software development lifecycle, focusing on creating a low & no-code solution for batch data operations in reporting and visualization. Their solution leverages Azure services, including Azure Web App, Storage Accounts, Azure Data Factory, and Databricks, with Python and C# as primary languages. Responsibilities: Collaborate on data harmonization and transformation requirements. Develop and maintain data processing libraries and pipelines. Optimize data processes for performance and scalability. Ensure data quality through validation … and testing. Requirements: 5+ years of software development experience. Expertise in Databricks, Python, and cloud deployment (preferably Azure). Experience with batch processing data. Nice to Have: Market research or retail data management experience. Familiarity with Agile, TDD, and Lean methodologies. Experience with Large Language Models more »

role is responsible for the maintenance and support of database systems across the organisation. Support the administration and optimisation of MS SQL and Azure SQL databases and associated technologies, ensuring data security, quality, and efficient operation. Contribute to the design of database architectures, data … within an agile project environment. Duties and responsibilities: Database Management and Administration: Support the management and administration of multiple MS SQL databases and Azure SQL databases. Assist in the design and administration of Azure SQL databases that underpin key business systems. Support the management and oversight … of the data warehouse and all associated data flows. Azure Ecosystem Management: Assist in the administration and functioning of Azure Logic Apps and Azure Data Factory. Support the seamless data integration and flow within the Azure more »

Our Financial Services client based near Bournemouth are seeking a Data Engineer to join their growing business. The role is hybrid with some travel to the office required. Please note this role does not offer sponsorship, we can only accept applications from candidates with a right to work … in the UK. The Role (Key Responsibilities) Automate the collection of disparate data sources to Data Lakes and Data Warehouses. Produce underlying SQL (tables, views, stored procedures, SSIS packages etc.) Develop reporting solutions. Manage Tableau … ADF (Azure Data Factory) and SQL Server reporting deployments. Key Skills/Experience Experienced in working Microsoft Cloud Data and Automation technologies. Experienced working with Windows SQL Servers. Experienced working with Tableau and or Power BI. Experienced in writing SQL scripts including more »

the UK, USA and Australia, their dynamic technology team – the driving force behind their success – is looking for a talented and creative Senior Data Engineer to develop and implement new Greenfield software solutions for seamless data accessibility. The Role: Designing and implementing data solutions … constructing new infrastructure to centralize data, and delivering actionable insights across the business. Responsibilities include collaborating with key stakeholders, gathering requirements, designing solutions, and leading the development lifecycle. Key Duties: Cultivate relationships with key stakeholders to design and implement data solutions aligned with business requirements. Lead … the design and implementation of a modern data platform as a Greenfield Project. Establish and maintain data flows to integrate operational systems, data analytics, and business intelligence (BI) systems. Engineer, develop, and optimize code to ensure business processes support organizational growth. Essential Requirements: Proven more »

provide constructive feedback to team members to promote continuous improvement and knowledge sharing. Lead efforts in systems integration, including third-party integrations and data synchronisation between different systems, ensuring data consistency and integrity. Troubleshoot and debug complex issues in backend systems, identifying root causes and implementing … of backend development principles, including GraphQL & RESTful APIs, microservices architecture and database design. Experience with systems integration, including third-party API integration and data synchronisation between disparate systems. Experience with frontend development frameworks such as React and Next.js An understanding or exposure to caching and security considerations when … fast-paced, dynamic environment and adapt quickly to changing priorities and requirements. Nice to Haves Experience with deployment platforms like Vercel. Experience with Azure API Management, Azure Data Factory and Azure SQL. Experience in working on web development projects based more »

Data Engineer Leeds - on site 2x per week up to £55,000 Looking to join a dynamic team in the financial sector? Fruition IT are looking for an experienced Data Engineer to join a leading company specializing in financial solutions. Working closely with the Senior Data … automation whilst maintaining a core SAS user base. Requirements: Demonstratable proficiency with SAS platforms Strong commercial experience with SQL Hands on experience with Azure Data Factory and the build of data pipelines Proficiency in Python for data manipulation, transformation and … analysis Experience with Azure Synapse including ingestion and querying We are an equal opportunities employer and welcome applications from all suitably qualified persons regardless of their race, sex, disability, religion/belief, sexual orientation or age. more »

an exciting opportunity to join a great team with opportunity to develop skills and implement new technologies as we look to develop the data platform and support national developments. You will have experience working with large datasets and experience of working with a range of data … the opportunity to implement and improve processes and methodology where necessary. As a Senior Developer you will have experience working in a similar data environment and delivering complex ETL/ELT processes. You will be able to manage the workload of yourself and the team and be able … NHS values underpin everything we do. The development team are a small team within the wider Business Intelligence team responsible for ensuring the data flows and data pipelines operate effectively and efficiently to support onward analysis. The team is based in various locations, mostly working from more »

responsible for designing, developing, and maintaining self-serve reports utilising a range of resources such as SQL, Report Manager, Excel, Power BI, and Azure Data Factory within a structured Data Warehouse setup, which includes pipelines, triggers, linked services, and Change Data Capture. Additionally, you will provide necessary data and analysis as required, manage and maintain systems and processes, and handle ad hoc data/reporting requests from both internal and external sources, ensuring the provision of qualitative data in line with specified requirements. more »