126 to 150 of 162 Azure Data Factory Jobs

Senior Data Engineering Lead - Analytics & Infrastructure Financial Services £120,000 + 20% Bonus 3 days in the office per week (Central London) A leading global financial service firm is on a transformative journey to become the benchmark for quality across all its insurance markets. Leveraging a state-of … the-art Data and Analytics strategy, we are redefining client intimacy and decision-making accuracy through a unified data ecosystem. As the Chapter Lead for Data Engineering, you will spearhead the creation and implementation of a comprehensive data strategy that empowers our … business users across the globe. Your role is crucial in turning complex data into actionable insights and ensuring data assets are robust, reliable, and ready for strategic use. Key Responsibilities: Develop and execute data strategies in alignment with the company's goals. Lead the more »

Data Engineer | Yorkshire | up to £45,000 basic | Flexible Working A regular feature in the "UK's Top 10 places to work", my client is an award-winning business with a reputable brand and is widely respected for investing in their employees, placing importance on personal development and … career progression. The Environment you'll be joining: You'll be joining a friendly 10+ Data Engineering team as the business undergoes a complete greenfield re-architecture from the ground up in Microsoft Azure. The Tech you'll be playing with: Azure Data Factory Azure Databricks PySpark SQL DBT What you need to bring: 1-3 year's experience in building Data Pipelines SQL experience in data warehousing Python experience would be desirable Experience in Azure/GCP/AWS is a bonus Why more »

Job Title :: Pyspark Data Engineer Job Type :: Permanent Work Model :: Edinburgh, Scotland, United Kingdom (HYBRID) Please find below the JD of Pyspark Data Engineer – Coding skills: Pyspark or Scala(level to troubleshoot issues) and SQL. Must have good pyspark knowledge to build data transformation. … Hands on Azure data platforms i.e; Azure Datafactory, Databricks, Synapse, SQL, Data lake storage. Experience building and optimizing ‘big data’ data pipelines, architectures and data sets. Must have experience on production environment specific to data processing and activities like Monitoring, Troubleshoot, Deployments. Good understanding on Data Cleansing, Ingestion ,Transformation and Visualization(PowerBI) flow. Good Data analytics skill and able to communicate with customers/business users. more »

Senior Data Engineer | Full Time | On-Site | Python | SQL | DataBricks| Azure| As a Senior Data Engineer, you will play a key technical role in design, implementation, and continuous refinement of data pipelines and architectures within Microsoft’s Azure ecosystem. This … role involves leveraging Azure’s diverse data services, such as Data Factory, Databricks, Azure SQL and Synapse Analytics, among others, to build scalable and secure data solutions that support complex onward processing by both operational and analytical teams. … What will this role look like? - Develop and maintain scalable, efficient, and robust data architectures. This involves creating 3NF and dimensional data models, designing and developing robust batch processing pipelines, and working with the operational and analytical teams to solve complex business problems. - Monitor system performance more »

Job Description for Data Engineer - Coding skills: Pyspark or Scala(level to troubleshoot issues) and SQL. Must have good pyspark knowledge to build data transformation. Hands on Azure data platforms i.e; Azure Datafactory, Databricks, Synapse, SQL, Data lake … storage. Experience building and optimizing ‘big data’ data pipelines, architectures and data sets. Must have experience on production environment specific to data processing and activities like Monitoring, Troubleshoot, Deployments. Good understanding on Data Cleansing, Ingestion ,Transformation and Visualization(PowerBI) flow. … Good Data analytics skill and able to communicate with customers/business users. more »

Data Engineer - Databricks - Power BI - London - Up to £75k My client is a multinational organisation who is a leader within their industry. Their projects which have been secured and completed are some of the most impressive projects and put them so far ahead of their competitors. If you … business, put this down to not just their skilled work force but also their head office support team. This role is for a Data Engineer/BI developer who wants to continue to excel using the latest Data technologies. The role is primarily focused around building … then also created some awesome dashboards and reports using Power BI. The successful applicants will be helping to really utilise the power of data to help them across a range of projects. This ranges from internal projects to improve the business but also, external projects that lead to more »

+ bonus up to 20%) I am currently recruiting for a business within the Lloyds of London space who are building out a Data Analytics and Science practise from the ground up. As part of this, I am currently recruiting for a Enterprise Data Architect. The … successful candidate will play a critical role, being responsible for the overall strategic design of the company's applications, systems infrastructure, and data architecture. You will ensure that the design frameworks, governance, and processes that underpin them are aligned with the business strategy. Responsibilities Define the target data … goals and objectives Provide technical leadership and guidance by driving the technical vision and roadmap. Evaluate, standardize, and implement technologies and products for data architecture. Mentor and lead a small team of architects and engineers Manage architecture projects and initiatives, including solution design, system integration, and technology upgrades. more »

business, put this down to not just their skilled work force but also their head office support team. This role is for a Data Engineer/BI developer who wants to continue to excel using the latest Data technologies. The role is primarily focused around building … then also created some awesome dashboards and reports using Power BI. The successful applicants will be helping to really utilise the power of data to help them across a range of projects. This ranges from internal projects to improve the business but also, external projects that lead to … extensive career development plans which are built specifically around each individual and their aspirations. Required skills: ADF; ability to build pipelines from scratch Azure Databricks Power BI; Ability to build reports from scratch Stakeholder management This is a great opportunity to join outstanding organisation who pride themselves on more »

We are working alongside a market leading organisation within the education sector who are growing their data team at a rapid rate. As such, there is a requirement for a Data Platform Engineer to join the organisation on a fixed term contractual basis until August 2025. … This is a fantastic opportunity for an experienced Data professional to work on some exciting upcoming projects working alongside other like-minded and talented individuals. This role requires the successful candidate to travel to the London Victoria office 3 days per week. Role & Responsibilities Design, develop and maintain … the organisations Data Warehouse and analytics architecture. Work alongside the Power BI Engineering team to design meta data and data models. Collaborate with internal senior stakeholders and board members to help design business strategy. Skills & Qualifications Strong knowledge of Azure Cloud Data more »

Job title: Lead Data Engineer Client: Hyper Scaling AI/FinTech Startup Salary: Up to £160,000 Location: London/Hybrid My client are seeking a Lead Data Engineer to own delivery of scalable data pipelines that are critical to the entire firms infrastructure. … Being a Lead Data Engineer at a truly elite hedge fund, you will join an environment that prides themselves on working with the most cutting edge technologies and boast a world class technical team where you will work with and learn from the best. Responsibilities: As a Lead … Data Engineer, you will engage with data scientists, software engineer's and product managers to deliver high-quality product based on very specifically tailored data requirements. Architect and implement data ingestion, transformation, and storage processes. Optimise data pipeline performance. Keep more »

our users. Through science, technology, and maintaining a clear focus on people, we make mobility possible. We have an exciting opportunity for a Data Engineer to join our growing IT team. The role As Data Engineer you will develop and construct data products and … services and integrate them into systems and business processes. Key duties: Implementing data flows to connect operational systems, data for analytics and business intelligence (BI) systems. Re-engineering manual data flows to enable scaling and repeatable use. Supporting the build of data streaming systems. Writing ETL/ELT scripts and code to make sure the process performs optimally. Developing data models to support self-service business intelligence reporting that can be re-used to enforce data standards and quality. Building accessible data for analysis. more »

companies to GPs and individuals to get people the support they need to feel better. We are looking for an expert in cloud data solutions to Lead our Data Team as part of a 6 month fixed term contract. As a Senior Data Engineer … together a single view of the client journey spanning a number of sources. You will be responsible for implementing the right architecture and data pipelines to enable the company to utilise its data assets. To be successful in this role you will need to: Ensure that … the business’s information architecture, entity modelling, intersystem data consolidation at an enterprise level and pipelines are well designed and fulfil current and future business requirements Ensure that good development and architectural practices are adhered to Monitor and refine data pipelines to ensure adherence to expected more »

Senior Data Engineer (No Sponsorship Available) I am seeking an experienced Data Engineer who has experience managing green field projects and implementing modern data platforms that connect business systems and data sources to drive insights through data analytics. The ideal … candidate will have experience using Azure Platforms for consolidating data sources and making them accessible to the wider business to support growth and business strategy. Must have strong communication skills and be comfortable liaising with key stakeholders and other business units to understand business needs and … gather requirements. Required Experience Track record of designing and building data infrastructure and ETL pipelines Experience with Azure Platform including Data Factory, Synapse, and Data Lake DB development experience with SQL Software development experience in relevant languages like Python or more »

facing Production IT applications and databases, based on Microsoft technology. o Strong implementation and administration knowledge of Microsoft SQL Server from 2000-2019, Azure SQL databases, Azure SQL Managed Instances o Database schema design and implementation -Relational databases, T-SQL, Stored Procedures, Functions and Views, Indexes … SQL jobs and alerts. o ETL Development and Data Warehousing experience - SSIS, SSRS, Azure Data Factory o CI & CD including Azure DevOps pipelines. o Experience in high availability databases/servers o Experience with Disaster Recovery o Strong troubleshooting skillset … mentoring and coaching other DBAs and/or developers. Desired : o Oracle and/or Sybase expertise o Practical knowledge of the following Azure Technologies: o Azure Resource Manager Templates o API Management o Service Bus o Logic Apps o Azure DevOps o Experience more »

Development team. You will engage in all phases of the software development lifecycle, focusing on creating a low & no-code solution for batch data operations in reporting and visualization. Their solution leverages Azure services, including Azure Web App, Storage Accounts, Azure Data Factory, and Databricks, with Python and C# as primary languages. Responsibilities: Collaborate on data harmonization and transformation requirements. Develop and maintain data processing libraries and pipelines. Optimize data processes for performance and scalability. Ensure data quality through validation … and testing. Requirements: 5+ years of software development experience. Expertise in Databricks, Python, and cloud deployment (preferably Azure). Experience with batch processing data. Nice to Have: Market research or retail data management experience. Familiarity with Agile, TDD, and Lean methodologies. Experience with Large Language Models more »

Data Systems Engineer Job Type: Full-time Location: Norwich/Ipswich/Cambridge - 3 days in the office, 2 working from home. Salary: £40,000 - £42,500 Working with a leading professional services business who are setting up and growing their data function, we are seeking … a Data Systems Engineer to join their Data & Systems Team within the IT Development Team. This role is ideal for someone with a passion for data analysis, manipulation, and processing using ETL/ELT techniques. You will also be involved in 3rd line support … and third-party systems, DBA tasks, and database deployments. Day to Day of the role: Implement solutions and deployments in collaboration with the Data and Systems team. Instil a culture of continuous improvement within the team and in data-related system design and development. Maintain industry more »

role is responsible for the maintenance and support of database systems across the organisation. Support the administration and optimisation of MS SQL and Azure SQL databases and associated technologies, ensuring data security, quality, and efficient operation. Contribute to the design of database architectures, data … within an agile project environment. Duties and responsibilities: Database Management and Administration: · Support the management and administration of multiple MS SQL databases and Azure SQL databases. · Assist in the design and administration of Azure SQL databases that underpin key business systems. · Support the management and oversight … of the data warehouse and all associated data flows. Azure Ecosystem Management: · Assist in the administration and functioning of Azure Logic Apps and Azure Data Factory. · Support the seamless data integration and flow within the Azure more »

the UK, USA and Australia, their dynamic technology team – the driving force behind their success – is looking for a talented and creative Senior Data Engineer to develop and implement new Greenfield software solutions for seamless data accessibility. The Role: Designing and implementing data solutions … constructing new infrastructure to centralize data, and delivering actionable insights across the business. Responsibilities include collaborating with key stakeholders, gathering requirements, designing solutions, and leading the development lifecycle. Key Duties: Cultivate relationships with key stakeholders to design and implement data solutions aligned with business requirements. Lead … the design and implementation of a modern data platform as a Greenfield Project. Establish and maintain data flows to integrate operational systems, data analytics, and business intelligence (BI) systems. Engineer, develop, and optimize code to ensure business processes support organizational growth. Essential Requirements: Proven more »

provide constructive feedback to team members to promote continuous improvement and knowledge sharing. Lead efforts in systems integration, including third-party integrations and data synchronisation between different systems, ensuring data consistency and integrity. Troubleshoot and debug complex issues in backend systems, identifying root causes and implementing … of backend development principles, including GraphQL & RESTful APIs, microservices architecture and database design. Experience with systems integration, including third-party API integration and data synchronisation between disparate systems. Experience with frontend development frameworks such as React and Next.js An understanding or exposure to caching and security considerations when … fast-paced, dynamic environment and adapt quickly to changing priorities and requirements. Nice to Haves Experience with deployment platforms like Vercel. Experience with Azure API Management, Azure Data Factory and Azure SQL. Experience in working on web development projects based more »

Job Description Microsoft Azure and Microsoft Suite Integrations Manager Our Client is an international organisation developing medical advancements. They are looking to recruit a Microsoft Azure systems Integration Manager with at least 7 years expertise of working with Microsoft Azure and involved with the … Computer Science, MIS degree or equivalent practical experience is required You will have a Azure certification in either of the following - Microsoft Azure Solutions Architect Expert (AZ-300) or Microsoft Azure Architect Design (AZ-301). Skills required: The Client would like to see … that you have 5+ years' experience in Microsoft Azure and O365 architecture (cloud and hybrid cloud/on-prem solutions) and components on a global basis including Azure monitoring and troubleshooting methods coupled with Azure backup and disaster recovery capabilities. Billing and cost management more »

Data Engineer Leeds - on site 2x per week up to £55,000 Looking to join a dynamic team in the financial sector? Fruition IT are looking for an experienced Data Engineer to join a leading company specializing in financial solutions. Working closely with the Senior Data … automation whilst maintaining a core SAS user base. Requirements: Demonstratable proficiency with SAS platforms Strong commercial experience with SQL Hands on experience with Azure Data Factory and the build of data pipelines Proficiency in Python for data manipulation, transformation and … analysis Experience with Azure Synapse including ingestion and querying We are an equal opportunities employer and welcome applications from all suitably qualified persons regardless of their race, sex, disability, religion/belief, sexual orientation or age. more »

Technical Data Business Analyst - Contract - 6 Months+ My London based client is looking for a Technical Business Analyst immediately available to join their team. As a Data focused Technical Business Analyst you will have strong requirement gathering skills, Stakeholder management but also hands on experience with … Azure, Databricks, Data Factory, Power BI and Azure SQL. Location : Remote (Occasionally reporting on site for meetings). Length : 6 Months+ Day Rate : £(Apply online only) per day. IR35 Status : Inside (Umbrella). Requirements: You will need previous experience working with stakeholders … and end users to define, test and deliver technical and functional requirements. You will need experience implementing Azure Cloud Platform Solutions. Experience with Data Querying, and Data Profiling. Experience working with Large data sets especially analysing and cleansing said data. Strong Communication more »

s Automatic Feature Extraction team as a Senior Infrastructure Engineer and contribute to solving business and customer problems using Microsoft's cloud offering Azure to orchestrate exciting new solutions. Be part of a multidisciplinary production delivery team and actively engage in the analytical community at OS. Who We … skills in software engineering & industry best practice (including (TDD, CI, Clean Code, creating testable code, Design Patterns). Technologies We Use : YAML, Bicep, Azure Pipelines, Azure Data Factory, Function Apps, Azure Batch. Our wider team also uses Python, Esri ArcPro more »

responsible for designing, developing, and maintaining self-serve reports utilising a range of resources such as SQL, Report Manager, Excel, Power BI, and Azure Data Factory within a structured Data Warehouse setup, which includes pipelines, triggers, linked services, and Change Data Capture. Additionally, you will provide necessary data and analysis as required, manage and maintain systems and processes, and handle ad hoc data/reporting requests from both internal and external sources, ensuring the provision of qualitative data in line with specified requirements. more »

responsible for designing, developing, and maintaining self-serve reports utilising a range of resources such as SQL, Report Manager, Excel, Power BI, and Azure Data Factory within a structured Data Warehouse setup, which includes pipelines, triggers, linked services, and Change Data Capture. Additionally, you will provide necessary data and analysis as required, manage and maintain systems and processes, and handle ad hoc data/reporting requests from both internal and external sources, ensuring the provision of qualitative data in line with specified requirements. more »