151 to 175 of 187 Azure Data Factory Jobs

test and deploy. The work will be composed of developing a low & no-code solution that enables users to configure and run batch data operations for the purpose of data reporting & visualisation. The solution is deployed and hosted in Azure and services used include … Azure Web App, Storage Accounts, Azure Data Factory and Databricks. The main programming languages used by the team are either Python or C#. About Team: The central mission of the Redslim Product Team revolves around developing tools and services that support Redslim … s data management services. The team's collaboration extends to various business domains, both internally and externally, helping develop products that support operational activities, activation, and client reporting solutions. Key Responsibilities: Collaborate with cross-functional teams to understand and define data harmonisation & transformation requirements. Design, develop more »

companies to GPs and individuals to get people the support they need to feel better. We are looking for an expert in cloud data solutions to Lead our Data Team as part of a 6 month fixed term contract. As a Senior Data Engineer … together a single view of the client journey spanning a number of sources. You will be responsible for implementing the right architecture and data pipelines to enable the company to utilise its data assets. To be successful in this role you will need to: Ensure that … the business’s information architecture, entity modelling, intersystem data consolidation at an enterprise level and pipelines are well designed and fulfil current and future business requirements Ensure that good development and architectural practices are adhered to Monitor and refine data pipelines to ensure adherence to expected more »

Senior Data Engineer (Databricks) Hybrid working - 3 days onsite in Manchester Up to £70,000 I'm currently working with a data-centric organisation who are looking for a Senior Data Engineer with strong Databricks experience to join their team. The primary focus of … the role is Databricks data engineering. You will be building data pipelines using Databricks, coding using PySpark, and supporting internal applications. You will also be using Python for Data Transformations and work across the Azure Data Platform. Must Have Strong … Databricks Data Engineering skills, not just admin but actually building data pipelines in Databricks and using it regularly. Strong coding experience with Pyspark. Strong experience in SQL Server and Python coding. Knowledge of Azure Data Factory. Strong 3-5 years working as more »

Data Engineer Remote working, West Sussex, Manchester Up to £54,000 per annum + Bonus An exciting opportunity has arisen to join a leading company in the Insurance and technology sector, renown for its outstanding working culture, in a Data Engineering role. The role will require … someone who has strong Pyspark and SQL experience alongside an Azure background. Key responsibilities: Develop low to high complexity, secure, governed, high quality, efficient data pipelinesfrom a variety of on and off premise, internal and external data sources Ensure that data is … cleansed, mapped, transformed and optimised for storage to meet requirements for business and technical use cases. Build data observability and data quality by design into all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. Build solutions that pipe transform more »

facing Production IT applications and databases, based on Microsoft technology. o Strong implementation and administration knowledge of Microsoft SQL Server from 2000-2019, Azure SQL databases, Azure SQL Managed Instances o Database schema design and implementation -Relational databases, T-SQL, Stored Procedures, Functions and Views, Indexes … SQL jobs and alerts. o ETL Development and Data Warehousing experience - SSIS, SSRS, Azure Data Factory o CI & CD including Azure DevOps pipelines. o Experience in high availability databases/servers o Experience with Disaster Recovery o Strong troubleshooting skillset … mentoring and coaching other DBAs and/or developers. Desired : o Oracle and/or Sybase expertise o Practical knowledge of the following Azure Technologies: o Azure Resource Manager Templates o API Management o Service Bus o Logic Apps o Azure DevOps o Experience more »

as a Power BI Expert Analyse large datasets and draw on your expertise with Power BI to provide expert reporting and intelligence into data driven decision making for key Customer Focused areas across the business. Work with data engineers across IT & Data teams to … provide guidance and consultancy on producing an efficient and accurate reporting infrastructure. To mentor and provide training to the Data Team, to develop their skills with Power BI and surrounding processes. Experience & Skills Required Expertise with Data Visualisation and Report Presentation using Power BI. Able to … train/mentor other data experts in data visualisation techniques from concept through to full build and maintenance. Sound knowledge of data repository design, data transformation and engineering for reporting purposes. Proficiency with the Azure Suite, Data Factory more »

Data Systems Engineer Job Type: Full-time Location: Norwich/Ipswich/Cambridge - 3 days in the office, 2 working from home. Salary: £40,000 - £42,500 Working with a leading professional services business who are setting up and growing their data function, we are seeking … a Data Systems Engineer to join their Data & Systems Team within the IT Development Team. This role is ideal for someone with a passion for data analysis, manipulation, and processing using ETL/ELT techniques. You will also be involved in 3rd line support … and third-party systems, DBA tasks, and database deployments. Day to Day of the role: Implement solutions and deployments in collaboration with the Data and Systems team. Instil a culture of continuous improvement within the team and in data-related system design and development. Maintain industry more »

Data & AI Engineer 6 Months June start Hybrid (Home-based with flexible travel requirements) £550 - £700 per day outside IR35 Our client is at the forefront of integrating Large Language Models (LLMs) and AI Agentic Reasoning into business operations. As they prepare for a phase of rapid growth … are developing smart, context-aware systems that not only enhance operational efficiency but also foster significant innovation. As such, they are seeking a Data & AI Engineer who is passionate about Data, AI, and LLMs. Core Responsibilities: Take a hands-on approach to design and develop Data … powered solutions, working closely with client teams. This role is tailored for proactive problem solvers who aspire to create impactful solutions beyond simple data manipulation. Support the execution of projects from initial design through to deployment. Engage in client interactions to highlight the technical benefits of AI solutions more »

the UK, USA and Australia, their dynamic technology team – the driving force behind their success – is looking for a talented and creative Senior Data Engineer to develop and implement new Greenfield software solutions for seamless data accessibility. The Role: Designing and implementing data solutions … constructing new infrastructure to centralize data, and delivering actionable insights across the business. Responsibilities include collaborating with key stakeholders, gathering requirements, designing solutions, and leading the development lifecycle. Key Duties: Cultivate relationships with key stakeholders to design and implement data solutions aligned with business requirements. Lead … the design and implementation of a modern data platform as a Greenfield Project. Establish and maintain data flows to integrate operational systems, data analytics, and business intelligence (BI) systems. Engineer, develop, and optimize code to ensure business processes support organizational growth. Essential Requirements: Minimum more »

provide constructive feedback to team members to promote continuous improvement and knowledge sharing. Lead efforts in systems integration, including third-party integrations and data synchronisation between different systems, ensuring data consistency and integrity. Troubleshoot and debug complex issues in backend systems, identifying root causes and implementing … of backend development principles, including GraphQL & RESTful APIs, microservices architecture and database design. Experience with systems integration, including third-party API integration and data synchronisation between disparate systems. Experience with frontend development frameworks such as React and Next.js An understanding or exposure to caching and security considerations when … fast-paced, dynamic environment and adapt quickly to changing priorities and requirements. Nice to Haves Experience with deployment platforms like Vercel. Experience with Azure API Management, Azure Data Factory and Azure SQL. Experience in working on web development projects based more »

Job Description Microsoft Azure and Microsoft Suite Integrations Manager Our Client is an international organisation developing medical advancements. They are looking to recruit a Microsoft Azure systems Integration Manager with at least 7 years expertise of working with Microsoft Azure and involved with the … Computer Science, MIS degree or equivalent practical experience is required You will have a Azure certification in either of the following - Microsoft Azure Solutions Architect Expert (AZ-300) or Microsoft Azure Architect Design (AZ-301). Skills required: The Client would like to see … that you have 5+ years' experience in Microsoft Azure and O365 architecture (cloud and hybrid cloud/on-prem solutions) and components on a global basis including Azure monitoring and troubleshooting methods coupled with Azure backup and disaster recovery capabilities. Billing and cost management more »

Are you a skilled Business Analyst with a passion for data analysis and a knack for translating business requirements into effective IT solutions? We have an exciting opportunity for a Corporate Business Analyst to join a team on a 12-month fixed-term contract in Belfast. Role Overview … and toolsets for business users. Corporate and KPI Reports: Design and publish corporate and KPI reports within the corporate Business Intelligence (B.I.) framework. Data Integrity and System Integration: Create and maintain corporate indices to support system integration and data integrity. Technical Support: Provide technical support for … and deliver training for IT staff and business users. Essential Qualifications and Experience: Minimum of 2 years' experience in a role involving significant data analysis and presentation. Proficiency in working with large relational databases and data management tools. Degree in Business, Computer Science (or equivalent) with more »

s Automatic Feature Extraction team as a Senior Infrastructure Engineer and contribute to solving business and customer problems using Microsoft's cloud offering Azure to orchestrate exciting new solutions. Be part of a multidisciplinary production delivery team and actively engage in the analytical community at OS. Who We … skills in software engineering & industry best practice (including (TDD, CI, Clean Code, creating testable code, Design Patterns). Technologies We Use : YAML, Bicep, Azure Pipelines, Azure Data Factory, Function Apps, Azure Batch. Our wider team also uses Python, Esri ArcPro more »

responsible for designing, developing, and maintaining self-serve reports utilising a range of resources such as SQL, Report Manager, Excel, Power BI, and Azure Data Factory within a structured Data Warehouse setup, which includes pipelines, triggers, linked services, and Change Data Capture. Additionally, you will provide necessary data and analysis as required, manage and maintain systems and processes, and handle ad hoc data/reporting requests from both internal and external sources, ensuring the provision of qualitative data in line with specified requirements. more »

responsible for designing, developing, and maintaining self-serve reports utilising a range of resources such as SQL, Report Manager, Excel, Power BI, and Azure Data Factory within a structured Data Warehouse setup, which includes pipelines, triggers, linked services, and Change Data Capture. Additionally, you will provide necessary data and analysis as required, manage and maintain systems and processes, and handle ad hoc data/reporting requests from both internal and external sources, ensuring the provision of qualitative data in line with specified requirements. more »

Data Engineer – Middleware/API £40,000 - £45,000 P/A X1 day per week on-site in Walsall We are seeking a talented and experienced Data Engineer with expertise in Middleware and API development to join our clients team. As a Data … the latest developments in middleware development and apply them to projects as appropriate. Technical System Skills: Competence in contemporary Middleware platforms like Mulesoft, Azure Data Factory, and Google Apigee/Application Integration. Proficient in developing APIs compliant with Open API standards (version 3.1.0). … queues. Knowledgeable about technical principles like caching, connection pooling, threading, and transaction management. Technical Skills: Familiarity with ETL best practices. Proficiency in utilising Azure DevOps and managing GIT repositories. Interested!?! Please send your up-to-date CV to Olivia Yafai for immediate review Not interested?! Do you know more »

Your Company: A highly successful company are partnering with the NET Recruit team to support their recruitment campaign for a Senior BI Data Analyst in Bournemouth. The company provide excellent solutions to their clients, across a number of niches including aerospace, automotive and industrial, among others. Due to … difference within the company both in terms of profitability and operational efficiency by capturing the relevant metrics from a wide cross section of data sources that will drive the business forward. IMPORTANT: Applicants MUST be already located and living in the Bournemouth area and have full right to … and alternative options for senior management to address their issues and needs Taking ownership of the deployment process Conducting quality checks, monitoring the data warehouse and administrating the ETL Providing support in reporting for Power BI and delivering training across the business Managing Power BI report subscriptions Managing more »

retail retirement and insurance businesses, we’re a fast-growing division with big, customer-centred ambitions. Job Description Legal and General Retail’s Data Operations team are currently hiring three Lead Data Engineers following the merger of internal divisions resulting in them expanding into a new … area. These positions are to focus on the retirements side of the Retail division and will build out new data pipelines utilising tools such as Synapse, DBT, Azure Devops and Snowflake. This role will see you responsible for designing, building, and implementing a variety of data … Facilitating the refinement of the tasks in the Product Backlog and guide and support your team as you break deliveries down into technical data engineering components. Converting user stories in to technical, quality, testing and documentation tasks in the chosen work-flow management tool. Liaising with the end more »

Management firm. This is an Outside IR35 Position, offering circa £750 per day. You will play a crucial role in crafting the semantic data layer in Power BI to create data products for users. You'll also be responsible for transferring the firm's Power BI … of the team, and with that in mind, you’ll need to have the following: Extensive experience with Power BI A background in Data Engineering would be beneficial to show programming aptitude (SQL proficiency/data warehousing practices). Azure Data Factory more »

new projects. The role would suit an experienced Software Engineer with 5+ years' commercial experience with C# and .NET technologies, SQL Server and Azure cloud services. You will have the chance to be involved with software architecture and design and work closely with the Head of Engineering. Tech … stack requirements: Strong backend experience using C#, .NET Core, .NET 5 SQL Server MS Azure (Azure Functions, Data Factory, Logic Apps) Unit Testing (TDD) Frontend skills ideally with Angular, JavaScript, HTML & CSS Code reviews Mentoring juniors The Senior Software Engineer will be more »

will work alongside business intelligence, database and systems developers. This role requires expertise in database management systems (design, implementation, maintenance, and performance optimisation), data modelling, and awareness of integration technologies to ensure the seamless flow of data across disparate systems. The position requires collaboration with cross … working, therefore you must be able to commute to our Sunderland offices daily if required. The Person Ideally candidates will have: • Proficiency with Azure and SQL Server administration and programming of on-premises and cloud database solutions. Experience of similar technologies desirable (e.g., MySQL, Progress) . • Strong understanding … and application of data modelling concepts, normalisation techniques, and database design principles. • Experience with ETL tools and processes (e.g., Informatica, Talend, SSIS, Azure Data Factory). • Experience with version control systems (GitHub, Bitbucket). • Knowledge of project management methodology, tools (e.g. Jira more »

Data Engineer | Hybrid – Bristol | Permanent | £30,000 - £40,000 Are you a Data Engineer seeking new opportunities? We are currently on the lookout for talented individuals on behalf of one of our esteemed clients in the professional services sector. Our client is a business that values … empowerment, collaboration, and career development. They are in search of a skilled Data Engineer to join their growing function. The Data Engineer will work closely with our Digital Data & Technology and IT Service functions building data solutions to requirements and root cause … analysis. What You'll Be Doing: Provide hands-on technical expertise to design and implement data-based solutions satisfying user requirements. Work collaboratively with internal teams and external partners in implementing the best solution. Be aware of industry standards, best practices, and trends. Provide feedback, advice, and informed more »

internal stakeholders and external suppliers. Essential for the role: Demonstrable Microsoft Dynamics and Power platform development experience. Excellent experience of full suite of Azure Integration Services products, including Logic Apps, Azure Data Factory etc. Experience of Mambu SaaS cloud banking platform. Evident … and technologies. Ability to provide strategic, scalable solutions to meet business requirements. Desirable for the role: MS Dynamics and Power Platform accreditations. MS Azure accreditations. Knowledge of Workday configuration. Experience of using modelling tools such as EA Sparx, BizzDesign, ErWin to capture business capabilities, processes, technology components and … data structures. Experience of developing and maintaining strong 3rd party, vendor, and partner relationships. Knowledge and understanding of the business processes associated with financial services organisations. Understanding of broader Change Management principles, practices, and methodologies. Awareness of the financial services industry, markets and competitors and the associated regulatory more »

versions of software or products. Experience in some of the following areas. Experience working with Cloud Native design patterns, with a preference towards Microsoft Azure/Google Cloud. Hands-on Technical experience with at least some of our core technologies (Terraform, Ansible, Packer, TypeScript, Python). Experience working … . Familiarity with natural language processing or AI technologies ( e.g LLMs such as ChatGPT or BARD, Embeddings, Prompt Engineering ) Experience with machine learning, data pipelines and preferably processing of document s (e.g using Google Cloud Fusion/Azure Data Factory ) Experience in … such as vector databases advantageous Strong background in either Python/Typescript Experience supporting digital platforms, including Integrations, Release Management, Regression Testing, Integrations, Data Obfuscation, etc. Experience scaling an “API-Ecosystem”, designing, and implementing “API-First” integration patterns. Experience working with authentication and authorisation protocols/patterns. Other more »

versions of software or products. Experience in some of the following areas. Experience working with Cloud Native design patterns, with a preference towards Microsoft Azure/Google Cloud. Hands-on Technical experience with at least some of our core technologies (Terraform, Ansible, Packer, TypeScript, Python). Experience working … . Familiarity with natural language processing or AI technologies (e.g LLMs such as ChatGPT or BARD, Embeddings, Prompt Engineering) Experience with machine learning, data pipelines and preferably processing of documents (e.g using Google Cloud Fusion/Azure Data Factory) Experience in new … automation and generative AI applications.(e.g SpaCy, NLTK, or Hugging Face). Experience supporting digital platforms, including Integrations, Release Management, Regression Testing, Integrations, Data Obfuscation, etc. Experience scaling an “API-Ecosystem”, designing, and implementing “API-First” integration patterns. Experience working with authentication and authorisation protocols/patterns. Other more »