1 to 25 of 151 Permanent Azure Data Factory Jobs in England

Azure Data Engineer - £60,000 + Benefits, London, weekly on-site You must have full right to work authorisation. No sponsorship available. Azure data platform technologies, including Data Lake Gen 2, Synapse, Analysis Services, and Power BI. Working in a … leading UK and global business you will be a key part of the team and take the lead in supporting the Strategic Data Manager to enrich, implement and maintain a highly effective Business Intelligence technical service, at the forefront of the technical development of cloud data platforms, offering near real-time process reporting solutions. Your Profile : Extensive experience with Azure data platform technologies, ideally including Data Lake Gen 2, Synapse, Analysis Services, and Power BI. Proven skills with Azure Data Factory & Databricks more »

Data Engineer London (hybrid working) £up to £68,000 A leading financial organisation based in London is currently looking to recruit a Data Engineer to join a growing machine learning team ideally with a strong track record of data modelling, developing, and delivering large … scale data transformation project aligned with the overarching Data Strategy. The successful data engineer will define, develop, and deliver data transformations that not only drives our Machine learning models but create more strategic transformation that delivers consistent data across the … organisation for the various business needs. Key responsibilities Delivering data transformation based on the overarching data strategy Design, development and maintenance of Data transformation pipelines aligning with Data Strategy. Test driven development, clean code and documentation Delivering on agreed service levels, which more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in … the office to collaborate with colleagues. It's a really exciting time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in … the office to collaborate with colleagues. It's a really exciting time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You more »

responsible for designing, developing, and maintaining self-serve reports utilising a range of resources such as SQL, Report Manager, Excel, Power BI, and Azure Data Factory within a structured Data Warehouse setup, which includes pipelines, triggers, linked services, and Change Data Capture. Additionally, you will provide necessary data and analysis as required, manage and maintain systems and processes, and handle ad hoc data/reporting requests from both internal and external sources, ensuring the provision of qualitative data in line with specified requirements. more »

Our client within the Education sector are looking for a Senior Data Engineer to join them on a contract basis. Inside IR35 6 month contract Hybrid 1 – 2 days per week onsite Technical Skills: In depth knowledge of relevant Azure services such as Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL Database, Azure Stream Analytics, etc. Strong Python or Scala with Spark, PySpark experience Experience with relational databases and NoSQL … databases Significant experience and in-depth knowledge of creating data pipelines and associated design principles, standards, Data modelling concepts, ETL procedures, and all steps of data production process Experience with unit and integration testing, and data quality frameworks such as Deequ, Great more »

what role you come in and do, we will have a plan targeted to help you advance. What you’ll do As a Data Architect will be required to analyse an array of product offerings and business requirements within Mercury, to create and own the overall data architecture spanning the Mercury product suite. You will work with the product development teams (e.g. Core, Web, Integration, Data Practice and product owners) to evaluate and identify solutions that meet the needs of the business and customers, utilising industry standard best practices, patterns and creative design … techniques to overcome complex business and technical challenges (e.g. maximum performance with complex data sets). Provide data architecture leadership and vision, mentoring product development teams that contribute to the various touch points for Mercury data. Create, maintain and develop a governance model on the data more »

unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not … but optimised for safe, secure utilisation across multiple fronts — be it reporting, analytics, or powering applications — ultimately driving substantial productivity gains for all data consumers. As a collaborative force, you will seamlessly integrate across central, regional, and local teams, refining our client's data visualisation strategy more »

Senior Azure Data Engineering Consultant Home-based with occasional customer travel £65,000 - £85,000 + bonus and benefits I'm working with a leading Microsoft Gold Partner who specialise in data. They are true experts when it comes to data strategy, data platforming, analytics, artificial intelligence and data managed service. This means they are working on the most interesting and cutting-edge data centric projects in the market today. I’m looking for a Senior Data Engineering Consultant to join the team. This is … an excellent opportunity for a Data Engineer, with experience in consulting and customer-facing roles to join a data-centric organisation at an exciting time of change. You will be well supported with the opportunity to gain numerous Microsoft certifications and accreditations to enhance your profile more »

Artificial Intelligence Engineer Permanent About the job As an AI Engineer specialising in Azure Services, you will be responsible for designing, implementing, and maintaining AI solutions within our organisation. Leveraging the Azure platform, including Azure Open AI, Azure Vision and other Azure … will be a key part of your role. What are the day-to-day tasks? Design and develop AI models and solutions using Azure Open AI, Azure Machine Learning, and Azure Cognitive Services to address specific business challenges. Implement and maintain scalable and efficient … AI systems, ensuring they meet business requirements and performance benchmarks. Collaborate with business analysts, data scientists, and IT teams to integrate AI solutions into existing systems and workflows, enhancing their capabilities and impact. Stay abreast of advancements in AI, machine learning, and Azure services, incorporating new more »

Data Analyst Location: Hybrid - London Package: Negotiable + Benefits The Data Analyst for Data Operations will be responsible for gathering, collating and analysing data issues and translating them into data and reporting needs, using technical expertise to ensure data accuracy and high-quality, whilst ensuring delivery deadlines meet business requirements. Working closely with the data operations team, business stakeholders and the wider data team in resolving operational and data issues. The day to day: You will be an experienced analyst who … specialises in delivering Data Projects using Agile delivery methods and Data Operations function. Your primary responsibilities will include: Working with a team of data analysts, engineers, and other specialists, You'll own or delegate tasks, ensure effective communication, and foster a collaborative work environment. more »

LEAD AZURE DATA CONSULTANT £76K - £90k + BONUS & BENEFITS HOME-BASED CONTRACT + CUSTOMER TRAVEL I’m working with a leading Microsoft Partner who currently hold 13 specialisations across the Azure tech stack. This is a great opportunity to join an experienced team of … Microsoft specialists who can help to grow your professional and technical skills each day. I am looking for Lead Data Consultants to join the team due to a number of recent project wins which means there is an increased workload. The successful candidate will draw upon their experience … deliver analytics capability on time and to budget. I’m looking for candidates with the following skills and experience: Expert with SQL and Azure Data Engineering Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure Data more »

As the Data Architect, you'll lead data architecture initiatives, establishing standards and practices essential for effective data management. Your focus will be on designing and implementing robust data and information systems, ensuring they meet stringent criteria for modelling, flow, lineage, quality … and security. Working closely with stakeholders and data governance teams, you'll drive adherence to established standards, facilitating data-driven decision-making processes across the organisation. This role encompasses: Developing and maintaining a comprehensive Data Architecture Framework and maturity roadmap. Enforcing best data … architecting data-centric solutions at a conceptual, logical and physical level Experience in architecting, designing and implementing solutions on AWS and Microsoft Azure stacks, including data pipelines, security and networking Expertise with data warehousing, data lakes and data more »

Data Engineer Embark on a Rewarding Journey with MIKI Travel: Where Your Career Takes Flight. At MIKI Travel, our 55+ years of expertise make us a trailblazing wholesale travel provider, curating unforgettable global adventures. As a premier private travel company with a presence in 36 offices, we invite … your career with opportunities for growth, powered by values of quality, innovation, and commitment that shape the Miki way. Job Purpose As a Data Engineer you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to enable efficient data ingestion, processing … storage, and analysis. The ideal candidate will have a strong background in data engineering, including expertise in building and optimizing ETL processes, data warehousing, and working with big data technologies. Main Responsibilities ● Collaborate with business stakeholders to gather and analyse business requirements, translating them more »

Data Engineering Manager Data Idols are working with a global publishing company to recruit a Data Engineering Manager. You will be supporting a team of Data Engineers to help design and build analytic solutions for the company, promote best practises and drive … a high standards for the team. The Opportunity Within the role of a Data Engineering Manager, you will drive the high standard of team outcomes, manage conflicts between business and tech priorities and establish a scalable, flexible, and technological roadmap with architecture business partners. Not only will you … contract engineering teams from the ground up Strong SQL Experience in leading and driving Agile delivery methodology and practices Experience delivering cloud-based data services Experience using tools such as SSIS, Azure Data Factory, Spark, or comparable data integration tools more »

versions of software or products. Experience in some of the following areas. Experience working with Cloud Native design patterns, with a preference towards Microsoft Azure/Google Cloud. Hands-on Technical experience with at least some of our core technologies (Terraform, Ansible, Packer, TypeScript, Python). Experience working … . Familiarity with natural language processing or AI technologies ( e.g LLMs such as ChatGPT or BARD, Embeddings, Prompt Engineering ) Experience with machine learning, data pipelines and preferably processing of document s (e.g using Google Cloud Fusion/Azure Data Factory ) Experience in … such as vector databases advantageous Strong background in either Python/Typescript Experience supporting digital platforms, including Integrations, Release Management, Regression Testing, Integrations, Data Obfuscation, etc. Experience scaling an “API-Ecosystem”, designing, and implementing “API-First” integration patterns. Experience working with authentication and authorisation protocols/patterns. Other more »

versions of software or products. Experience in some of the following areas. Experience working with Cloud Native design patterns, with a preference towards Microsoft Azure/Google Cloud. Hands-on Technical experience with at least some of our core technologies (Terraform, Ansible, Packer, TypeScript, Python). Experience working … . Familiarity with natural language processing or AI technologies (e.g LLMs such as ChatGPT or BARD, Embeddings, Prompt Engineering) Experience with machine learning, data pipelines and preferably processing of documents (e.g using Google Cloud Fusion/Azure Data Factory) Experience in new … automation and generative AI applications.(e.g SpaCy, NLTK, or Hugging Face). Experience supporting digital platforms, including Integrations, Release Management, Regression Testing, Integrations, Data Obfuscation, etc. Experience scaling an “API-Ecosystem”, designing, and implementing “API-First” integration patterns. Experience working with authentication and authorisation protocols/patterns. Other more »

leading, innovative Insurance business operating within the Lloyd's & Company markets, assisting with their efforts to identify an experienced SQL DBA the growing Data & IT team. Role responsibilities: · Manage their estate of SQL Servers which include a mixture of SQL versions including Azure. · Manage automated and ad hoc … the organisation. · Upgrade and deploy new updates. · Assist with the creation of new and manage changes of exiting Stored Procedures · Manage pipelines in Azure · Assist with the IT needs of the company, making system and hardware recommendations to resolve identified issues. · Take ownership of your work and communicate … know version 2012 and upwards including T-SQL · Strong knowledge of SSIS and SSAS · Good knowledge of Power BI reporting · Excellent experience in Azure (Data Factory is advantageous) · Expertise in performance tuning and diagnostic and fix resolution · London market Insurance industry experience is highly more »

AI Engineer & Innovation Consultant Consulting firm London UK £50k - £60k About Them Part of the digital innovation and data division within a leading global consultancy, they create fresh ventures and products for clients in the professional services space. Their efforts are focused on propelling forward exciting and innovative … analytics and AI solutions. Your responsibilities will include collaborating on both new and existing products, delivering actionable insights to clients, and harnessing advanced data methodologies to drive this insight. Working alongside a diverse team of Engineers, Designers, and Consultants, you'll conduct in-depth analysis on intricate datasets … sklearn, pytorch, langchain, llamaindex, bedrock, sagemaker, huggingface, mlflow, gradio, Flask, FastAPI, SQLAlchemy, psycopg2, boto3, gunicorn, pytest, and scrapy Experience with cloud services like Microsoft Azure (Data Factory, ML Studio, Synapse Analytics, etc.) Interest in researching, testing, and implementing state-of-the-art technologies to more »

a .NET Developer to come in on a contract basis. Key Skills/Requirements: Must have strong .NET Development experience Must have strong Azure cloud experience (Data Factory, Kubernetes Service, Container Apps, App Service, Functions, Event Grid and Service Bus) Messaging platforms experience (ideally more »

Senior Data Engineer Python – SQL – Azure 5 days a week in the office Up to £130,000 Are you a Senior Data Engineer ready to make a significant impact in the insurance industry? We have an exciting opportunity for you to join our esteemed … and exceptional service to clients worldwide. With a dedicated team of 90 underwriters, they are at the forefront of driving business success through data-driven insights. Role Overview: As a Senior Data Engineer, you will play a crucial role in empowering our underwriting team with robust … data infrastructure. You will be responsible for designing, building, and optimizing ETL pipelines using SQL and Python. Leveraging the Azure Data Engineering stack, including Azure Data Factory (ADF) and Azure Synapse Analytics, you will ensure our more »

their growing London based data team. This organisation have recently implemented a brand new data platform encompassing the full Microsoft Azure Stack including leveraging Databricks in order to deliver on its goal of becoming truly data driven. In this role you will … be responsible for the BI and data engineering lifecycle across the business supporting the global data needs of various business functions. This role is a split between data engineering and data analytics and you will take a prominent role on a number … will have. Strong experience creating data pipelines using Azure Data Factory Experience working with the Microsoft Azure stack including databricks for data transformation Experience using Power BI to create custom visualisations Strong SQL skills This is just a more »

hybrid role 80% homeworking available and 20% in Stratford Upon Avon About the role We are seeking a skilled Developer to join our Data Engineering team. In this role, you will play a pivotal part inmaintainingand enhancing our technical service offerings, ensuring operational efficiency and effectiveness. As a … Developer in our Data Engineering team, you willbe responsible formanaging technical service operationssupporting data pipelines throughout the Cloud Data Platform. With a focus on problem-solving, adaptability, and analytical skills. Collaborating closely with stakeholders, you will gain a deep understanding of business imperatives and … development within our team. The essential requirements for this role are: Proficiency in SQL/KQL, including scripting and automation proficiency Experience in data management, with an understanding of data storage and extraction principles. Azure Data Factory (error handling, pipeline more »

Data Engineer - Databricks - Power BI - London - Up to £75k My client is a multinational organisation who is a leader within their industry. Their projects which have been secured and completed are some of the most impressive projects and put them so far ahead of their competitors. If you … business, put this down to not just their skilled work force but also their head office support team. This role is for a Data Engineer/BI developer who wants to continue to excel using the latest Data technologies. The role is primarily focused around building … then also created some awesome dashboards and reports using Power BI. The successful applicants will be helping to really utilise the power of data to help them across a range of projects. This ranges from internal projects to improve the business but also, external projects that lead to more »

Data Platform Engineer (Azure) On behalf of our award-winning client based in Manchester, we are recruiting for an experienced Data Platform Engineer. As a Data Platform Engineer, you will deliverthe IT Support/corporate services business objectives and implement IT Services … to meet business infrastructure, platform needs, and growth targets. Data Platform Engineer (Azure)will be responsible for: Accountability & Responsibility for the continued development and delivery of the IT Data Operations support delivery. Lead the development, implementation, and establish a technology life cycle and continuous … can operate 24x7 Lead the planning, development, documentation, implementation and testing of the corporate Disaster Recovery and Business Continuity processes and procedures The Data Platform Engineer (Azure) will have the following: Understanding and detailed knowledge of Microsoft Azure DevOps, ITIL, Azure Synapse more »