351 to 375 of 430 Data Pipeline Jobs in the UK excluding London

remediation (Tanium) Support endpoint security & EDR (Trend Micro, Trellix) Administer email security (Clearswift) and respond to phishing threats Maintain log integration and SIEM data pipelines Support Active Directory , access management, and system security (Windows/Linux) Work within ITSM tools (Remedy, Jira) ensuring proper documentation and governance Requirements ...

availability and resilience across Azure-hosted environments Architect robust backend services in Python using modern frameworks (FastAPI, Pydantic), implementing clean API design, efficient data pipelines, and integration patterns within our Azure ecosystem Establish and enforce best practices for the TypeScript/React frontend, ensuring a highly performant, accessible … intuitive user experience, including real-time interfaces and interactive data visualisations Lead the configuration and optimisation of Azure cloud environments, establishing robust CI/CD pipelines with GitHub Actions or Azure DevOps, and ensuring cost-optimised use of Azure services and container orchestration resources Set the standard ...

plus benefits This is a great opportunity to join a fast-growing digital lender where you will work at the intersection of data, credit strategy, and product innovation. You will play a meaningful role in shaping credit decisioning and analytical capability within a business that places data … next-generation lending products for homeowners across the UK. With a strong culture of ownership, innovation, and collaboration, they are scaling their credit, data, and technology functions to support continued expansion. Their environment suits people who enjoy autonomy, problem-solving, and making an immediate impact. The Role ...

Data Engineer Opportunity, DV-cleared only All candidates should make sure to read the following job description and information carefully before applying. London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence … Process large structured and unstructured datasets, integrating multiple sources Collaborate with stakeholders and delivery teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant ...

Data Engineer Opportunity, DV-cleared only Check all associated application documentation thoroughly before clicking on the apply button at the bottom of this description. London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across … Process large structured and unstructured datasets, integrating multiple sources Collaborate with stakeholders and delivery teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant ...

reporting tools. Some of the main responsibilities of the Power BI Analyst will include: Develop, maintain, and enhance Power BI dashboards and data models to support Quality performance monitoring and informed project decision-making. Produce weekly, monthly, and quarterly performance reports that deliver clear, actionable insights to Quality … Leadership. Ensure the integrity, accuracy, and validation of all Quality data, guaranteeing alignment with actual project progress and performance. Lead the analysis, interpretation, and presentation of complex datasets across multiple Quality reporting disciplines. Identify trends, anomalies, and root causes, supporting the development and implementation of improvement action plans ...

where you'll lead the design, development, and optimisation of enterprise-wide BI solutions using Microsoft Fabric, Power BI and advanced cloud-based data engineering technologies. About the Role As Senior BI Developer, you'll translate complex business requirements into scalable, high-quality BI solutions used across multiple … regions. You will design and maintain enterprise data models, architect advanced Power BI solutions, and lead development within a Microsoft Fabric Lakehouse environment. This role also acts as a technical leader within the BI practice, supporting other developers and serving as the primary escalation point for advanced ...

where you'll lead the design, development, and optimisation of enterprise-wide BI solutions using Microsoft Fabric, Power BI and advanced cloud-based data engineering technologies. About the Role As Senior BI Developer, you'll translate complex business requirements into scalable, high-quality BI solutions used across multiple … regions. You will design and maintain enterprise data models, architect advanced Power BI solutions, and lead development within a Microsoft Fabric Lakehouse environment. This role also acts as a technical leader within the BI practice, supporting other developers and serving as the primary escalation point for advanced ...

where you'll lead the design, development, and optimisation of enterprise-wide BI solutions using Microsoft Fabric, Power BI and advanced cloud-based data engineering technologies. About the Role As Senior BI Developer, you'll translate complex business requirements into scalable, high-quality BI solutions used across multiple … regions. You will design and maintain enterprise data models, architect advanced Power BI solutions, and lead development within a Microsoft Fabric Lakehouse environment. This role also acts as a technical leader within the BI practice, supporting other developers and serving as the primary escalation point for advanced ...

where you'll lead the design, development, and optimisation of enterprise-wide BI solutions using Microsoft Fabric, Power BI and advanced cloud-based data engineering technologies. About the Role As Senior BI Developer, you'll translate complex business requirements into scalable, high-quality BI solutions used across multiple … regions. You will design and maintain enterprise data models, architect advanced Power BI solutions, and lead development within a Microsoft Fabric Lakehouse environment. This role also acts as a technical leader within the BI practice, supporting other developers and serving as the primary escalation point for advanced ...

where you'll lead the design, development, and optimisation of enterprise-wide BI solutions using Microsoft Fabric, Power BI and advanced cloud-based data engineering technologies. About the Role As Senior BI Developer, you'll translate complex business requirements into scalable, high-quality BI solutions used across multiple … regions. You will design and maintain enterprise data models, architect advanced Power BI solutions, and lead development within a Microsoft Fabric Lakehouse environment. This role also acts as a technical leader within the BI practice, supporting other developers and serving as the primary escalation point for advanced ...

where you'll lead the design, development, and optimisation of enterprise-wide BI solutions using Microsoft Fabric, Power BI and advanced cloud-based data engineering technologies. About the Role As Senior BI Developer, you'll translate complex business requirements into scalable, high-quality BI solutions used across multiple … regions. You will design and maintain enterprise data models, architect advanced Power BI solutions, and lead development within a Microsoft Fabric Lakehouse environment. This role also acts as a technical leader within the BI practice, supporting other developers and serving as the primary escalation point for advanced ...

/React frontend, ensuring a highly performant, accessible, and intuitive user experience for AI-driven tooling, including real-time streaming interfaces and interactive data visualisations Lead the configuration and optimisation of Azure cloud environments, establishing robust CI/CD pipelines with GitHub Actions or Azure DevOps, and ensuring … junior and mid-level engineers to grow their capabilities hampion Responsible AI practices including model evaluation, bias monitoring, content filtering, and compliance with data protection regulations; define and maintain guardrails for LLM-powered features in production Identifying patterns in recurring issues and engineering permanent solutions Contribute to technical ...

RealityMine has been a pioneer in delivering data driven insights to the world's largest brands for over a decade. Our platform provides unique data solutions to our clients enabling them to make strategic, informed decisions powered by data from real people, collected … way. We are now looking for a Machine Learning Engineer to help build and optimise production-ready machine learning systems and advance our data pipelines for inference at scale. This is a pivotal role for someone who thrives in autonomous environments and enjoys owning solutions from concept ...

Cleared DevSecOps Platform Architect & Engineer to join a high-profile, secure military IT programme, delivering highly resilient, automated, and secure data platforms. This role sits at the intersection of DevSecOps, platform engineering, cloud infrastructure, and secure data systems, supporting advanced research and large-scale data … where failure is not an option, you'll feel right at home. Key Responsibilities Design, build, and maintain secure DevSecOps platforms supporting sensitive data workloads Architect and deliver automated CI/CD and GitOps pipelines for rapid, secure deployments Develop and manage secure cloud and hybrid infrastructure Implement ...

Implement monitoring using CloudWatch, Grafana, Prometheus, or OpenTelemetry. Enforce integration security practices: Authentication/Authorization IAM policies Encryption at rest/in transit Data governance & lineage Ensure solutions meet RPO, RTO, resiliency, disaster recovery, and failover requirements. Establish observability using tracing, logging, alerting, and dashboards. Collaborate with product … consumer groups Kafka Streams, ksqlDB Schema Registry & Avro/JSON/Protobuf Kafka Connect connectors Deep expertise in AWS streaming & messaging: Amazon Kinesis Data Streams, Firehose EventBridge (rules, event buses, routing) SQS/SNS with dead letter queues AWS Lambda event-based integrations Experience designing event-driven ...

through to clinical development. They are looking for an Informatics Specialist (2-year FTC) to play a key role in shaping how scientific data is captured, structured, and shared across research teams. This backend-focused role will centre on database systems, APIs, and data pipelines, with … particular emphasis on integrating Electronic Lab Notebook (ELN) platforms—building solutions to extract, transform, and transfer data between systems to support collaboration and downstream research. In this role, you’ll collaborate closely with scientists and technical teams to design and deliver scalable data solutions, helping ...

Title: Senior Data Engineer Work Model: Hybrid (3 Days Week) Location: Coventry, UK Role Description The Senior Data Engineer is responsible for designing, building, and maintaining scalable, high performance data platforms on Microsoft Azure. The role involves leading the development of secure, reliable … efficient data pipelines using Azure Synapse Analytics, Azure Data Factory, PySpark, and Azu click apply for full job details ...

Were seeking a Data Platform Engineer to design and build a modern enterprise data platform using Microsoft Fabric. Youll play a key role in architecting a secure, scalable and high-performance cloud environment that enables advanced analytics and data-driven decision making. This … hybrid role with 1 day a week in the Milton Keynes office. You will - Design and deliver a cloud-native data platform in Microsoft Fabric. Build and optimise data pipelines, lakehouse/warehouse solutions and semantic models. Implement Platform as Code (terraform) and CI/ ...

Software Engineer Gloucester, United Kingdom Reporting to: Practice Lead Company: Akkodis is a global leader in engineering, technology and R&D, harnessing connected data to drive digital transformation and innovation. With over 50,000 engineers and digital specialists across 30 countries, Akkodis supports organisations from concept through … enhances engineering workflows. In addition to core software development, you will integrate AI and machine learning components into engineering tools, contributing to scalable, data-driven systems deployed in production environments. Key Responsibilities: Lead software development activities and support engineering standards for scalable, maintainable codebases Design, build, test ...

Data Engineer 37 hours per week Monday – Friday, based at our offices on Preston Docks £45,000 - £50,000 per annum What will you be doing in this role? Your role is to ensure that high-quality, trustworthy data flows seamlessly to the people who need … most, from our frontline housing teams through to our Board. You will solve real-world problems by designing resilient data pipelines and modern models that turn raw information into a strategic asset. Whether you are helping us migrate to our new cloud-based platforms or ensuring our systems ...

Data Engineer - dbt - Python - Remote Unlock your potential in a rewarding Data Engineering role, where your expertise will drive innovative solutions using AWS technologies. This remote opportunity invites skilled professionals who thrive in fast-paced environments and are eager to make an impact. As the first … data hire, they are looking for someone to come with ideas, be proactive and guide the wider team. Equally, you be be given autonomy to make changes and drive strategic decisions. Key responsibilities and skills include:- Proficiency in data engineering principles, frameworks, and best practices.- Experience ...

Location: Oxford/London – Hybrid I’m currently working with a highly ambitious organisation building large-scale data platforms to power the next generation of scientific discovery. They are looking for Data Engineers with a background in genomics or bioinformatics to work directly alongside scientists … researchers, turning complex biological data into reliable, scalable datasets that can power AI and machine learning models. This role sits at the intersection of data engineering, genomics, and applied research - ideal for engineers who enjoy collaborating closely with scientists and building systems that enable real-world ...

HYBRID WORKING - BRADFORD HQ Your new role Urgent requirement for a Contract SQL Developer to design, develop and optimise SQL-based Data Warehouse and Master Data Management (MDM) solutions. You will be responsible for building and maintaining high-quality SQL objects & ensuring robust and efficient data … able to demonstrate the following key skills: Advanced SQL Server development (stored procedures, query optimisation, indexing strategies, tuning techniques) Strong understanding of data warehouse principles and dimensional modelling Experience working with MDM data structures and concepts Knowledge of ETL tools (Alteryx preferred) for data ...

TERM- Permanent SALARY- £60,000 to £90,000 per annum (plus benefits) My client is a technology-focused organisation developing advanced AI and data-driven solutions across a range of industries. They are looking to expand their technical team by hiring a Machine Learning Engineer to support … their offices in Reading. The Machine Learning Engineer will ideally have the following attributes: Knowledge/experience in Machine Learning, Artificial Intelligence, or Data Science A degree qualification (BSc, MSc, PhD etc.) in Computer Science, Data Science, Mathematics, Statistics, Artificial Intelligence or similar Strong programming skills ...