251 to 275 of 299 Data Pipeline Jobs in the North of England

Leonard Curtis is seeking a Data Engineer to build, maintain, and optimise robust data pipelines. This role develops efficient ETL/ELT workflows using Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics. You will implement … Delta Live Tables, write PySpark and SQL in Fabric Notebooks and Databricks clusters, and ensure data access control, quality checks, and governance through Unity Catalog. #J-18808-Ljbffr ...

Australia and New Zealand.The RoleTo take technical responsibility for the operation and modernisation of Peninsula’s finance and HR systems, working in the Data Team, alongside our in-house Development Team and third-party technology suppliers across the globe. We seek technical experts with:Substantial experience of developing … solutions, data pipelines and systems integrations in both legacy and contemporary technologies using the Microsoft stack.A proven track record working with finance professionals, systems, processes and data.A history of liaising with stakeholders at the highest level in international corporate businesses.Reporting to the Associate Director of Data ...

Lead AI Engineer Leeds or Edinburgh £72,000 - £108,000 Your new role The Data, Technology and Innovation (DTI) division enables the group to be a digital-first, data-led smart regulator by delivering a secure, agile, and cost-effective technology and data ecosystem … consistency and delivery quality to enable more reliable and scalable product development Establish end-to-end technical architectures for LLM-enabled systems, covering data pipelines, retrieval/RAG, prompt orchestration and agent workflows to support robust and effective AI implementation Analyse complex constraints across product, data ...

Morrisons is seeking an Analytics Engineer to join our Data & Analytics team at our Head Office. You will shape data models and centralised semantic layers that power trusted reporting and data products across the business. You’ll translate complex business requirements into scalable data structures, mentor colleagues on SQL and data testing, and collaborate with stakeholders to drive insight-driven decisions while optimising data pipelines on Google Cloud Platform. #J-18808-Ljbffr ...

days per week, or 40% of your time, at one of our above office sites About this opportunity We're transforming how data and security are engineered across Lloyds Banking Group, using data, automation and modern architectures to detect, disrupt and deter threats at pace … scale. Within the Chief Security Office, our Security Data & AI Lab is building intelligent, AI-driven security capabilities that help keep our customers and colleagues safe! As a Site Reliability Engineer, you'll join a collaborative team focused on the resilient operation of cloud-hosted applications and services. ...

production ML/AI platforms on Microsoft Azure. You will coach a compact team of MLOps, Analytics and AI Engineers, and collaborate with Data Science and Software teams to push reliable, auditable models into production. The role emphasises governance, CI/CD, and scalable data pipelines. ...

existing codebase while growing your skills in an agile, supportive environment. Required Skills & Experience of the Software Engineer: Strong Python: Writing and maintaining data pipelines. Able to solve complex problems. Excellent written, oral and visual communication skills to explain complex information. Enjoys and works well in a team … modifying existing/legacy codebases; good documentation and PR practices. SQL Databases: PostgreSQL and SQLite experience (schema design, migrations, basicperformance tuning). Orchestration & data engineering: experience with workflow/orchestration tools (Prefect or similar) and distributed task queuing (e.g. Celery, RabbitMQ). Testing & automation: writing unit and basic ...

Somerset Bridge Group is modernising its data platform to enable analytics, reporting, and AI initiatives across Pricing, Underwriting and Claims. You will design and build scalable data pipelines on Azure Databricks and Delta Lake, with governance, security, and real-time processing at scale. The role sits … Enterprise Data Team and requires strong SQL and PySpark, plus experience with cloud-native data platforms. Hybrid working available, with 2 days in the office and 3 days from home. #J-18808-Ljbffr ...

Hippo Digital Limited in Leeds is seeking a Lead Data Engineer to join our growing data practice. You will lead a multidisciplinary team to design, build and scale data pipelines, governance, and analytics platforms for public and private sector clients. You will … technical leader, mentor engineers, and drive strategic data engineering deliverables, while maintaining strong client relationships and promoting best practices in CI/CD, cloud, and data modelling. #J-18808-Ljbffr ...

dashboards. Working with key stakeholders to develop and deliver a digital transformation roadmap focused on efficiency, waste reduction and continuous improvement. Partnering with Data Science and AI teams to explore how predictive analytics can be integrated into production processes. Identifying opportunities to improve manufacturing performance through digital tools … automation, data insights and Industry 4.0 solutions. Creating governance and change management processes for internally developed digital tools, ensuring they are secure, structured and sustainable. Tracking the success of digital initiatives by defining and monitoring KPIs, ensuring digital investments deliver measurable improvements. Acting as the link between ...

Manufacturing Technology Centre (MTC) in the United Kingdom invites an AI & Data Science Engineer to join multidisciplinary engineering projects. You will develop ML models, build data pipelines and create Python‐based tools to support decision‐making and system intelligence across teams. You will work with senior ...

Role Overview and Responsibilities TT Electronics, Bedlington , are hiring for a Lead Digitisation Engineer to lead the strategy, architecture, and implementation of automated data pipelines, IoT integration, smart manufacturing systems, and advanced analytics. Working directly to drive yield optimisation, predictive maintenance, and lights-out automation across our cleanroom … infrastructure. Key Responsibilities Include: Designing and owning the Industry 4.0 Strategy & Roadmap. Driving the integration of legacy and modern microelectronics equipment. Architecting robust data pipelines to collect, store, and analyse process data. Collaborating with process engineers to implement advanced process control (APC), statistical process control (SPC), and machine ...

Vertus Partners is seeking an experienced AI/data engineer to help with the greenfield design and build of the next generation data foundations that power search, analytics and AI-driven applications across the business. This is a hands-on role focused on designing robust data pipelines, improving data accessibility and creating scalable solutions that enable better use of information across a complex technology environment. #J-18808-Ljbffr ...

Langham Recruitment is seeking a hands-on Senior Data Engineer for a well-established SaaS company in Huddersfield. The role involves end-to-end ownership of data pipelines, models and reporting that underpin the platform, with shaping future data architecture. You will work across … full data lifecycle, solve complex data problems and mentor junior engineers in a highly collaborative environment. #J-18808-Ljbffr ...

independent design assurance for new cloud-based services and solutions, including cloud environments supporting the client's developing AI strategy, AI services and data platforms. Responsibilities Provide security architecture consultancy across AWS and Azure projects. Review and assure cloud solution designs against security standards, policies and architecture principles. … Develop secure reference architectures, patterns and guardrails for multi-cloud environments. Support the secure design of environments for AI services, data platforms, experimentation and production AI workloads. Conduct security design reviews across cloud applications, services and infrastructure. Identify security risks and provide practical, proportionate remediation recommendations. Embed security ...

Noir Consulting is seeking a talented Data Engineer in Newcastle to build and optimize systems handling complex datasets. You will develop high-quality data pipelines and enhance the central data platform to support investment decision-making. The ideal candidate should have experience ...

CreateFuture is delivering the migration of an ML estate from Databricks to an AWS SageMaker-based MLOps platform. The Senior Data Engineer (ML) will build and migrate data pipelines feeding model training and inference, ensuring parity with the old Databricks setup. This hands-on role operates ...

CreateFuture is delivering the migration of an ML estate from Databricks to an AWS SageMaker-based MLOps platform. The Senior Data Engineer (ML) will build and migrate data pipelines feeding model training and inference, ensuring parity with the old Databricks setup. This hands-on role operates ...

Electronics, Bedlington , are hiring for a Lead Digitisation Engineer to lead the strategy, architecture, and implementation of automated data pipelines, IoT integration, smart manufacturing systems, and advanced analytics. Working directly to drive yield optimisation, predictive maintenance, and lights-out automation across our cleanroom and assembly lines … infrastructure. Key Responsibilities Include: Designing and owning the Industry 4.0 Strategy & Roadmap. Driving the integration of legacy and modern microelectronics equipment. Architecting robust data pipelines to collect, store, and analyse process data. Collaborating with process engineers to implement advanced process control (APC), statistical process control (SPC), and machine ...

McGregor Recruitment is recruiting a Data Engineer for a major Financial Services client. Location options include Bristol, Leeds, Manchester or Edinburgh, with an initial 3-month duration and potential extension. The role focuses on building scalable data pipelines and knowledge solutions to support an Enterprise Knowledge … Base. You will handle data ingestion, enrichment, indexing and knowledge graphs, transforming enterprise data into searchable, governed formats for AI consumption. #J-18808-Ljbffr ...

Work closely with product and engineering teams, validating releases, triaging issues, and representing customer technical needs with precision. Read and reason about configurations, data structures, integration patterns, and API behaviour well enough to scope work accurately and challenge estimates. Feed structured, prioritised insight back into the product roadmap …/C-level sponsors, with the gravitas to hold difficult conversations and the empathy to keep relationships strong. Technical fluency, comfortable reading configurations, data mappings, logs, and API documentation, and able to converse credibly with engineers and challenge technical assumptions. Clear, structured written and verbal communication, including executive ...

control evidence from source systems. Build automated processes that test cybersecurity controls and identify failures, gaps and downward trends. Develop and maintain data pipelines that extract, normalise and securely transfer control evidence. Use Python and PowerShell to build automation and integration processes. Use Jenkins, GitHub Actions or similar … automation behind a major cybersecurity controls monitoring capability. You'll have genuine ownership of the technology, working across cybersecurity, cloud, automation, APIs and data to help continuously prove that security controls are working. We are an equal opportunities employer and welcome applications from all backgrounds. We are committed ...

security engineer and leading engineering initiatives in a DevSecOps environment. Strong expertise securing AI and ML systems at scale, including model lifecycle security, data pipelines, and secure deployment. Strong hands‐on experience with machine learning stacks, such as PyTorch, TensorFlow, MLflow, Kubeflow, or equivalent managed platforms (e.g. Vertex … future, whilst the scale and reach of our Group means you’ll have many opportunities to learn, grow and develop. We keep your data safe. So, we’ll only ever ask you to provide confidential or sensitive information once you have formally been invited along to an interview ...

senior security engineer and leading engineering initiatives in a DevSecOps environment.Strong expertise securing AI and ML systems at scale, including model lifecycle security, data pipelines, and secure deployment.Strong hands‐on experience with machine learning stacks, such as PyTorch, TensorFlow, MLflow, Kubeflow, or equivalent managed platforms (e.g. Vertex … future, whilst the scale and reach of our Group means you'll have many opportunities to learn, grow and develop.We keep your data safe. So, we'll only ever ask you to provide confidential or sensitive information once you have formally been invited along to an interview ...

senior security engineer and leading engineering initiatives in a DevSecOps environment.Strong expertise securing AI and ML systems at scale, including model lifecycle security, data pipelines, and secure deployment.Strong hands‐on experience with machine learning stacks, such as PyTorch, TensorFlow, MLflow, Kubeflow, or equivalent managed platforms (e.g. Vertex … future, whilst the scale and reach of our Group means you'll have many opportunities to learn, grow and develop.We keep your data safe. So, we'll only ever ask you to provide confidential or sensitive information once you have formally been invited along to an interview ...