351 to 375 of 430 Data Pipeline Jobs in England

Description Marketing Data Manager - Manchester Marketing Data Manager with extensive experience in Excel, VBA, Power Query & Power BI is required by a leading e-commerce company in Manchester. You should have retail/e-commerce experience. xkybehq Any experience building data pipelines or website … pricing data would be a bonus. This role is ideal for someone who thrives on data management and enjoys working with spre Learn more about the general tasks related to this opportunity below, as well as required skills. Please click on the apply button to read ...

responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor … products and services Design solutions for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs ...

responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor … products and services Design solutions for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs ...

Were seeking a Data Platform Engineer to design and build a modern enterprise data platform using Microsoft Fabric. Youll play a key role in architecting a secure, scalable and high-performance cloud environment that enables advanced analytics and data-driven decision making. This … hybrid role with 1 day a week in the Milton Keynes office. You will - Design and deliver a cloud-native data platform in Microsoft Fabric. Build and optimise data pipelines, lakehouse/warehouse solutions and semantic models. Implement Platform as Code (terraform) and CI/ ...

systems and AI agents that leverage LLMs and retrieval‐augmented generation (RAG) to provide contextual, reasoning‐based capabilities. Develop cloud‐native microservices and data pipelines to deliver high‐performance inference and contextual retrieval across multiple data sources. Implement frameworks for orchestration, task planning and memory management … Rust; experience with cloud platforms (AWS, Azure, GCP) and container orchestration (Kubernetes). Familiarity with AI/ML inference frameworks, vector databases and data streaming systems. Strong problem‐solving skills, ability to mentor peers and thrive in a dynamic startup environment. ...

functionality, including automated responses, predictive analytics, and risk scoring • Integrating with OpenAI APIs and exploring in-house model training and fine-tuning • Creating data pipelines to support ML workflows, from preparation to deployment and monitoring • Writing and maintaining APIs for our React/TypeScript frontend • Contributing to frontend … work: • User stories are managed on Monday.com • Code quality is enforced through automated testing, PHPStan static analysis, and Laravel Pint formatting • CI/CD pipeline with automated deployments • CloudWatch for monitoring What we offer: • 25 days holiday + your birthday off (if it falls during the working week) • Flexible ...

between application monitoring and infrastructure, leveraging different tools like tools. Your Profile Essential Skills/Knowledge/Experience Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) at scale. Stream OpenShift telemetry via Kafka (producers, topics, schemas) and build resilient consumer services … transformation and enrichment. Engineer data models and routing for multi-tenant observability; ensure lineage, quality, and SLAs across the stream layer. Integrate processed telemetry into Splunk for visualization, dashboards, alerting, and analytics to achieve Observability Level 4 (proactive insights). Implement schema management (Avro/Protobuf), governance ...

Lead Data Engineer - Databricks - £75-80k + bonus + benefits - Basingstoke 3 days a week The Opportunity: We are looking for a Lead Data Engineer with good Databricks expeirence to join a Basingstoke based organisation who are investing heavily in their Digital Transformation Programme. … lead a small team whilst contributing personally - Be able to drive agile, modern engineering practises - Champion quality, observability and good engineering discipline, ensuring pipeline and models run cleanly and predictably ...

Google Cloud, or Azure. Knowledge of containerization and orchestration tools like Docker and Kubernetes is a plus. Experience designing end to end ML data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda … stay up-to-date with the state-of-the-art open source infrastructure solutions applicable to designing and improving large scale recommender systems, data engineering, and machine learning You have a Master’s or PhD in Computer Science, statistics, or an engineering field with 5+ years of experience ...

into existing systems and workflows. Analyse business processes with stakeholders to identify automation opportunities and define clear requirements. Develop automation scripts and build data pipelines covering ingestion, preprocessing and feature engineering. Conduct testing, troubleshooting and performance monitoring to maintain system accuracy and reliability. Collaborate with data ...

Kubernetes skills Experience shipping and operating production systems (“you build it, you run it”) Solid cloud security knowledge: identity, access control, logging, and data protection Strong consulting, communication, and leadership skills Passion for learning and applying emerging technologies Desirable Python engineering experience and API development Experience with data ...

Industry Experience Required. Payrate: £400 - £500 per day INSIDE IR35 Umbrella The Mission We need an experienced Delivery Lead to drive high-priority Data & Analytics initiatives for a major Telco. You will lead a cross-functional squad (onshore & offshore) to deliver a GCP platform re-architecture and automated … self-serve reporting (Qlik/Looker/PowerBI). What You'll Do Lead Delivery: Manage sprint ceremonies, backlogs, and flow for data engineering and analytics teams. Manage Vendors: Coordinate effectively with offshore partners to ensure seamless delivery. Unblock: Navigate complex data dependencies and remove impediments ...

Industry Experience Required. Payrate: £400 - £500 per day INSIDE IR35 Umbrella The Mission We need an experienced Delivery Lead to drive high-priority Data & Analytics initiatives for a major Telco. You will lead a cross-functional squad (onshore & offshore) to deliver a GCP platform re-architecture and automated … self-serve reporting (Qlik/Looker/PowerBI). What You'll Do Lead Delivery: Manage sprint ceremonies, backlogs, and flow for data engineering and analytics teams. Manage Vendors: Coordinate effectively with offshore partners to ensure seamless delivery. Unblock: Navigate complex data dependencies and remove impediments ...

Industry Experience Required. Payrate: £400 - £500 per day INSIDE IR35 Umbrella The Mission We need an experienced Delivery Lead to drive high-priority Data & Analytics initiatives for a major Telco. You will lead a cross-functional squad (onshore & offshore) to deliver a GCP platform re-architecture and automated … self-serve reporting (Qlik/Looker/PowerBI). What You'll Do Lead Delivery: Manage sprint ceremonies, backlogs, and flow for data engineering and analytics teams. Manage Vendors: Coordinate effectively with offshore partners to ensure seamless delivery. Unblock: Navigate complex data dependencies and remove impediments ...

accessible financial markets for all types of investors, this is a high-impact opportunity to be part of a company redefining financial data infrastructure from the ground up. Responsibilities Design and implement scalable, high-performance data pipelines Develop backend services and APIs to support data processing and analytics Build integrations with external vendors and market data providers Tech Stack Python AWS (Lambda, ECS, CloudFormation, S3) GitHub Actions (CI/CD) Vue.js (optional frontend involvement) Requirements 2+ years’ experience as a Data Engineer or Backend Engineer Proficiency in Python Experience ...

processes and testing pipelines to support quick iterative development and system stability. Work on ML model development with our team to build robust data pipelines and deploy ML models. Analyse large corpora of data and build real-time recommendation systems. Work with large amounts of data ...

About Us We build decision-making infrastructure for complex, real-world systems. Our platform combines edge-deployed sensors and intelligence with centralised algorithms, data pipelines, and graph-based analytics. We work primarily in global logistics, where we ingest data from sensors, emails, spreadsheets, and external databases … devices and agents. The system includes edge devices with onboard sensors and compute, a central cloud-based analytics layer, and a graph-based data store and algorithmic engine that supports both machine learning and rules-based logic. Job Description We are hiring a Senior QA Engineer ...

Summary: We are partnering with a leading global consultancy who are looking to hire a highly skilled Databricks Engineer to deliver modern, scalable data platforms for enterprise clients. This is a hands-on engineering role, focused on building, optimising, and operating Databricks-based Lakehouse solutions across cloud environments. … Responsibilities: Design, build, and maintain data pipelines using Databricks (Spark, Delta Lake). Develop batch and streaming workloads using PySpark/Spark SQL. Implement data ingestion, transformation, and orchestration pipelines. Optimise Databricks workloads for performance, reliability, and cost. Integrate Databricks with cloud-native services across Azure ...

Augmented Generation (RAG) AI agents and orchestration workflows Designing and maintaining backend services and APIs (primarily Python, FastAPI/Flask) Building and scaling data pipelines and search systems using: ElasticSearch, Weaviate, Pinecone, and other vector databases Engineering secure, containerised architectures using Docker and Kubernetes Ensuring high availability, fault … Experience in defence, government, healthcare, or other regulated domains Familiarity with DevOps practices, CI/CD pipelines, and infrastructure as code Exposure to data engineering, ETL pipelines, or high-volume data processing Experience working in SME or start-up environments , comfortable wearing multiple hats Salary ...

Product Engineer (Data/Platform/Applied AI) £65,000 - £80,000 Location: London (Hybrid – 3 days onsite) Level: Mid–Senior (roughly 2–6 years’ experience) The Opportunity We’re working with a fast-growing, venture-backed technology company building an enterprise data and AI platform … Product Engineer — someone who enjoys building real products , not just pipelines or one-off solutions. This role sits at the intersection of data engineering, backend engineering, and product thinking , with exposure to modern AI-enabled workflows. You’ll work on problems where customer needs are complex and messy ...

Deliver applied research and technical innovation projects Translate complex business and actuarial problems into technical solutions Design and develop analytical models, algorithms, and data pipelines Build tools and prototypes using Python and modern data science techniques Work closely with actuarial, consulting, and engineering teams Contribute … working across multiple projects and problem domains. Required Skills & Experience Master's degree or PhD in a quantitative discipline (Mathematics, Physics, Computer Science, Data Science, Engineering, Statistics or similar) Strong programming skills in Python, R, or similar Excellent mathematical modelling and analytical skills Experience working with large ...

contribute to a broad range of software systems and infrastructure that underpin Vertical’s aircraft programmes. Your work may include: Building secure, scalable data pipelines from aircraft and test rigs to the cloud Developing full-stack web applications to support internal engineering and operational workflows Automating and monitoring … services Prototyping and defining cloud architectures for certified and in-service aircraft Supporting and enabling non-software engineering teams through scripting, tooling, and data processing What You’ll Bring Strong software engineering fundamentals, including networking, data, and system design Proven experience delivering high-quality software ...

Google Cloud, or Azure. Knowledge of containerization and orchestration tools like Docker and Kubernetes is a plus. Experience designing end to end ML data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda … stay up-to-date with the state-of-the-art open source infrastructure solutions applicable to designing and improving large scale recommender systems, data engineering, and machine learning You have a Master’s or PhD in Computer Science, statistics, or an engineering field with 5+ years of experience ...

native services Translate business problems into deployable ML solutions Develop and maintain end-to-end ML pipelines (training, testing, deployment, monitoring) Work with data scientists and engineers to operationalise models at scale Implement best practices for model performance, versioning, and lifecycle management Ensure solutions are secure, scalable … Platform Experience with services such as Vertex AI, BigQuery, Cloud Storage, and Cloud Functions/Cloud Run Solid Python experience for ML and data engineering workloads Experience productionising models (not just experimentation or notebooks) Understanding of MLOps concepts: CI/CD, monitoring, retraining, and model governance Ability ...

deliver technical security work packages in support of wider organisational security strategies. Advise on secure adoption of emerging technologies including AI models, data pipelines, automation, and cloud-native architectures. Translate complex cyber and AI-related risks into clear, actionable insights for non-technical audiences. Identify and mitigate … specific threats such as model abuse, data leakage, prompt injection, bias, and automation risks. Act as the organisation's technical security subject-matter expert. Provide escalation support during cyber incidents, including incidents involving AI-enabled platforms. Lead and oversee technical assurance activities, including IT Health Checks and security ...