776 to 800 of 1,585 Data Pipeline Jobs in England

looking for Data Engineers to help deliver secure, mission-critical solutions for customers across the National Security sector. Working as part of a collaborative engineering team, you'll design and develop scalable data platforms, build robust data pipelines and transform complex datasets into meaningful … insights. You'll have the opportunity to work with modern cloud technologies, distributed systems and large-scale data environments on projects that have real-world impact. Key Responsibilities* Design and develop scalable data pipelines and ingestion frameworks * Integrate, process and enrich data from multiple ...

Architect with strong domain expertise in Human Resources and Legal technology, combined with a deep understanding of AI-enabled solutions, enterprise integrations, and data-driven platforms. This role will define and deliver end-to-end architecture for HR and Legal solutions, ensuring scalability, integration, and alignment with enterprise … data strategies. KEY RESPONSIBILITIES Define end-to-end architecture for HR and Legal platforms with a focus on SAP SuccessFactors and employee experience solutions Design AI-enabled HR and Legal solutions (e.g., copilots, automation, personalization, analytics-driven insights) Lead integration architecture across HR, Legal, enterprise systems ...

Location: LondonDepartment: DataExperience Level: Experience ProfessionalsContact: Paul KrugJob ID: REQ8345About the RoleWe are seeking a Data Engineer to join our Geospatial Data Science team supporting commodities trading. In this role, you will build and maintain the data pipelines and geospatial infrastructure that will … example, turn raw vessel-movement data (AIS), port activity, and cargo flows into actionable trading signals across energy, agricultural, and metals markets.You will work at the intersection of large-scale geospatial engineering and front-office trading, collaborating closely with portfolio managers, quantitative researchers, and fellow data ...

Architect with strong domain expertise in Human Resources and Legal technology, combined with a deep understanding of AI-enabled solutions, enterprise integrations, and data-driven platforms. This role will define and deliver end-to-end architecture for HR and Legal solutions, ensuring scalability, integration, and alignment with enterprise … data strategies. KEY RESPONSIBILITIES Define end-to-end architecture for HR and Legal platforms with a focus on SAP SuccessFactors and employee experience solutions Design AI-enabled HR and Legal solutions (e.g., copilots, automation, personalization, analytics-driven insights) Lead integration architecture across HR, Legal, enterprise systems ...

seeking a Senior Databricks Architect to design, implement, and optimize enterprise-scale data platforms using the Databricks Lakehouse Platform . The ideal candidate will have deep expertise in Databricks architecture, Apache Spark, Delta Lake, data engineering, cloud platforms, and enterprise data solutions. Key Responsibilities … Design and architect Databricks Lakehouse solutions for large-scaleenterprise data platforms. Lead end-to-end Databricks implementation, including architecture, development, deployment, and optimization. Define Databricks workspace architecture, clusterstrategies, security models, and operational standards. Design and developscalable data pipelinesusing Databricks, Apache Spark, PySpark, SQL, andDelta Lake . ...

sexual orientation, veteran status, or any basis prohibited by the laws that govern its operations.How does this role contribute to our collective success Data and analytics are of critical importance for AXIS. Simply put, we want to turn data into information, that can be used … pairing, structured code reviews, and knowledge-sharing sessions on emerging techniques and tools.Resource & Capacity Planning: Support the Head of in tracking the project pipeline, estimating costs (including cloud compute and API consumption), and managing resource allocation to ensure the team is effectively deployed against priorities.Technology Vision: Stay current with ...

extensive market insights quickly, the Lead Ruby Engineer will play a crucial role in shaping this product.Key Responsibilities:Scale systems to handle increasing data streams.Collaborate with a team of experienced engineers on next-gen research and data analysis tools.Utilise Ruby and JavaScript daily, integrating with data pipelines for Data Lake, Data Warehouse, ML training loops, and data operations workflows.Requirements:Strong expertise in Ruby and Rails with 7+ years of experience.Solid understanding of object-oriented programming and relational databases (PostgreSQL).Proficient in writing tested code (unit and acceptance tests ...

orientation, veteran status, or any basis prohibited by the laws that govern its operations. How does this role contribute to our collective success? Data and analytics are of critical importance for AXIS. Simply put, we want to turn data into information, that can be used … pairing, structured code reviews, and knowledge‐sharing sessions on emerging techniques and tools. Resource & Capacity Planning: Support the Head of in tracking the project pipeline, estimating costs (including cloud compute and API consumption), and managing resource allocation to ensure the team is effectively deployed against priorities. Technology Vision: Stay ...

about building and delivering transformative digital solutions for a diverse range of Public and Private sector clients. We are recruiting for a Senior Data Engineer to join our Hippo Herd. We work at the intersection of strategy, design, and technology to solve complex problems and create lasting value. … collaborative and agile culture empowers our teams to make a genuine impact. As a Senior Data Engineer, you will play an important role in making Hippo the best Consultancy out there. You will work as part of a multi-disciplinary team combining data, design, product, delivery ...

about building and delivering transformative digital solutions for a diverse range of Public and Private sector clients. We are recruiting for a Senior Data Engineer to join our Hippo Herd. We work at the intersection of strategy, design, and technology to solve complex problems and create lasting value. … collaborative and agile culture empowers our teams to make a genuine impact. As a Senior Data Engineer, you will play an important role in making Hippo the best Consultancy out there. You will work as part of a multi-disciplinary team combining data, design, product, delivery ...

about building and delivering transformative digital solutions for a diverse range of Public and Private sector clients. We are recruiting for a Senior Data Engineer to join our Hippo Herd. We work at the intersection of strategy, design, and technology to solve complex problems and create lasting value. … collaborative and agile culture empowers our teams to make a genuine impact. As a Senior Data Engineer, you will play an important role in making Hippo the best Consultancy out there. You will work as part of a multi-disciplinary team combining data, design, product, delivery ...

Location: Hybrid/Monument St, London EC3R 8AJ, UK job type: Permanent/Full-time Sector and subsector: IT | Data Engineer Salary: Competitive salary Platform Architecture & Engineering responsibilities: Design and implement scalable Databricks Lakehouse platforms on AWS and/or Azure aligned to client requirements Architect … data platforms including ingestion, storage (Delta Lake), processing, and consumption layers Build and configure cloud infrastructure using infrastructure-as-code (e.g. Terraform & Declarative Automation Bundles(DAB's)) Establish secure, compliant environments including networking (VNet/VPC, Private Link), identity (IAM/Entra ID), data governance (Unity ...

Technical Account Manager - ETFs and Mutual Funds Location London Business Area Data Ref # 10053247 Description & Requirements Bloomberg runs on data and the Data department is responsible for acquiring and supplying data, news and analytics to our clients for their financial data needs. We collect, analyse, process and publish the data which is the backbone of our iconic Bloomberg Terminal; the facts and figures which ultimately move the financial markets. We apply problem-solvin g skills to identify innovative workflow efficiencies, and we implement technology solutions to enhance ...

pipelines that support rapid model iteration, automated testing, and safe deployments. Support ML workflow orchestration; experiment tracking, training run management, and data pipeline reliability. Ensure reproducibility across research and production environments through containerisation and rigorous environment management. Define monitoring, alerting, and incident response processes so the team … services (compute, storage, networking, IAM). Hands-on experience with infrastructure-as-code and container orchestration (Kubernetes or equivalent). Solid CI/CD pipeline experience, GitHub Actions, GitLab CI, or similar. Proficient in Python and Bash; comfortable reading and writing code across a polyglot stack. Deep Linux systems ...

team, the post holder will act as a trusted analytical partner, helping stakeholders understand their information requirements and translating these into high-quality data products, dashboards, reports, and insights. Main duties of the job The role combines advanced analytical and technical expertise with strong stakeholder engagement skills, requiring … post holder to build and maintain effective relationships across multiple organisations. They will lead on the development of complex datasets, reporting solutions, data pipelines, and automation processes, while ensuring high standards of data quality, governance, and information security. About us Here is a not-for-profit ...

exciting opportunity for a Data & ML Engineer to join a thriving technology and innovation hub where talented engineers, data specialists and industry experts come together to build solutions that make a real difference. Working across a diverse range of projects, youll have the opportunity to work … with cutting-edge technologies, solve challenging data problems and develop your expertise across the rapidly evolving world of AI. You will have the opportunity to: Design and implement robust data pipelines and ML workflows using Python, SQL, Spark and Databricks. Develop and deploy machine learning models ...

market insights quickly, the Lead Ruby Engineer will play a crucial role in shaping this product. Key Responsibilities: Scale systems to handle increasing data streams. Collaborate with a team of experienced engineers on next-gen research and data analysis tools. Utilise Ruby and JavaScript daily, integrating … with data pipelines for Data Lake, Data Warehouse, ML training loops, and data operations workflows. Requirements: Strong expertise in Ruby and Rails with 7+ years of experience. Solid understanding of object-oriented programming and relational databases (PostgreSQL).Proficient in writing tested code ...

RoleWe are seeking a talented Senior Software Engineer to help build and run the data services and platform behind Datalex's dynamic pricing and offer optimisation. This is a Python-first, backend and infrastructure-focused role: you will work on end-to-end solutions — from robust application code … data pipelines through to APIs, infrastructure-as-code, and production monitoring.You will design and maintain the services that turn large volumes of pricing and offer data into fast, reliable, production-grade functionality, and you will help integrate machine learning and optimisation models into that pipeline. ...

role is hybrid and would only require 1 day a week in the office. The Role You must have experience in leading data & analytics engineering platforms. In this role, you will play a pivotal role in driving the business-critical transformation of technology delivery and supporting the achievement … delivery teams at scale (30+ colleagues, multiple suppliers) Good grounding in technology and data software delivery including system design, data pipeline development, or delivery management Proven experience identifying and delivering continuous improvement through innovation, agile transformation and operational improvement initiatives Experience operating at senior stakeholder ...

5+ years. Here are some things we’ve worked on recently that give a sense of the work we do:Building a data analytics tool using a Neo4J graph database.A DevOps platform to support 3000 users.Processing digital forensic data to enable search and insight generation.A search … reporting system backed by an Elasticsearch cluster.A custom workflow tool with a React/TS front-endAn AI assurance capabilityOrchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts.About the Role:As a Senior Software Engineer, you will ...

hybrid work model, requiring onsite presence for 2 days per week. The ideal candidate will design and optimize machine-learning models, maintain data pipelines, and supervise models in production. Candidates should have proficiency in Python and experience with ML frameworks like TensorFlow and PyTorch, along with strong analytical ...

networks, and security frameworks.Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques.Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines.Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment.Strong experience in solution architecture, technical ...

5+ years. Here are some things we’ve worked on recently that give a sense of the work we do:Building a data analytics tool using a Neo4J graph database.A DevOps platform to support 3000 users.Processing digital forensic data to enable search and insight generation.A search … backed by an ElasticSearch cluster.A custom workflow tool using Camunda, with a React/TS front-endAn AI assurance capabilityOrchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts.About the Role:As a Senior Software Engineer, you will ...

building software in production, ideally at the senior or staff level. Strong in Python. You will write Python daily, backend services, agents, evals, data pipelines. Hands-on ML engineering experience: trained, evaluated and deployed models in production, not just used them via an API. Real comfort with cloud ...

most exciting projects in the world. Please visit our website: Job DescriptionJoin a flagship Defence programme contributing to the development and deployment of data management applications within a secure and complex environment. This role offers the opportunity to gain security clearance, work with cutting-edge technologies like Palantir … Foundry, and build strategic capabilities in data modelling and application development. Key responsibilitiesCollaborate with client stakeholders to identify and prioritise Key User Requirements (KURs) Design and develop data-driven applications and features aligned to user needs Build and manage data pipelines for ingestion ...