1,176 to 1,200 of 1,710 Data Pipeline Jobs in the UK

Research, working daily with: Research Scientists who determine the model architectures and methods ML Engineers who implement and develop the models Simulation Data Engineers who are accountable for upstream data pipelines You will have end-to-end responsibilities over the research infrastructure, with the autonomy … scale: Deep expertise in distributed training: you've debugged NCCL hangs, optimized collective communication, and know when to use FSDP vs. DDP vs. pipeline parallelism Strong systems fundamentals: Linux, networking (including domain specific NVLink and InfiniBand), storage I/O, profiling and performance optimization Production experience with Kubernetes ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemerally environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

organisation’s mission of advancing the mobile ecosystem and enabling innovation across global digital infrastructure. This role sits within GSMA’s data and technology function and focuses on designing, developing, and deploying advanced artificial intelligence solutions to support internal operations, member services, and industry initiatives. The successful candidate … systems, working closely with cross-functional teams to translate business requirements into technical solutions. Responsibilities include developing and optimising machine learning models, implementing data pipelines, and ensuring the robustness and scalability of AI-driven applications. The role also involves contributing to AI strategy, evaluating emerging technologies, and promoting ...

external partners, providing plant sciences subject matter expertise to co‐develop AI and automation solutions that transform and accelerate plant transformation workflows while enhancing pipeline efficiency. The successful candidate will work within a matrixed, cross functional project team to guide the design and deployment of technology which integrates robotics … matter expertise to design, develop and implement automated robotic systems for transformation and tissue culture workflows. Co‐develop computer vision systems for the transformation pipeline, validation of phenotyping and automation tools, and performance optimization. Lead the data strategy and validation of predictive ML models to optimize transformation ...

code and ensure robust, well-documented releases. Your Responsibilities Oversee architecture across trading, clearing and post-trade systems, including integrations with CCPs, exchanges, data/platform vendors and customers. Direct modernisation of integration patterns and frameworks, reinforcing strong security principles and practices. Steer data architecture strategy … data quality, ownership, security and accessibility. Chair architecture governance forums, driving timely, effective architectural decisions. Produce architecture documentation, architectural decision records, target-state blueprints and audit-ready artefacts. Design resilient systems meeting RTO/RPO requirements and FCA operational resilience obligations. Meet regulatory obligations by design (FCA/ ...

Data Scientist (AI & Machine Learning) – Renewable Energy & Emerging Technologies London/Hybrid About the Role We\'re looking for an AI-focused Data Scientist to join our Engineering & Development team, helping transform how renewable energy projects are identified, evaluated and developed. You\'ll work … technologies can improve the way renewable energy projects are developed. You\'ll also have the opportunity to contribute to new technology areas including data centres, onshore wind and future energy infrastructure. The organisation sees AI and advanced analytics as a key enabler of future growth and is looking ...

Barclays is seeking a skilled Data Scientist to design and implement ML models for financial crime risk management, including transaction monitoring and fraud detection. You will manage data pipelines, ensure data quality, and explore analytics to support governance across multiple jurisdictions. The role requires ...

Search, SEO, AI Search, Display (Meta, TikTok, etc.), Affiliates, and the next wave of channels yet to emerge. You’ll partner with engineering, data, and marketing teams to build products that efficiently drive new subscribers to Preply at unprecedented scale. Core Responsibilities: Scale paid acquisition channels through Product … posts and optimises millions of keywords - from discovery, through bidding, account structure, and ad copy generation. Push the team toward an always-on, data-driven automated scale of operations. Build creative automation for Display channels - generating, tracking, testing and iterating on creatives, across dozens of languages and regions. ...

global scale. WHAT YOU'LL BE DOINGStrategy & MetricsOwn the Numbers: Define, track, and socialize the core KPIs and OKRs for your product. Enable Data: Own necessary data logging and ensure pipelines are built for accurate product tracking. Drive Insights: Conduct deep-dive analysis to identify … BRINGExpert-level SQL skills with experience querying, manipulating and transforming large, complex, and relational datasets into functional pipelines. Experience designing and building automated data pipelines and transformations. Strong product thinking skills with the ability to translate customer needs into defining the right problem statements, success metrics, and opportunity ...

businesses are the backbone of the economy, and we’re here to help them win. We’ve built a platform that uses clever data to get them the funding they need in minutes, not weeks. At Funding Circle, we have the restless energy of a fintech start … campaigns and operational processes Use agentic AI tooling to automate structured tasks and remove delivery bottlenecks Build and maintain scalable, low-code data pipelines between marketing platforms, data sources and reporting tools Monitor and own the health of platforms: identify and mitigate risks, issues or control ...

Alliance Group, part of BDO, is seeking a Data & AI Senior Consultant to join our Jersey-based practice. You will design, build and deliver modern data and AI solutions across Microsoft Fabric, Azure, and related services, focusing on hands-on delivery and stakeholder engagement. Responsibilities include … developing data pipelines, semantic models and reporting using SQL, Python and Power BI, ensuring robust, scalable outputs and adherence to quality standards. #J-18808-Ljbffr ...

Artefact is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines using SQL, Python, Databricks, Snowflake and orchestration tools. You will lead a team, collaborate with architects and analysts, and drive data governance and security practices across complex systems. … role emphasizes CI/CD for data workflows, tooling with cloud-native services, and delivering robust data solutions that enable business insights across platforms. #J-18808-Ljbffr ...

realized by automationRequired qualifications, capabilities, and skillsFormal training or certification on software engineering concepts and advanced applied experienceStrong software engineering fundamentals — system design, data structures, algorithms, and architectural thinking — with the ability to ramp up quickly across varied tech stacks and project typesHands-on practical experience in full … stack or cross-functional development, spanning frontend, backend, data pipelines, or mobile, with demonstrated ability to contribute across the length and breadth of a projectProficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude ...

Searchability NS&D in Portsmouth seeks an experienced Databricks Data Engineer to design and build secure, production‐grade data applications supporting defence environments. This hands‐on role sits at the intersection of Software and Data Engineering, with on‐site work three days per week. … scalable data pipelines, streaming and batch processing, and work with Python, Kafka, Spark, Docker, Kubernetes, Airflow, and IaC tools to deliver reliable data platforms with governance and #J-18808-Ljbffr ...

defining strategy, shaping the roadmap, writing detailed specifications and driving measurable outcomes. You will work at the intersection of product management, financial accounting, data modelling and energy retail, partnering closely with engineering teams and senior finance stakeholders. This is a hands-on product role requiring strong analytical thinking … delivering valuable, scalable software solutions. Key responsibilities: Own the strategy, vision and roadmap for Financial Assurance, using customer insight, commercial input and product data to continuously evolve priorities. Write high-quality product specifications and requirements that engineering teams can build from with confidence and minimal clarification. Define, track ...

Seven Investment Management in London is seeking a Data Engineer to design, build, test and release data solutions, contributing to a modernisation of the data platform. You will deliver robust, scalable pipelines in a regulated financial services environment. Responsibilities include collaborating with stakeholders, developing … data models, adhering to security standards and maintaining documentation while driving continuous improvement across the data engineering team. #J-18808-Ljbffr ...

Overview: We are looking for an EDA Optimisation Engineer to support the data-driven optimisation, analysis and maintenance of Arm’s engineering platforms. This role will work as part of a team effort to improve system utilisation/efficiency/cost-performance and touch on forecasting accuracy … infrastructure strategy. Working within the Productivity Engineering group, there will be a focus on metrics, automation, data-engineering and problem-solving where applicable to efficiency topics, in a metrics-first/data-driven-decisions environment. We expect this work to drive scalability and vendor strategy across ...

Core Data team models and owns the structured datasets that connect Squarepoint to the outside world, effectively representing the firm's view of reality. We partner closely with portfolio managers and investment researchers to define robust data models and build reliable data pipelines that … collaborative, learning-oriented environment where excellence is recognized, diverse perspectives are valued, and innovative solutions are encouraged. Acquire a deep understanding of the data requirements provided by investment research teams and deliver solutions that create business impactDesign, implement, test, optimize and troubleshoot data pipelines and services ...

correctness and compliance with US GAAP before changes go live. Partner with engineering and product teams to validate that financial event architecture feeds data accurately into accounting systems and the general ledger. Identify gaps in data capture or classification and drive cross-functional solutions to close … integration accuracy. Translate technical system behavior into accounting-compliant financial event design, bridging the gap between product logic and GAAP requirements. Collaborate with data analytics to support the development of scalable data pipelines and monitoring tools for integration health. Accounting standards and controlsApply US GAAP accounting ...

Infosys Limited in London is seeking a Senior Databricks Architect to design, build, and operate scalable data pipelines and data products that enable a modern data mesh. The role focuses on integrating legacy systems with cloud-native platforms for analytics, reporting, and domain-owned … data products, with hands-on work in Databricks, Kafka, and AWS S3. You will implement batch and streaming pipelines, apply the Bronze-Silver-Gold medallion architecture, ensure data quality and governance, and #J-18808-Ljbffr ...

Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and advanced applied experience Strong software engineering fundamentals system design, data structures, algorithms, and architectural thinking with the ability to ramp up quickly across varied tech stacks and project types Hands-on practical experience … full-stack or cross-functional development, spanning frontend, backend, data pipelines, or mobile, with demonstrated ability to contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness ...