1,776 to 1,800 of 2,473 Data Pipeline Jobs in the UK

Kubernetes, Elastic Container Service, or equivalent technologies in production environments Strong experience designing and implementing application programming interfaces, distributed systems, event-driven architectures, data pipelines, PostgreSQL, MongoDB, Redis, vector databases, observability, and automated deployment pipelines Demonstrated ability to influence technical direction while remaining close to the codebase, mentoring … coding, reviewing, debugging, and improving production systems that support AI-powered products and services Design and build scalable backend services, application programming interfaces, data pipelines, inference pipelines, and platform capabilities that support real-time and batch AI workloads at enterprise scale Implement advanced large language model applications using ...

will design and implement the Python systems, services, and orchestration layers that accelerate AI development across Nevis. You'll work across applied AI, data pipelines, model execution frameworks, agentic systems, retrieval infrastructure, and backend components that support our AI products. You'll thrive here if you love building … scale. What You'll Do Build and evolve Nevis' Python-based AI platform, powering core workflows and agentic automation. Develop model orchestration, data processing pipelines, retrieval systems, and execution runtimes for applied AI features. Create scalable APIs, services, and internal tools enabling rapid development, evaluation, and deployment ...

legal workflows across the firm. This role will serve as Orrick Labs' primary pro-code development resource, building applications, integrations, APIs, automation services, data pipelines, and user-facing solutions that extend and complement the team's low-code capabilities. The role requires strong software engineering skills … agents, or a hybrid approach, and design solutions accordingly. Build and deploy Model Context Protocol (MCP) servers that securely expose firm tools and data as needed to the firm’s internal AI agents. Design, develop, and deploy custom software applications that support legal workflows. Architect and build APIs ...

maintenance. Produce technical designs, testing strategies and implementation plans. Partner with Finance stakeholders to understand business needs and translate them into process workflows, data requirements and specifications. Build reusable solutions and identify opportunities for cross-divisional collaboration. Contribute to data modelling and curation. Basic Qualifications Bachelor … Computer Science, Mathematics, Electrical Engineering or related discipline. 6+ years of software development experience. Strong analysis and design skills, plus knowledge of data structures, algorithms and performance-oriented design. Strong communication skills with both technical and business audiences, and comfortable working with multiple global stakeholders. Expert Knowledge ...

Ampstek is seeking a senior data engineer with 8+ years of Python experience to lead the design and development of scalable data pipelines and enterprise Python applications. You will work with NumPy, Pandas, BeautifulSoup, Selenium, SQL (PostgreSQL), Spark, and cloud platforms such … Azure Databricks, in an Agile environment across multiple time zones. You will also mentor team members, drive best practices in automation and data processing, and coordinate with stakeholders globally. #J-18808-Ljbffr ...

Intropic, a Canary Wharf-based fintech data company, seeks a researcher to design and optimize data platforms. You will own PostgreSQL queries, data stores, Python APIs, and data pipelines while collaborating with clients to expand product features. You will work … small team, taking ownership of features from conception to deployment, with a focus on performance, data quality, and rapid iteration. #J-18808-Ljbffr ...

Cloud ecosystem. Key Responsibilities Lead end-to-end technical architecture and solution design for Salesforce Marketing Cloud implementations, migrations, and enhancements. Design robust data models and seamless integration patterns connecting SFMC with Core Salesforce (Sales/Service Cloud), Data Cloud and enterprise data warehouses … AMPscript, and SQL queries. Partner closely with marketing operations, enterprise architects, and business leaders to align technical strategy with core business KPIs. Establish data governance, security protocols, API management, and campaign execution standards across the platform. What We’re Looking For 4+ years of hands-on experience architecting ...

site role, and candidates for this role are required to hold an active DV security clearance. Hexegic are looking for technically minded data and software engineers to work on an intriguing and exciting project, building and maintaining data pipelines and platforms for our customers … with similar languages API awareness for data retrieval and integration into processing pipelines Experience of stakeholder management and requirements capture Understanding of pipeline scheduling and health checks What’s in it for you? Base salary of £50,000-£70,000 £5000 a year professional development budget Wellness ...

Consulting Limited is looking for a Senior Data Engineer (Python Enterprise Developer) to lead the design and optimization of scalable data pipelines. The role requires 8+ years of Python scripting experience, proficiency with SQL databases like PostgreSQL, and familiarity with cloud platforms such ...

Rise Technical in Manchester is seeking a Senior Data Engineer to build the foundations for reporting rather than inheriting someone else’s platform. You’ll create Azure-based data platforms from scratch, develop scalable data models and reporting architectures, and deliver trusted reporting with … lineage built in. You’ll work directly with planners, quantity surveyors and project managers to translate requirements into reliable reporting solutions, owning data pipelines and #J-18808-Ljbffr ...

Stott and May in London is seeking an experienced AI & Data Engineer to drive a major Balance Sheet Modelling transformation. You will design production-ready AI agents, build data pipelines and deliver scalable AI solutions across the Data and AI Working Groups. This hands … experience with Azure Databricks, Power Platform, and DevOps practices. You'll translate business needs into technical implementations and collaborate with stakeholders to optimise data #J-18808-Ljbffr ...

Project description This is a strategic data engineering engagement with our client to architect and plan the migration of their entire data processing and ETL estate from Matillion to AWS Glue — a foundational shift in how one of the world's largest financial market infrastructure companies … accelerate migration workflowsж Pattern library build — develop and maintain a library of reusable migration patterns/templates for common conversion scenarios; -Automated conversion pipeline — build pipelines that automatically convert/transform code and configurations (e.g., Matillion jobs) as part of the migration process; -GitHub Copilot integration for code generation ...

eFinancialCareers is seeking a Manager - AI & Data Architect in London. The role combines client-facing delivery with advanced data architecture across transformation projects. You will design modern data platforms, cloud solutions, data pipelines and governance, while leading teams and ensuring architectural quality. … ideal candidate has 5+ years in data engineering/architecture, consultancy experience and strong SQL, with exposure to AI/ML integration. #J-18808-Ljbffr ...

This is an exciting opportunity for someone who is passionate about technology, data, and machine learning, and is eager to contribute to a forward-thinking, collaborative environment. The Data Scientist will be responsible for building and deploying machine learning models to support personalisation, recommendations, anomaly detection … data insights. The role involves working within modern ML Ops practices and leveraging AI-powered development tools to increase efficiency and scale. Key ResponsibilitiesDevelop and deploy machine learning models for various use cases including personalisation and anomaly detectionImplement ML Ops practices including monitoring, continuous integration, and automated retrainingUse ...

Amazon Web Services Professional Services (ProServe) team is seeking a Delivery Consultant specialising in AI/ML and generative AI to join our Data & AI practice. In this role, you will work with enterprise customers to design, build, and deploy AI solutions that address defined business outcomes … include predictive ML, generative AI applications, retrieval and knowledge systems, intelligent automation, and agentic workflows. You will work across customers with different industries, data estates, regulatory requirements, and levels of AI maturity. You will combine software engineering, data and AI expertise with consulting skills to translate ...

world's money. For everyone, everywhere. More about our mission and what we offer . We’re looking for a Lead Data Scientist to join our Pricing team in London. This is a rare chance to shape how Wise prices cross-border money transfers — using data … millions of customers who rely on us for fair, transparent pricing About the Role: We are seeking a skilled and detail-oriented Data Scientist to help us develop a data-driven approach to pricing strategy and execution in a highly competitive remittance market. As part ...

Research, working daily with: Research Scientists who determine the model architectures and methods ML Engineers who implement and develop the models Simulation Data Engineers who are accountable for upstream data pipelines You will have end-to-end responsibilities over the research infrastructure, with the autonomy … scale: Deep expertise in distributed training: you've debugged NCCL hangs, optimized collective communication, and know when to use FSDP vs. DDP vs. pipeline parallelism Strong systems fundamentals: Linux, networking (including domain specific NVLink and InfiniBand), storage I/O, profiling and performance optimization Production experience with Kubernetes ...

readiness, and production release activities.* Automate support, deployment, validation, monitoring, and documentation activities using approved DevOps and scripting tools.* Analyze SQL and Oracle data, logs, APIs, middleware, batch processing, and data pipelines to restore service and support root-cause analysis.* Support operational readiness, backup, recovery, resiliency … recovery, and disaster recovery.* **DevOps and automation:** Experience with CI/CD, PowerShell, Bash, Python, Terraform, Azure DevOps, GitHub, Jenkins, or similar tools.* **Data and integration troubleshooting:** Ability to analyze SQL and Oracle data, logs, APIs, batch processing, middleware, and data pipelines.**Preferred Qualifications ...

United States Digital Space LLC is seeking a Senior Product Manager to define and execute a data-distribution strategy, focusing on APIs and cloud-native delivery. You will shape data packaging, tiering, and pricing for enterprise clients, working with cross-functional teams and customers during pilots … onboarding. The role requires 5+ years in API or data-product management, with strong SQL/Python skills and experience across Snowflake data sharing, data pipelines, and external developer #J-18808-Ljbffr ...

first credit products. In this role you’ll partner closely with a high performing global team consisting of the product lead, engineers, data scientists and designers to deliver a world class credit product. You will be expected to be hands on with the data and grow … small team of analysts as the product scales. What You’ll Do Partner with Data Science to challenge and stress-test credit risk modelling assumptions for our SME customers (including scenario and sensitivity testing), ensuring decisions are robust and explainable. Leverage market insights and publicly available data ...

looking for an experienced Data Scientist with strong Machine Learning, Google Cloud Platform (GCP), Python and data engineering expertise to support the optimisation of fraud models and ML infrastructure. Contract information Job title: Data Scientist Location: 3 days in Sheffield and 2 days remote … practical, implementation-ready recommendations, including estimated effort, cost savings and technical impact. Provide both configuration-level and code-level guidance to engineering and data science teams. Analyse and optimise GCP compute, storage and networking, balancing cost, performance and reliability. Implement and improve monitoring and observability across ML workloads ...

Database schema design, row-level security for tenant isolation, SQL functions, materialized views, scheduled jobs, query performance at telemetry scale. Run the telemetry pipeline: MQTT ingestion from site BMS equipment, collector services, data-quality rollups, retention, and the monitoring that guards them. Test and verify … systems (REST, OAuth2/JWT, webhooks), including at least one messy real-world system of record. Python for scripting, data processing or pipeline work. Preferable: Deeper LLM experience: fine-tuning methodology, corpus design, evaluation-harness construction, vLLM internals, or heavy daily use of AI coding agents. ...

deployment workflows. You’ll work end‐to‐end across model adaptation and post‐training (CPT/SFT/RL/distillation), evaluation, data, and infrastructure. The role bridges research experimentation and production constraints. This role sits in Applied Science, with direct impact on client outcomes. You’ll collaborate … facing teams to ensure Forge projects ship, are maintainable, and can be trusted by others. Interview focus can vary (algorithms, infrastructure, evals, or data). You don’t need to match every bullet below to apply. What You Will Do Build and improve post‐training and evaluation workflows ...

DescriptionPosition TitleJob Title: BI Engineer, SREPosition OverviewOur BI team runs a set of GCP-based APIs and data services that a lot of internal products depend on. As we've grown, keeping things running has increasingly been a side responsibility for engineers who are primarily building features … cloud budget. The BI Engineer, SRE will ensure the availability, performance, and security of the Business Intelligence team's GCP-hosted APIs and data infrastructure. This role is responsible for proactive monitoring, incident response, and continuous improvement of platform reliability across a cloud-native stack. The engineer will ...

deployment of proprietary analytical tools, models, and dashboards. Coding: Use Python to build and enhance tools for research, backtesting, and production reporting. Data Management: Design and maintain data pipelines (including SQL) for clean, reliable data feeds. Trade Support: Assist in generating, researching, and stress … Venue. Strong knowledge of financial products and active interest in the Commodities and Macro space. Exceptional analytics and problem-solving skills. Experience managing data and building tools in Python. Excellent verbal, written and presentation skills. For more information about DRW's processing activities ...