926 to 950 of 1,766 Data Pipeline Jobs in the UK

Python experience along with AI and ML development skills to create scalable, high-performance applications that integrate various AI technologies. Responsibilities include developing data pipelines, optimizing performance, and utilizing cloud platforms. Ideal candidates will exhibit a robust understanding of API development and database systems, complemented by strong problem ...

problem-solving skills, and ability to thrive in a fast-paced, collaborative environment. Preferred qualification, capabilities, and skills Agentic AI and data pipeline/processing experience a plus. Product development lifecycle experience a plus. #J-18808-Ljbffr ...

Evaluation & observability : Practical experience instrumenting tracing (LangSmith, Arize) and building CI/CD pipelines built specifically for LLMs. Engineering foundations : Distributed systems, scalable data pipelines (Kafka, SQL), and cloud‐native infrastructure. Cloud‐native deployment: Deep familiarity with shipping agentic workloads into production environments, ideally leveraging Kubernetes for enterprise ...

Evaluation & observability : Practical experience instrumenting tracing (LangSmith, Arize) and building CI/CD pipelines built specifically for LLMs. Engineering foundations : Distributed systems, scalable data pipelines (Kafka, SQL), and cloud-native infrastructure. Cloud-native deployment: Deep familiarity with shipping agentic workloads into production environments, ideally leveraging Kubernetes for enterprise ...

will work on a wide range of systems that fuel our trading success including, but not limited to, core tooling and frameworks, data pipelines used to feed predictive models in research and trading, and software products used worldwide by traders and researchers. You will collaborate with experienced software ...

etc.) with libraries/frameworks such as PyTorch, TensorFlow etc.) * Experience with RAG and LLM-based solutions * Solid understanding of AI architectures and data pipelines * Knowledge of security, compliance, and governance principles from a development perspective * Proven mentoring and team development capabilities * Excellent communication and stakeholder management skills ...

Their primary focus is on execution within defined parameters, applying modern engineering practices including CI/CD, automated testing, code quality, observability and data quality controls. They may also be accountable for regular reporting or process administration within the squad. Working in partnership with more experienced staff, their … practical, well-engineered technical solutions. Build production-ready solutions using modern engineering practices, including CI/CD, automated testing, code quality, observability and data quality controls. Support data quality, monitoring, reporting and process administration activities to help ensure accurate and consistent outcomes. Identify and resolve technical ...

Their primary focus is on execution within defined parameters, applying modern engineering practices including CI/CD, automated testing, code quality, observability and data quality controls. They may also be accountable for regular reporting or process administration within the squad. Working in partnership with more experienced staff, their … practical, well-engineered technical solutions. Build production-ready solutions using modern engineering practices, including CI/CD, automated testing, code quality, observability and data quality controls. Support data quality, monitoring, reporting and process administration activities to help ensure accurate and consistent outcomes. Identify and resolve technical ...

Barratt Developments plc is seeking a highly skilled Azure Data Engineer to join our newly formed Group Data Office. You will build and maintain the Azure Data Lake, develop robust data pipelines from enterprise systems, and support the Power BI data model development with the Visualization team. The role emphasizes SOLID development, cloud data warehousing on Azure Synapse, TOGAF-aligned architecture, API integrations with 3rd parties, and secure data transport via XML and JSON over HTTPS, #J-18808-Ljbffr ...

Unite Students is seeking an experienced Data Engineering Lead to join our Data & Insight team and shape the future of our data capabilities. You'll lead and develop a team of Data Engineers, provide technical direction while remaining hands-on with complex … engineering challenges, including the evolution of our Databricks data platform and data pipelines that support analytics, reporting and data science. #J-18808-Ljbffr ...

deploy intelligent, scalable applications. You will work at the intersection of backend engineering and artificial intelligence, building systems that integrate machine learning models, data pipelines, and cloud-native services. This role is ideal for someone passionate about clean architecture, performance optimization, and applying AI technologies to real-world … based applications Integrate AI/ML models into production-grade backend systems Build RESTful APIs and microservices using modern Java frameworks Collaborate with data scientists to deploy and scale machine learning solutions Optimise system performance, scalability, and security Implement CI/CD pipelines and ensure high code quality ...

Advantage Resourcing UK Ltd is recruiting a Senior Data Engineer on a contract basis to start in September for 6-12 months, operating inside IR35. Three days onsite in London per week are required. The Senior Data Engineer designs and builds data foundations … data solutions, enabling data-driven thinking across IT and business stakeholders, while mentoring junior engineers. #J-18808-Ljbffr ...

transformation of its Financial Crime, Risk and Compliance technology landscape. As part of this journey, they are looking to hire a Financial Crime Data Lead to play a central role in designing and building a new enterprise-wide Financial Crime data platform that will underpin … highly visible role sitting at the intersection of: Governance AI Enablement You’ll be responsible for creating a trusted Financial Crime data layer that brings together multiple systems and data sources into a single foundation supporting reporting, controls, workflow automation and analytics. Key Responsibilities Design ...

# Gen AI Python DeveloperLondonApply for this job* Permanent* Experienced Professionals* Data & AI* ID 549011-en\\_GB**Job Title:** **Gen AI Python Developer****Location: London****About the Job you are considering:**We are seeking a Generative AI Data Engineer with strong experience in financial services (banking … capital markets, insurance, or fintech) to design, build, and scale GenAI-powered data solutions. The role combines modern data engineering, ML/LLM integration, and domain-specific financial knowledge to deliver enterprise-grade AI platforms. You will lead the development of data pipelines, vector ...

Allocation Strategy's core modelling and analytics platform. Implement, validate, and productionise advanced models for asset allocation, risk, macro and scenario analysis, including data preparation, testing, calibration, optimisation, and maintenance as models and data evolve. Develop AI‐assisted research and modelling workflows, including data … maintainable code. Rapidly prototype new modelling approaches and analytical tools, then harden them for production use. Build and maintain robust backend systems, data pipelines, and APIs supporting both internal research and client‐facing applications. Design, operate, and evolve cloud‐based data and model workflows, including orchestration ...

Data Engineer (Snowflake, DBT, AWS) Basildon, UK - 5 Days Onsite Required Inside IR35, 6-Month Contract We are looking for an experienced Data Engineer to join a major data transformation programme within a leading enterprise organisation. This role will focus on building and optimising … scalable data pipelines, data warehouse solutions, and cloud-based analytics platforms using Snowflake, DBT, and AW click apply for full job details ...

Principal AI Engineer Are you excited about building intelligent systems powered by innovative AI technologies? Do you enjoy designing models that turn complex data into impactful solutions? About the team: Embedded Innovation Teams are cross-functional squads embedded within our segments to rapidly turn internal AI experimentation into … deliver new ones. Design and govern reusable agentic AI patterns (orchestration, tool use, memory, retrieval). Ensure delivery meets architecture, security and data-governance standards; recommend infrastructure, hosting and data residency. Codify validated solutions into patterns, reference implementations and starter kits so they can be picked ...

Principal AI Engineer Are you excited about building intelligent systems powered by innovative AI technologies? Do you enjoy designing models that turn complex data into impactful solutions? About the team: Embedded Innovation Teams are cross-functional squads embedded within our segments to rapidly turn internal AI experimentation into … deliver new ones. Design and govern reusable agentic AI patterns (orchestration, tool use, memory, retrieval). Ensure delivery meets architecture, security and data-governance standards; recommend infrastructure, hosting and data residency. Codify validated solutions into patterns, reference implementations and starter kits so they can be picked ...

ICAP in Belfast seeks a Data Ops Engineer to design and maintain end-to-end data pipelines for market surveillance. You’ll implement data quality checks, govern data lineage, and work with AWS, Terraform/CDK, and analytics tools to ensure accurate … timely data delivery across platforms. You will collaborate with analysts, developers and testers, optimise performance, and help scale data ingestion in a fast-paced financial services environment. #J-18808-Ljbffr ...

Data Intellect is seeking experienced Consultants/Data Engineers to build scalable, high-performance data platforms, with a focus on ClickHouse. This is a chance to shape our new ClickHouse capability and work on challenging financial services projects. You will engage directly with clients … design data models, and implement data pipelines across cloud-native architectures, leveraging Python, SQL and modern data engineering practices. #J-18808-Ljbffr ...

people, who are relentlessly resourceful to solve problems and find smarter solutions than the status quoBuild the best technology in-house, using new data sources, machine learning and AI to make machines do the heavy liftingWe'd love for you to become a key part of our Python … group that's always pushing the boundaries of what's possible. This role sits at the intersection of analytics engineering and Python-based data engineering. You'll work on transforming and modelling data using SQL and dbt, while also leveraging Python to build data ...

Senior Data Platform Engineer Our Client is looking for an experienced Data Platform Engineer to join the team on a 6 month contract , working outside IR35 . Rate: £650 - £750 Location: Hybrid – 2/3 days … week on-site Contract: 6 months | Outside IR35 Key Skills: Data Lakehouse PySpark DBT Iceberg AWS Strong data engineering and pipeline development experience You’ll be responsible for designing, building and optimising scalable data pipelines and lakehouse solutions within a modern AWS environment. ...

evolve critical ML systems across training, inference, evaluation, and infrastructure. Architect and build large-scale ML systems including training pipelines, inference systems, and data systems. Implement evaluation pipelines for performance, robustness, safety, and bias. Own production deployment with GPU optimization, memory efficiency, latency reduction, and scaling. Collaborate with … quality in production by building sound evaluations, monitoring performance, and investigating failures post-launch. Own end-to-end ML system execution including data pipelines, training workflows, evaluation systems, inference architecture, and deployment. Fine-tune and adapt models using state-of-the-art methods. Architect and operate scalable inference ...

Harvey Nash Group in Reading, England, is hiring a Cyber Data Engineer for a 6-month Inside IR35 contract with hybrid work (2–3 days on site) starting ASAP. Day rate £600. You will build automated data pipelines, onboard cyber data sources and support … dashboard development to deliver trusted metrics and timely reporting. Required: data engineering and analytics expertise; Power BI and Databricks experience; strong ETL and data modelling; familiarity with cyber security data sources. #J-18808-Ljbffr ...

will bridge cutting-edge AI capabilities with enterprise-grade engineering to deliver measurable impact across Markets Operations. You will collaborate with engineers, researchers, data scientists, and business leaders in a hands-on, builder-focused environment. You will have the opportunity to grow your career while helping advance safe … reusable AI engineering patterns, context management frameworks, evaluation pipelines, and production-ready AI services. You will partner closely with software engineers, AI and data science specialists, and operations stakeholders to identify high-value opportunities and deliver robust solutions integrated with strategic platforms and operational processes. Job ResponsibilitiesLead ...