751 to 775 of 926 Data Pipeline Jobs in the UK

Senior Data Engineer Salary: £85K - £95K Location: London - Flexible working Data Idols are working with a fast-growing, product-led tech company to hire a Senio Data Engineer and help shape the data platform. They are looking for this person to provide technical leadership and lead projects end to end. The Opportunity … to have real technical ownership over the systems and models that power decision making across the entire organisation. In this role, you'll drive the design of robust data pipelines, evolve our warehouse strategy, and align cross-functional teams around shared, reusable models. You'll be part of a company that takes data seriously, where your … Strong Python SQL Experience working with GCP dbt If you are looking for a new challenge, then please submit your CV for initial screening and more details. Senior Data Engineer More ❯

security architecture for AI/ML systems, CI/CD and data pipelines. * Participate in enterprise-wide architecture initiatives for AI/ML. Understand the workflow and pipeline architectures of ML and deep learning workloads. * Conduct security risk assessments and threat modelling for AI/ML and other business projects performed thorough design reviews and security assessments … testing of AI/ML models, LLM and development of trustworthiness, safety, fairness, bias and inappropriateness detection, as well as adversarial test specification, development, and execution. * Collaborate with data scientists, engineers, and other stakeholders to embed security controls and measures into AI/ML applications, models, algorithms, and data pipelines. * Define and enforce robust access controls … authentication mechanisms, and encryption standards to safeguard AI/ML systems, training data, provenance, and any sensitive data. * Stay abreast of emerging AI security threats, trends, and technologies, evaluating their impact and proactively adapting security measures to mitigate potential risks. * Provide technical guidance and support to cross-functional teams during the design, development, and deployment of AI/ More ❯

Business/Data Analyst – KDB & Python | Greenfield Build | Investment Banking -EXPERIENCE IN KDB+ IS Essential- A leading investment bank is building a brand-new team for a greenfield project and is looking for a Business/Data Analyst with strong KDB and Python skills. Key Responsibilities: Gather and analyze business requirements from front-office and tech … teams. Build data models and analytics solutions using KDB+/q and Python. Define data pipelines and ensure data quality and performance. Translate business needs into actionable insights and documentation. Requirements: Experience in financial services, ideally trading or investment banking. Strong hands-on skills in KDB+/q and Python . Solid understanding of … market data and financial instruments. Excellent communication and stakeholder management skills. Why Apply? Join a greenfield build with full ownership from day one. Work with cutting-edge tech in a high-impact, front-office environment. Be part of a collaborative and fast-paced team shaping a new platform. More ❯

Business/Data Analyst – KDB & Python | Greenfield Build | Investment Banking -EXPERIENCE IN KDB+ IS Essential- A leading investment bank is building a brand-new team for a greenfield project and is looking for a Business/Data Analyst with strong KDB and Python skills. Key Responsibilities: Gather and analyze business requirements from front-office and tech … teams. Build data models and analytics solutions using KDB+/q and Python. Define data pipelines and ensure data quality and performance. Translate business needs into actionable insights and documentation. Requirements: Experience in financial services, ideally trading or investment banking. Strong hands-on skills in KDB+/q and Python . Solid understanding of … market data and financial instruments. Excellent communication and stakeholder management skills. Why Apply? Join a greenfield build with full ownership from day one. Work with cutting-edge tech in a high-impact, front-office environment. Be part of a collaborative and fast-paced team shaping a new platform. More ❯

Role: Technical Product Owner Industry: Sports Data Salary: Up to £80,000 Location : London/Hybrid Are you a talented Product Owner with a good understanding of data engineering concepts? Are you interested in progressing to the role of Product Manager over time? Are you excited by Sports/Sports data and taking ownership … of a brand-new team? If so, this could be the perfect next role for you! This global leader in real-time sports data delivery is used by some of the worlds largest betting operators. Having recently hired a new Chief Product Officer, the Product team is only a few months old and this role will join a … newly formed data engineering/analytics team. What are they looking for: 2-3 years as a Product Owner/Product Manager Good understanding of data engineering concepts and data pipelines Familiarity with data analytics practices, modern BI tools, and reporting workflows Experience working in agile environments with cross functional teams Previous More ❯

Full Stack Data Engineer - AI Research £92K Hybrid London (3 Days … Onsite) We're hiring a Full Stack Data Engineer to join an elite AI research team in London. You'll be hands-on with end-to-end pipeline development-onboarding, filtering and packaging massive datasets (text, image, video) that will power LLM agents used in cutting-edge automation and FAIR research. This isn't your average data role-it's technical, research-focused, and sits right at the intersection of data engineering and software craftsmanship. What's in it for you? Annual Salary up to £92,000 doe Length : Through December 2025, with possibility of extension Contract Type : Inside IR35 - PAYE - paid via Principle HR on a weekly basis Location : 3 days onsite More ❯

a Manual QA Test Engineer with hands-on experience in SnapLogic to join my clients growing team on a contract basis. You will be responsible for testing integrations, data pipelines, and workflows built using the SnapLogic platform, ensuring quality, stability, and performance across various projects. Key Responsibilities Design and execute manual test cases for SnapLogic pipelines and integrations. … Validate data transformations, API integrations, and ETL workflows. Collaborate with developers, business analysts, and integration architects to understand functional and non-functional requirements. Identify, document, and track bugs through to resolution. Maintain test documentation, including test cases, test results, and issue logs. Support UAT and production release verification. Ensure data accuracy and integrity across systems and … integrations. Required Skills & Experience 1+ years of experience testing SnapLogic integrations (required). Strong background in manual testing , particularly for APIs, data pipelines, and enterprise integrations. Experience with JSON, REST APIs, SQL , and data validation. Familiarity with tools like Postman, JIRA, Confluence, or similar. Strong analytical and problem-solving skills. Excellent communication skills and attention to More ❯

Senior Data Scientist – Credit Risk Modelling £70-100,000 (dependent on experience) REMOTE WITHIN UK THE COMPANY This is an exceptional opportunity to join a well-funded fintech startup at a pivotal moment in its journey. With backing from respected investors and a founding team experienced in launching and scaling high-growth ventures, the business is now entering … acquisition, behavioural, and collections Choose and justify modelling techniques (traditional, hybrid, or even ML-informed) Define the credit strategy and lending criteria from the ground up Partner with data engineering to ensure the data pipelines and feature stores support what you need Play a hands-on role in regulatory documentation, governance, and model risk management YOUR … statistical and analytical skills with proficiency in Python Understanding of regulatory requirements relating to credit risk, including model governance and validation Experience collaborating with cross-functional teams including data engineering and product Self-starter with the ability to operate autonomously and take initiative in an unstructured environment SALARY AND BENEFITS Base salary from £70-100,000 depending on More ❯

work with our media client on their Content Metadata testing team which is responsible for a centralised metadata system providing manual and automatic ways for teams to access data on their products. The role is to provide test expertise and support to the engineering teams working across the Content Metadata products. This exciting position involves performing exploratory, regression … integration and cross-browser testing of a React front-end as well as back-end APIs, data pipelines and data stores. The successful applicant will have experience with cloud platforms especially AWS (Lambda, CloudWatch and S3), familiarity with API testing tools like Postman, SoapUI or RestAssured and good knowledge of JavaScript or TypeScript. Familiarity with CI More ❯

new technologies Perception Model Lifecycle Management: Lead the end-to-end development of scalable ML models for critical perception tasks (object detection, tracking, scene understanding, mapping), including MLOps, data pipelines, and optimization for robust onboard deployment Team Leadership & Mentorship: Build, mentor, and lead a high-performing team of machine learning engineers, fostering a culture of innovation, technical excellence … limitation, such as those covered by the Americans with Disabilities Act, that requires accommodations to assist you in the search and application process, please email us . Candidate Data Privacy Rivian may collect, use and disclose your personal information or personal data (within the meaning of the applicable data protection laws) when you apply … for employment and/or participate in our recruitment processes ("Candidate Personal Data"). This data includes contact, demographic, communications, educational, professional, employment, social media/website, network/device, recruiting system usage/interaction, security and preference information. Rivian may use your Candidate Personal Data for the purposes of (i) tracking interactions with More ❯

possible in research. We do impactful work with amazing organisations ranging from well-known brands to life-changing non-profits. Join us! About the role As a Senior Data Scientist you will be instrumental in shaping the technical backbone of the analytics function at Focaldata. In this role, you'll develop advanced R tools and scalable solutions to … implementation of cutting-edge modelling techniques. You'll collaborate on diverse projects, enhance our analytics infrastructure, and mentor team members in best practices. If you're passionate about data science, skilled in R, and eager to make an impact in public opinion and research, we'd love to hear from you. What you'll do This is a … will be: Build internal R packages to automate and standardise core tasks like weighting, modelling, and charting. Develop scalable tooling to support our research and analytics teams-from data pipelines to custom dashboards. Lead the development and deployment of advanced modelling techniques (e.g. multilevel regression, segmentation, random forest models, text analysis). Collaborate with the wider team on More ❯

maintain scalable, secure Python-based back-end services and APIs Develop and deploy cloud-native applications on AWS (e.g., Lambda, ECS, S3, RDS) Integrate with third-party financial data providers and internal portfolio systems Collaborate closely with front-end developers, DevOps, and business stakeholders Write clean, testable code and contribute to CI/CD pipelines and automated deployments … and deployment workflows Desirable: Experience with alternative asset strategies such as private credit, real estate, or private equity Exposure to event-driven systems (Kafka, Redis) and ETL/data pipelines Familiarity with portfolio management tools or investment data modeling Knowledge of security and compliance requirements in financial cloud environments Additional Information Competitive salary + discretionary bonus More ❯

Clean Code: Write clear, well-documented, and reusable code in line with engineering best practices. Help architect a scalable and resilient cloud-native platform (Azure) Maintain and improve data pipelines, ensuring data quality and integrity. Requirements : Bachelor’s or Master’s degree in a STEM field (e.g. Computer Science, Mathematics, Engineering). 0.5–3 years of More ❯

Clean Code: Write clear, well-documented, and reusable code in line with engineering best practices. Help architect a scalable and resilient cloud-native platform (Azure) Maintain and improve data pipelines, ensuring data quality and integrity. Requirements : Bachelor’s or Master’s degree in a STEM field (e.g. Computer Science, Mathematics, Engineering). 0.5–3 years of More ❯

develop, and deploy end-to-end AI/ML-powered features and applications using Python and modern frameworks. Build, integrate, and maintain machine learning models and solutions-from data pipelines to API deployment and user-facing interfaces. Collaborate with product managers, compliance experts, and engineers to translate business needs into intelligent technologies. Develop robust backend systems and APIs … models (LLMs, predictive/classification, agentic workflows), ensuring security and compliance standards are met. Implement best practices for MLOps, including CI/CD, automated testing, model versioning, and data validation. Architect integrations with vector databases, cloud platforms, and retrieval-augmented generation systems. Qualifications: 3+ years of experience delivering full-stack AI/ML applications in production. Proficiency in More ❯

services using .NET Core/.NET 6+ Collaborate efficiently on an AI-driven project alongside the customers Lead Backend Engineer Work closely with ML Engineers, App Developers, and Data teams for integrated feature delivery Design and build RESTful APIs to expose AI models and LLM prompt-based services Integrate trained ML models into backend systems supporting real product … features Build and maintain infrastructure for data ingestion, processing, and secure storage Support full end-to-end testing with QA and development teams to prevent security or data issues Create services to manage data ingestion for model training and dynamic personalization Implement access controls, password policies, and SSO using existing client authentication models Secure … APIs and data pipelines with encryption and appropriate authentication measures Required Skills and Experience Proven experience in .NET Core/.NET 6+ development Strong understanding of REST API design and backend microservices architecture Experience working on AI/ML integrations in production environments Familiarity with secure coding practices and enterprise-level data protection standards Comfortable with More ❯

As a Privacy Engineer at NCC Group, you will play a crucial role in assessing and enhancing our clients' privacy solutions. You will leverage your expertise in data engineering and privacy to analyse, design, and develop innovative privacy solutions tailored to enterprise environments. Your work will ensure that our clients' technologies meet the highest standards of privacy and … data protection. Summary Conduct comprehensive assessments of clients' privacy solutions to identify strengths and areas for improvement. Design and develop customised privacy solutions to address clients' specific needs and challenges. Execute rigorous testing processes to validate the effectiveness of privacy technologies. Collaborate with clients' cross-functional teams to integrate privacy into their system designs and workflows. Provide expert … technical guidance on data engineering and privacy best practices to clients. Develop and utilise tools and scripts in Python to support privacy engineering tasks. Conduct technical tests and experiments to validate privacy solutions for clients. Document and communicate privacy solutions and findings to clients and stakeholders. Knowledge of global privacy regulations and compliance requirements. Experience with privacy impact More ❯

Job Title: Data Consultant (Azure) - Outside IR35 Location: London - onsite 3 days per week Salary/Rate: £350 per day - outside IR35 Start Date: August Duration: March 2026 I have an exciting opportunity to work with a sector-leading consultancy client. They are looking for an experienced Software Engineer to join on a 12-month contract working outside … IR35. Job Responsibilities/Objectives Develop and deploy ETL pipelines for data cleansing using Azure-based tooling. Build and maintain outbound/inbound API endpoints for downstream systems (e.g. reporting tools, finance systems). Write scripts to generate unique client identifiers and validate data quality rules. Design and configure integration flows between Dataverse, the practice management … experience delivering technical solutions across Microsoft Dataverse, Azure Fabric, and Power Platform. Strong coding experience in one or more languages: Python, C#, Hands-on experience with API integrations, data pipelines, and transformation logic. Demonstrated expertise with modern delivery techniques - including TDD, pairing, infrastructure-as-code, and CI/CD pipelines, using tooling such as Azure DevOps or GitHub More ❯

For more information, contact Mieke Van Tonder at . This is an exciting opportunity for someone passionate about technology, data, and machine learning, eager to contribute to a collaborative environment. The Data Scientist will build and deploy machine learning models to support personalization, recommendations, anomaly detection, and data insights. The role involves working with … as monitoring, continuous integration, and automated retraining. Utilize AI-assisted development tools like Cursor and Copilot to improve productivity. Collaborate with engineers, DevOps, and leadership to ensure robust data pipelines and translate business needs into technical solutions. Requirements At least 3 years of experience in applied machine learning and deploying production models. Proficiency in Python, SQL, and frameworks … learn. Experience with AWS services and Databricks; understanding of ML Ops is highly beneficial. Ability to adapt quickly to new tools and deliver scalable solutions independently. Familiarity with data pipelines involving Kafka, Debezium, S3, Lambda, and Delta Lake is a plus. Note: Some irrelevant content and personal opinions were removed for clarity and focus. This job posting is More ❯

in architecting our real-time mindshare platform that turns noisy social feeds into crystal-clear token insights. Your work will power a product so fast and intuitive, ingesting data from every channel, powering advanced NLP models, and delivering sub-second API responses that will deliver a trading experience that end users will only describe as magic. This role … deliver new ML-driven insights and to design intuitive consumer-facing dashboards and alert systems that visualize real-time mindshare and sentiment metrics aligned with product goals. Ensure data security and compliance, particularly around usergenerated content, API keys, and any PII in social media streams. Maintain code and model quality: author clean, efficient, and maintainable code; implement comprehensive … designing feedback loops, active learning, or user-in-the-loop systems to continuously improve model relevance. Experience with Git-based workflows and integrating model training into CI/CD pipeline Ideal Candidate Profile A creative problem-solver who is eager to innovate and push boundaries in the DeFi space. Deep expertise in data engineering and ML pipelines More ❯

SQL Data Engineer/BI Developer North West NHS Client Outside IR35 3 Month initial period Flexible day rate We are seeking a BI Developer/Data Engineer with end-to-end data project experience to join a North-West based NHS trust. This is a fantastic opportunity to contribute to meaningful healthcare improvement … by delivering high-quality BI solutions that drive clinical, operational, and strategic decision-making. You will play a pivotal role in transforming complex healthcare data into accessible and actionable insights. Develop and maintain robust Power BI dashboards and reports, ensuring accuracy and usability for clinical and operational teams. Design and build data pipelines and transformation logic More ❯

Yes Job Reference: 973e563a7c0a Job Views: 4 Posted: 14.07.2025 Expiry Date: 28.08.2025 Job Description: Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture for our clients, around the clock - from around the world. In Data, we are responsible for delivering this data … support to our content partners and customers to ensure Bloomberg is the platform of choice for content distribution. You will be responsible for ensuring the delivery of quality data for the Mutual Funds and ETP product, focusing on improving coverage, completeness, timeliness, and accuracy of funds' data. The team maintains and ensures the quality of the funds dataset … including pricing, dividends, reference data, corporate actions, documents, and regulatory data. Your role involves developing expertise in your market, building relationships with fund houses, custodians, administrators, exchanges, and third-party content partners to establish sustainable data pipelines, educate on data dissemination best practices, stay updated on industry trends, and maintain a comprehensive profile of More ❯

BI Developer/Data Analyst (Power BI) Location: West Midlands Salary: Up to £65,000 Type: Full-time, Office-based About the Role An established food manufacturer and supplier is implementing their first-ever ERP system, focusing on four key modules: Manufacturing, Compliance, Reliability, and Learning. Each module will take approximately 4-6 months to complete. To support … and maintain Power BI dashboards and reports delivering actionable insights. Collaborate with internal stakeholders and external implementation partners throughout the ERP rollout and ongoing system maintenance. Develop robust data pipelines and write advanced SQL queries for ETL processes and data analysis. Migrate and integrate data between systems to ensure seamless communication and reporting. Continuously … monitor and improve BI tools post-ERP implementation. Analyse large datasets to uncover trends supporting strategic decision-making. Ensure data integrity, security, and automation of workflows to maintain reliability and efficiency. Benefits Competitive salary up to £65,000 25 days holiday plus bank holidays Onsite parking available Employee rewards and retail discounts Pension scheme (details to be confirmed More ❯

deliverables Manage and resolve dependencies across teams, ensuring smooth and efficient project execution Operational Excellence & Risk Management Identify and mitigate technical risks and obstacles, ensuring that the product development pipeline runs smoothly and efficiently. Ensure the security, performance, and scalability of products through proactive monitoring and improvements. Ensure adherence to high coding standards, software quality, and efficient development processes … Technical Skills: Strong technical background with hands-on experience in modern software development technologies (e.g., Java, Python, microservices, cloud platforms like AWS, Azure, etc.) Expertise in software architecture, data architecture, and system design, with an ability to lead and influence technical decision-making. Drive innovation toward building high-scalable, real-time data pipelines and data … observations and seek out new levels of understanding so that we can help companies, governments and individuals make an impact on tomorrow. At S&P Global we transform data into Essential Intelligence, pinpointing risks and opening possibilities. We Accelerate Progress. Our People: We're more than 35,000 strong worldwide-so we're able to understand nuances while More ❯

to the next level and be part of a global innovative team shaping the future of betting entertainment for millions worldwide. The Goal We're looking for a Data Engineer/AI Platform Specialist to build and optimize the infrastructure powering our AI ambitions. In this hands-on role, you'll design scalable data pipelines, manage … cloud services, and implement infrastructure-as-code to enable secure, efficient, and high-performance AI workflows. Your work will ensure data is not just available-but ready for AI at scale. You'll collaborate closely with ML engineers, software developers, and stakeholders to unlock siloed data, improve compliance, and drive platform reliability. This is your chance … the technical foundation behind real-world AI impact in a high-growth, high-regulation industry. The Player You bring deep expertise in cloud infrastructure (AWS, Azure, or GCP), data engineering, CI/CD, and IaC tools like Terraform. You thrive in cross-functional environments, balance performance with governance, and know how to turn complex systems into seamless pipelines. More ❯