176 to 200 of 267 Data Pipeline Jobs in the UK excluding London

Will Work With Building and deploying AI and Machine Learning solutions Designing and implementing end-to-end AI and ML pipelines, from data acquisition and feature engineering through to deployment and optimisation Developing scalable ML pipelines and engineering frameworks AI model training, evaluation, optimisation and deployment Cloud-native … data platforms across Azure, AWS and GCP MLOps tools and best practices for deployment, monitoring and governance Structured and unstructured datasets Generative AI and advanced analytics solutions Designing and maintaining scalable data pipelines, datasets and workflows Collaborating directly with client stakeholders to understand business challenges ...

Data Scientist | Remote | AI & Machine Learning | AWS | Azure | LLM If you're excited by solving complex problems with AI rather than simply maintaining existing models, this could be the opportunity you've been waiting for. We're looking for a Data Scientist who wants to work … play a key role in shaping solutions that help businesses operate more safely, efficiently and intelligently. You'll join a collaborative team of Data Scientists, AI Engineers, Data Engineers and DevOps specialists who are investing heavily in modern AI technologies and building products used by thousands ...

This role requires eligibility for BPSS and SC Security Clearance, including 5 years' continuous UK residency. The Role We're looking for a Data Engineer to join a growing technology team delivering cloud and data solutions across a range of complex projects. You'll design … build scalable data pipelines, work with modern cloud technologies, and collaborate with engineers, analysts and product teams to deliver high-quality data solutions that support analytics and AI. Key Responsibilities * Design, build and maintain scalable data pipelines * Develop real-time and batch data ...

based data platforms Exposure to Databricks, SQL Server, or similar database technologies Ability to write SQL scripts and support data pipeline development where required Requirements Assess the current Qlik environment and define the migration approach Lead the migration from discovery through to production deployment Redesign ...

Lead Data & Insight Analyst Location: Chertsey (Hybrid - 2 days onsite) At Foodbuy, we're driving transformation through data. As the procurement and supply chain division of Compass Group UK & Ireland, we sit at the heart of a £2.6bn spend network-delivering insight-led solutions to some … most recognisable organisations across healthcare, education, hospitality and business. We're now looking for a Lead Data & Insight Analyst to join our growing Analytics team, playing a key role in shaping how data and insight drive decision-making across the business. The Role This ...

third‐party tools. Work with message brokers (RabbitMQ) to design event‐driven and asynchronous integration patterns. Collaborate with stakeholders to ensure seamless data flow across interconnected systems. Design, develop, and maintain background ETL processes for data ingestion, transformation, and loading. … Build and optimize data pipelines that support analytics, reporting, and operational workflows. Ensure data integrity, reliability, and traceability across all pipeline stages. Contribute to and lead discussions on system architecture, ensuring solutions are robust, scalable, and maintainable. Define technical standards and patterns for backend services ...

Senior Data Engineer (Knowledge Systems) This organisation is building a modern, cloud-native platform and evolving towards an AI-first engineering model , where intelligent systems rely on high-quality, well-structured knowledge to power automation, decision-making and software delivery. They are looking for a Senior Data … multiple sources. Choose the most appropriate storage and retrieval approach for different use cases, including document stores, graph databases, vector databases and traditional data platforms. Model complex business domains to improve retrieval quality and contextual understanding. Design and optimise hybrid retrieval strategies using semantic search, keyword search, embeddings ...

Principal Data Engineer (Contract) Outside IR35 Principal Data Engineer £650 per day | Outside IR35 | 3 Month Contract | Remote UK (Very occasional travel to Leeds if you can) Brio Digital are working with a major UK organisation embarking on a strategic data transformation project … into a much larger programme of work. You'll join a cross-functional delivery team alongside Solution Architects, Technical Analysts, Project Managers, and Data specialists, taking ownership of the platform's technical design and engineering. Principal Data Engineer Responsibilities: * Design and build a cloud-native ...

Support and coordinate other delivery managers contributing to the AI strategy, aligning plans and sharing good practice Translate technical concepts - such as architectures, data pipelines, and AI engineering approaches - into clear, accessible language for stakeholders Plan and prioritise work packages, balancing short-term delivery needs with longer-term ...

platforms Handle and partner with external vendors/configuration centres to deliver scalable, compliant solutions globally Act as a link between engineering, product, data science ensuring solutions move beyond prototypes into sustainable production AI & Engineering Leadership Design, develop and maintain production-grade AI applications and services using modern … cloud-native design, CI/CD, testing, observability). Define and implement reusable AI platforms and capabilities (e.g. conversational assistants, AI search, unstructured data processing, GenAI solutions). Lead architectural decisions , ensuring responsible AI, explain ability, security, and operational robustness are embedded by design. Evaluate and integrate LLMs ...

Commerce Data Analyst £35,000 - £45,000 Merseyside (3 days a week on-site) Are you passionate about turning digital data into meaningful business outcomes? This is an excellent opportunity for an E-Commerce Data Analyst to join a growing analytics function where your … influence online performance, customer experience, and commercial decision-making. You'll work closely with E-Commerce and Analytics teams, helping shape strategy through data-driven recommendations. THE COMPANY They are a well-established consumer-focused organisation with a strong digital presence and a commitment to using data ...

Lead Data Engineer £400/day (Outside IR35) | 3-Month Initial Contract, with view to extend | Remote (occasional travel to London) | UK-based candidates only, must hold full right to work in the UK About the Role We're looking for a Lead Data Engineer … take ownership of core data engineering and architecture work while providing technical leadership to a delivery team. This is a hands-on senior role for someone equally comfortable designing scalable data solutions and guiding the engineers building them. Key Details Rate: £400 per day, Outside IR35 ...

working closely with and under the guidance of senior engineers to help integrate AI models into production systems. You will work closely with data scientists, software engineers, and product teams to deliver robust, scalable AI solutions that enhance our Workday product offerings - including Kainos Smart (Smart Test, Smart … early career experience - with an interest in developing MLOps skills (CI/CD, model versioning, monitoring). Awareness of responsible AI, security, and data privacy practices, with the ability to follow agreed guidelines such as handling sensitive data correctly, using approved tools, and raising potential risks ...

risk to unlock opportunity, helping our clients navigate uncertainty with clarity, speed, and confidence. Skills and Competencies 3+ years of experience within a data engineering or software development team Hands‐on experience designing and developing data integration/ETL pipelines from diverse data sources … applying AI‐assisted development tools (e.g., GitHub Copilot, generative AI coding assistants) to improve engineering productivity, code quality, and delivery efficiency Understanding of data engineering considerations for AI and machine learning workloads, including data quality, governance, lineage, and scalability requirements Education Bachelor’s degree or equivalent ...

Data & AI Engineer - London (Hybrid) - Up to £50,000 We are supporting a leading organisation within the Technology and Data space that deliver technology-enabled transformations. This team specialises in building modern, data-driven solutions that enable better decision-making, automation, and innovation. This … opportunity to design, build and deploy enterprise-scale AI solutions, working alongside highly skilled engineers and data specialists to deliver innovative products for a diverse portfolio of organisations. Whether you're an experienced engineer looking to specialise further or you're ready to take on greater technical ownership ...

both parties)**Ways to Stand Out from the Crowd:*** Hands-on experience building or optimizing vertical-specific solutions (e.g., network stacks, bidding algorithms, data pipelines, etc.).* Familiarity with advanced computing, AI, and/or GPU acceleration platforms such as CUDA, Triton, NeMo* Track record in crafting ...

Consulting is hiring a Principal GCP Data Engineer in Bristol to lead data engineering efforts for complex client programmes. You will own end-to-end data solutions, guide architecture, and drive best practices across teams with a focus on production-grade pipelines and cloud … native patterns. You will mentor teammates, influence client stakeholders, and contribute to design discussions beyond data processing, shaping the overall data strategy for large-scale engagements. #J-18808-Ljbffr ...

develop framework is essential Back-end: Expertise in C# .NET Core, REST APIs, and microservices-based development is essential Python (pyspark): Experience with data pipelines and analytics is a plus. Power BI: Familiarity with developing dashboards and data models. Architecture: Knowledge of microservices, API design ...

design and deliver scalable data processing solutions … customers operating in highly sensitive, demanding environments. This is hands-on technical work: you'll architect cloud-native systems, lead data pipeline development, and work directly with technical stakeholders to solve complex, real-world problems. Essential requirements British national only, active SC, and eligible for higher ...

Company Description Experian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more. Experian invests in people and new advanced technologies to unlock … people in 32 countries. Internal Grade D/EB8 Job Description Experian Credit Services & Verifications are looking for a Lead Data Platform Engineer to join our Ascend Cloud Foundation Platform team. Reporting into our Engineering Director, you will join an established agile team, with a passion and lead ...

possible to track and then present KPIs effectively across the Group. Main responsibilities Support the implementation and development of the Group Microsoft Fabric data environment Design and maintain data ingestion pipelines from multiple source systems Develop and maintain data models to support reporting … interactive dashboards. Ensuring the dashboard, reporting and design process uses the most appropriate formats to gain maximum user engagement and insight. Ensuring the data integrity of all reports, dashboards, and analysis. Assist in the governance and documentation of BI solutions, including data dictionaries and report inventories. ...

opportunity This is not a standard reporting role. Our client is looking for a commercially minded analyst who is genuinely passionate about data - someone who sees insight as a tool for making better business decisions, not just producing charts for a weekly report. You'll be embedded … Projects team that delivers complex, bespoke, multi-million-pound solutions to international clients. You'll own the data and analytics function for that team - building dashboards, interrogating cost data and helping project managers and commercial leads make smarter decisions throughout the project lifecycle. Longer term, there ...

Lead Data Scientist | Fully Remote | £90,000–£100,000 + Benefits Build the models behind real-time decision making at scale. Why this role stands out This isn’t just another senior data science position. It’s a chance to shape the future of analytics … most successful privately owned technology businesses, a market leader trusted by millions and driven by data at its core. You’ll join a high-performing team working with real-time data, advanced machine learning, and large-scale analytical systems, with the freedom to influence both technical ...

place where people stay because they feel valued, and find room to grow because theyre challenged. About the role Working closely with the Data Analytics Manager and wider Marketing Team, this role will be responsible for turning audience data and customer intelligence into real-world outcome … marketing activations across paid media, CRM, and emerging channels across the DFS Group. This role sits at the heart of our Group Customer Data Strategy so the successful candidate will be responsible for the deployment and activation of our First Party Data (1PD) audiences, enriching audience ...

Contract Role Data Engineer £500 Inside ir35 Remote SC Clearance Required 6 Months contract Must-Have Skills & Experience Strong hands-on experience with Informatica PowerCentre (v10.6 preferred) Extensive experience working with Oracle databases (SQL & PL/SQL) Proficiency in UNIX/Linux shell scripting Proven experience working … Data Warehouse/ETL environments Experience in data integration, transformation, and performance tuning Strong understanding of ETL frameworks, data pipelines, and batch processing Desirable Skills Working knowledge of SAS (especially in ETL context) Experience in migrating SAS workloads to Informatica ETLs Familiarity with data ...