301 to 325 of 379 Data Pipeline Jobs in the UK excluding London

and speech-to-speech tasks Translating academic and internal research into scalable, maintainable code and services Developing and maintaining training pipelines, inference services, and deployment workflows Implementing robust data pipelines for sourcing, preprocessing, and versioning multimodal datasets Collaborating with research scientists to refine model architectures and integrate the latest techniques into production Evaluating model performance with custom metrics More ❯

What you’ll be doing We’re looking for someone who has experience guiding teams and supporting clients to use data to make better decision making. Data is at the heart of everything we do and we're working on some amazing projects across both our Health and Private clients. If you're interested in being … involved in work that delivers real value then we'd love to hear from you! What you’ll bring to Answer Designing and implementing complex data pipelines, leveraging both NoSQL and relational databases. Develop and manage cloud-based data solutions, ensuring scalability and security. Lead and mentor junior data engineers, promoting knowledge sharing and … professional growth. Implement and oversee CI/CD pipelines, ensuring efficient deployment of data services. Proficiency in Python, SQL, and other relevant backend languages. Utilise backend programming languages effectively for data processing and manipulation. It would be great if you also had experience in some of these, but if not we’ll help you with them More ❯

as specialist practices Publicis Media Exchange (PMX), Performics, Publicis Sport & Entertainment, Publicis Media Content and NextTECHnow. Together they combine deep expertise in media investment, strategy, insights and analytics, data and technology, commerce, performance marketing and content. Publicis Media is part of Publicis Groupe and is present in more than 100 countries with over 23,500 employees worldwide. Our … encourages applications from underrepresented groups. We are committed to equality of opportunity and welcome applications from individuals, regardless of their background. Job Description We are looking for a Data Engineer to join our Product Development team. You will work closely with the Scrum Master to deliver our technical builds, approach, and prioritisation. Are you a developer, data or software engineer with experience working with advertising/media dataset, and a history of creating data pipelines and structures that can be used in front end applications or creating automations that make data work harder? If so this is the role for you! Qualifications To be successful in this role you will need More ❯

DOE) + Benefits SQL Database Developer needed for a permanent career opportunity based in Derby . A chance to join an established + growing software business who develop data solutions for large Retail brands. Must be willing to work in the Derby office on a full-time basis. Start ASAP during Summer 2025. Key experience + responsibilities: Designing … SQL Server database solutions that power core business applications. Strong hands-on SQL Server database development skills including: complex stored procedures T-SQL, indexing, relational/dimensional modelling, data dashboards. Building/optimising data pipelines and integrations across cloud platforms. Any cloud platforms experience would be helpful including: such as Snowflake, Databricks, BigQuery, Azure SQL. Working … closely with key stakeholders including data architects, analysts, testers and managers. Working across the full SQL development life-cycle including: design, development, documentation and testing. Advantageous Skills: Power BI, NoSQL, Azure Synapse, data visualisation tools, Data Lakes, streaming technologies, MDM, Git, DevOps pipelines. Benefits include: to £50k Base (DOE) + 25 days holiday (plus More ❯

on experience Working Hours – 37.5 hours a week, Monday to Friday We are the brand behind world-class brands. We deliver unparalleled customer management, marketing, payment, technology and data solutions, making us the largest and most strategically aligned full-service provider for publishers globally. We have earned the trusted confidence of a wide range of companies supporting over … brands globally The Analytics Engineer will join a strong team who design, develop, deploy and maintain scalable data pipelines and analytics solutions. The Analytics Engineer is responsible for creating, enhancing and maintaining reporting services to meet requests for new functionality and support internal and external users. The Analytics Engineer will also be responsible for resolving support requests in … collaborate with cross-functional teams and translate business requirements into technical solutions. A very strong command of SQL, both Athena and MSSQL A good understanding of methods for data manipulation, analysis, and automation tasks. Experience with Microsoft SSIS ETL pipelines. Experience with AWS tools such as S3, Glue, Redshift, Lambda, and Athena for building scalable data More ❯

days per month on site in Telford and is inside IR35 so will require working via an FCSA accredited umbrella company. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in SAS More ❯

a new scrum team within Minerva Platfrom to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support Business Intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in SAS More ❯

Job Title: Data Engineer Location: Leeds/Hybrid (2x per week on site) Salary: Up to £55,000 per annum Why Apply? This is an exciting opportunity for an experienced Data Engineer to play a pivotal role in a business critical data transformation project. With a major migration to Microsoft Fabric underway, you'll … the very beginning of this journey, contributing to tooling decisions, shaping future architecture, and helping to knowledge share with the wider team. Responsibilities: Design, build, and maintain scalable data pipelines and ELT processes using Microsoft Fabric and related tools Optimise data flows and models for performance, scalability, and cost efficiency Collaborate closely with Analysts to deliver … data for reporting and insight Work alongside the Governance team to ensure data is secure and well managed Support the migration from an on-prem SQL Server data warehouse to Microsoft Fabric Contribute to knowledge sharing and training across the wider team Requirements: Proven experience designing and implementing solutions in Microsoft Fabric Proficiency in More ❯

in high-velocity environments. Deep knowledge of modern ML (supervised, unsupervised, generative, self-supervised learning, etc.). Strong understanding of ML systems at scale: inference pipelines, observability, MLOps, data pipelines, etc. Background in building ML for real-world infra, distributed systems, or low-latency environments is a big plus. Confident working at both strategic and technical depth, exec More ❯

deploying scientific software using common CI and containerization solutions. - Enjoy staying up to date with current software development best practices and tools, e.g. AI coding assistants or modern data pipelines and scheduling solutions. - Enjoy diving into new problems with a continuous learning attitude, absorbing relevant domain knowledge. - Additional experience with scientific C++ and Fortran libraries, HPC technologies, cloud More ❯

solutions and consultancy projects to clients across a range of sectors (travel, manufacturing, microfinance, engineering, services etc.). Typical responsibilities will include: Manage both scheduled and ad hoc data harvesting processes. Write efficient regular expressions to extract data from raw HTML, JSON, and XML. Clean and validate harvested data using automated processes. Troubleshoot and … resolve complex data processing issues. Maintain and enhance existing data pipelines and services. Improve automation for data processing and delivery. Core Requirements: Solid understanding of HTTP protocols and request/response architecture. Proficiency in writing Regular Expressions for data extraction. Working knowledge of Python, SQL, and either C# or Java. Strong problem … solving and debugging skills. Effective communication skills for understanding project needs and working with the team. Advantageous: Experience with automated data harvesting using Python, C#, or Java. Familiarity with front-end technologies (JavaScript, React). Experience with cloud platforms like AWS or GCP (especially BigQuery). Exposure to Big Data tools such as Elasticsearch. Background in More ❯

Your new company Working for a globally renowned bank. Your new role You will be working as a Senior Bi Engineer in a newly formed data product team. In this role you will be supporting Front Office operations possessing strong expertise in Power Bi and Data Engineering, with good stakeholder management experience.You will be: Designing and … maintaining Power BI dashboards for trading, risk, and regulatory reporting as well as building data pipelines for real-time financial data. Partnering with the front office to deliver analytics solutions and optimising data models for front office reporting. What you'll need to succeed Strong business intelligence/data engineering experience with strong Power … BI expertise. Data engineering experience building production pipelines - with Databricks Business experience working around the Front Office/Risk is a must! Understanding of regulatory reporting processes. Financial product knowledge e.g. - equities, fixed income, derivatives. Experience on Azure cloud platforms. What you'll get in return Flexible working options available. What you need to do now If you More ❯

and push boundaries, then CAVU is the place for you. Together, we can reach new heights. Together, we are CAVU. The role We're looking for a Lead Data Engineer to join our growing tech team. In this senior technical role, you'll lead the design and implementation of scalable data infrastructure and robust ETL pipelines … to enable data-driven decision-making across the business. Working closely with analysts, data scientists, and stakeholders across the business, you'll ensure we extract maximum value from our data assets. You'll be at the heart of our mission to make our global single platform the best in the market - a tech-first … travel. This is a hands-on, delivery-focused leadership role-perfect for someone who thrives on innovation, collaboration, and making things happen. Projects range from client integrations and data warehousing to machine learning and real-time reporting. If you're excited about building systems from the ground up in a supportive, forward-thinking environment, this is your opportunity More ❯

Job Title: Data Engineer Location: London (Hybrid - 2 days in office) Type: Full-time Agency: Representing a leading digital media group We're representing a well-established digital media company with a growing portfolio of high-traffic content brands. As they expand their data capabilities, they're looking for a Data Engineer to join … their London-based team. Key Responsibilities: Design and maintain scalable data pipelines across diverse sources. Automate and optimise workflows using tools like Airflow, dbt, and Spark. Support data modelling for analytics, dashboards, and A/B testing. Collaborate with cross-functional teams to deliver data-driven insights. Work with cloud platforms (GCP preferred) and … A proactive, collaborative approach and strong communication skills. This is a fantastic opportunity to work in a fast-paced, content-rich environment and help shape the future of data in digital publishing. Diversity, equity and inclusion are at the heart of what we value as an organisation. Boston Hale is an equal opportunities employer, and all qualified applicants More ❯

users worldwide. Joining this team means becoming part of a culture that values curiosity, collaboration, and a deep commitment to quality and impact. Your New Role As a Data Engineer, you'll be instrumental in designing, building, and optimising data pipelines and infrastructure that support advanced analytics and modelling. You'll collaborate with cross-functional teams … to manage complex ETL processes, implement best practices in code management, and ensure seamless data flow across platforms. Projects may include connecting SharePoint to Databricks, optimising Spark jobs, and managing GitHub-based code promotion workflows. This is a hybrid role based in London, with 1-2 days per week in the office. What You'll Need to Succeed … You'll bring 5+ years of data engineering experience, with expert-level skills in Python and/or Scala, SQL, and Apache Spark. You're highly proficient with Databricks and Databricks Asset Bundles, and have a strong understanding of data transformation best practices. Experience with GitHub, DBT, and handling large structured and unstructured datasets is essential. More ❯

AI-enabled workflows to prioritise investigations, surface insights, and allow teams to work collaboratively at pace to achieve successful, measurable outcomes. As a Technical Leader for AI and Data at Clue, you will play a pivotal role in accelerating automation and efficiency improvements across investigation workflows supported by our SaaS product. You will lead by example, acting as … a senior technical contributor while coordinating the work of a high-performing team. Your deep expertise in AI, data engineering, and cloud-native development will help shape the future of our platform. Key Accountabilities Lead the technical development of our AI and data initiatives, ensuring alignment with business goals and product strategy. Act as a senior … hands-on contributor (approx. 90% of your time), designing and developing scalable AI and data solutions. Mentor and support the growth of team members through technical guidance, code reviews and knowledge sharing. Coordinate and oversee the technical work of the team, ensuring high-quality delivery and adherence to best practices. Collaborate with cross-functional teams including Product, Engineering More ❯

dashboards and reports using Microsoft Power BI and SQL. The role supports performance monitoring of the SEND DMP and SEND service decision-making. You will work with the Data Group, SEND Business Analyst, the Capita lead and the head of Service for SEND Qualifications Degree in Computer Science, Data Science, Mathematics, or related field, or equivalent … certification (optional but preferred). Design and develop visually compelling and interactive Power BI dashboards and reports. Translating business requirements into technical solutions Connecting to a variety of data sources (Capita, SQL Server, Excel, SharePoint, APIs, etc.) . Model data efficiently (e.g. star schema) for performance and scalability. Collaborate with DMP Data Group and … SEND Head of Service to define KPIs, metrics, and reporting needs. Schedule and manage data refreshes and gateway configurations. Work with the BA and Capita lead to ensure data accuracy, consistency, and security across reports. Document data sources, transformation logic, and report structures. Provide support, training, and guidance to end-users on Power BI More ❯

remote. Key Requirements: Strong experience with Server-Side Tag Management Google Tag Manager (GTM) - Server-Side essential Google Meridian - MUST HAVE Google Cloud Platform (GCP) Experience setting up data pipelines, event tracking, and tag execution environments Bonus Experience: Experience working with travel or airline clients (huge plus) eCommerce or Shopify knowledge is an advantage Timeline: Start Date: September More ❯

ll bring the expertise. We'll provide the platform to succeed. Ready? It's time to do your thing. Who you'll be working with: Liberty IT's Data Science group partners directly with business stakeholders and global data science teams to create solutions for large business problems. You will collaborate closely with experienced data scientists focusing on advanced challenges such as entity resolution at scale and graph modelling with Neo4J to produce graphical representations of potential fraud rings. Our Data Scientists research and apply advanced techniques in Machine Learning, Natural Language Processing, Deep Learning, and Computer Vision to understand how we can utilise data across all components of … insurance, for example in managing risk, and build solutions that enable Liberty Mutual to achieve this. You will have opportunities to learn from and contribute alongside expert data scientists, and to coach and mentor emerging talent. Experience and skills we need: A third level qualification in Mathematics, Computer Science, Statistics or another quantitative field. A minimum of two More ❯

+ bonus + benefits We are working with a leading Financial Services organisation who have an excellent opportunity for an experience Quality Engineer to join their Data Reporting Product team. This is very much a hands off leadership role - focusing on best practice adoption, working with 3rd parties, engagement with senior stakeholders, however, we do require someone who … has come from a technical Datawarehouse testing background. You'll lead testing efforts across data warehouse solutions, driving quality across ETL processes, data pipelines, and system integrations.What You'll Do:* Define and execute testing strategies for data accuracy, quality, and performance* Lead a high-performing testing team and collaborate across Agile teams* Implement automated … testing frameworks integrated into CI/CD pipelines* Ensure data validation, consistency, and completeness across complex systemsWhat You'll Bring:* Background within data warehouse testing (ETL, pipelines, cloud-native platforms like Snowflake)* Experience building and maintaining test harnesses using tools like dbt (Data Build Tool) for automating data validation across ETL processes More ❯

ll join the Platform & AI Enablement team within our GPTO Engineering organization, reporting to the Sr. Director Engineering API. The team is responsible for building and supporting the data and AI platforms that underpin our industry-leading Business Planning Software solutions. This is a highly hands-on role focused on designing, building, and operating scalable systems that integrate … event-driven, batch & streaming data flows, and AI capabilities into the platform. Your Impact Build and maintain core platform capabilities that support high-throughput batch, streaming, and AI-powered workloads. Develop resilient, observable, and scalable systems using Apache Kafka, Flink, Pulsar, and cloud-native tools. Collaborate with AI/ML engineers to operationalize models and enable generative AI … use cases such as prompt-based insights or automation. Deliver reliable integrations with data lakes, event stores, and analytics systems, ensuring data flows efficiently across the business planning ecosystem. Contribute full-stack code where needed, including React-based frontends and backend services in Java and Python. Write clean, maintainable, well-tested code with an emphasis on More ❯

ll join the Platform & AI Enablement team within our GPTO Engineering organization, reporting to the Sr. Director Engineering API. The team is responsible for building and supporting the data and AI platforms that underpin our industry-leading Business Planning Software solutions. This is a highly hands-on role focused on designing, building, and operating scalable systems that integrate … event-driven, batch & streaming data flows, and AI capabilities into the platform. Your Impact Build and maintain core platform capabilities that support high-throughput batch, streaming, and AI-powered workloads. Develop resilient, observable, and scalable systems using Apache Kafka, Flink, Pulsar, and cloud-native tools. Collaborate with AI/ML engineers to operationalize models and enable generative AI … use cases such as prompt-based insights or automation. Deliver reliable integrations with data lakes, event stores, and analytics systems, ensuring data flows efficiently across the business planning ecosystem. Contribute full-stack code where needed, including React-based frontends and backend services in Java and Python. Write clean, maintainable, well-tested code with an emphasis on More ❯

memory, guardrails, orchestration, trace management, and tool marketplaces. System Integration - Integrate AI and GenAI applications into existing systems and workflows, ensuring smooth and efficient operation. Infrastructure - Collaborate with data engineering teams to build scalable data pipelines and infrastructure supporting AI apps and agents. Evals - Monitor and evaluate the performance of AI apps, agents, and the overall … agentic AI system. Stakeholder Collaboration - Work closely with cross-functional teams, including project managers, platform engineers, data engineers, solution engineers, data scientists, and business stakeholders to define, design, and implement new features. Stay Updated - Keep current with the latest trends and advancements in AI and machine learning, and apply relevant innovations to projects. Documentation and Knowledge More ❯

Subject Matter Expert (SME) on Technical and Functional domain areas. What we value Demonstrated experience in Python, PySpark and SQL (AWS Redshift, Postgres, Oracle). Demonstrated experience building data pipelines with PySpark and AWS. Application development experience in financial services with hands on designing, developing, and deploying complex applications.Demonstrated ability to translate business requirements in a technical design … looking for, we don't necessarily need you to fulfil all of them when applying. If you like change and innovation, seek to see the bigger picture, make data driven decisions and are a good team player, you could be a great fit. About State Street What we do. State Street is one of the largest custodian banks … markon the financial services industry. For more than two centuries, we've been helping our clientssafeguard and steward the investments of millions of people. We provide investment servicing, data& analytics, investment research & trading and investment management to institutional clients. Work, Live and Grow. We make all efforts to create a great work environment. Our benefits packages are competitive More ❯

security architecture for AI/ML systems, CI/CD and data pipelines. * Participate in enterprise-wide architecture initiatives for AI/ML. Understand the workflow and pipeline architectures of ML and deep learning workloads. * Conduct security risk assessments and threat modelling for AI/ML and other business projects performed thorough design reviews and security assessments … testing of AI/ML models, LLM and development of trustworthiness, safety, fairness, bias and inappropriateness detection, as well as adversarial test specification, development, and execution. * Collaborate with data scientists, engineers, and other stakeholders to embed security controls and measures into AI/ML applications, models, algorithms, and data pipelines. * Define and enforce robust access controls … authentication mechanisms, and encryption standards to safeguard AI/ML systems, training data, provenance, and any sensitive data. * Stay abreast of emerging AI security threats, trends, and technologies, evaluating their impact and proactively adapting security measures to mitigate potential risks. * Provide technical guidance and support to cross-functional teams during the design, development, and deployment of AI/ More ❯