1 to 25 of 561 Data Pipeline Jobs in the UK

Job summary Are you a data engineer with a passion for public service? Then maybe you're looking for us! We are seeking an experienced and skilled Advanced Data Engineer to be part of a growing team that delivers on our mission of protecting and improving the health and wellbeing of the people of Wales. You … ll be involved in improving our data practices, cataloguing our data, automating our data processing, creating pipelines and developing our overall data maturity. You are an experienced data engineer with leadership, communication and collaboration skills who knows how to deliver in a fast-paced, often ambiguous environment. Working with us … ETL/ELT at scale. Advanced programming skills in SQL and Python and a collaborative, CI/CD approach to pushing code; experience with orchestration and data pipeline tools. You will be able to find a full Job description and Person Specification attached within the supporting documents or please click "Apply now" to view on Trac. The More ❯

Role: Technical Data Architect Location: UK (remote is fine, candidate must be in UK and available for any IMP meeting) Contract: 3 months (will likelyextend) Data Feed Factory - for Telco Network Function Expectations on the role : Hands on Experience on design & architecture of the Data Platform, Technical components and Data Engg. related … Data management. This includes assessing data quality, accessibility, data contract and lineage including any other potential capability evaluation Analyze existing Data pipeline and data workflows to determine the integration points and any design considerations/framework and patterns for the data factory as per the need for … the business users including any ad hoc demand for Data Processing. Support the Automation Code samples and examples produced during MVP phase to address Data pipeline build including Data Platform capabilities More ❯

About The Role Job level: 10 Deadline for applications: 11:59pm on Sunday 26th October. Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising and … sharing opportunities to reuse data flows where possible. Coordinate teams and set best practices and standards when it comes to data engineering principles. Champion data engineering across projects and clients. Responsibilities Lead by example, holding responsibilities for team culture, and how projects deliver the most impact and value to our clients. Be accountable for … understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts to both technical and non More ❯

NATIONAL BUSINESS REQUIRES PROACTIVE BUSINESS INTELLIGENCE STRATEGIST/LEAD DATA ANALYST TO SPEARHEAD DATA AND REPORTING STRATEGY, BUILDING A DATA-DRIVEN CULTURE FROM THE GROUND UP WITH A DATA WAREHOUSE-FIRST MINDSET. TITLE: Business Intelligence Strategist/Lead Data Analyst SALARY: £(phone number removed) LOCATION: Office Based near Wakefield You … may have been a: Data Officer, Data Strategist, Data Analytics Manager, Business Intelligence Manager, Data Governance Manager, Reporting and Analytics Manager, Data Operations Manager, Head of Data Strategy, Business Intelligence Strategist, Data Insights Manager, Enterprise Data Manager, Data Program Manager, Analytics and … Reporting Lead, Data Solutions Architect RESPONSIBILITIES: Business Intelligence Strategist/Lead Data Analyst Engage with non-technical stakeholders to identify business challenges, define requirements, and create effective reporting solutions. Lead the transition from reporting on production databases to a robust data warehouse as the single source of truth. Design and build new ETL/ More ❯

Job Title: Senior Data Architect Salary: £70,400 - £94,100 Location: Cambridge/Hybrid with office attendance for an average of 2 days a week Contract: Permanent Shape the future of data and AI at Cambridge University Press & Assessment We are Cambridge University Press & Assessment, a world-leading academic publisher and assessment organisation and a proud … part of the University of Cambridge. About the role As a Senior Data Architect, you will play a pivotal role in delivering a coherent and scalable data framework aligned with our enterprise data strategy. You'll advance key architectural principles such as data mesh, data products, and data … data warehouse, and data virtualization concepts. Mastery of data modelling (conceptual, logical, physical), integration patterns (APIs, event-driven, streaming), and data pipeline orchestration. Experience enabling AI/GenAI capabilities and understanding of ethical and responsible AI considerations. Excellent stakeholder engagement and communication skills across technical and non-technical teams. Experience coaching More ❯

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: PermanentWe’re looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight.The Senior Data Engineer will take ownership of developing and integrating data pipelines across the business, supporting enterprise reporting and enabling smart decision-making through Power BI and Azure-based solutions. Key Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and More ❯

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: Permanent We’re looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight. The Senior Data Engineer will take ownership of developing and integrating … data pipelines across the business, supporting enterprise reporting and enabling smart decision-making through Power BI and Azure-based solutions. Key Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce More ❯

we're proud to be consumer champions in the automotive space. We're constantly exploring smarter ways to connect people with the right cars - and that's where data engineering plays a key role. You'll join a focused data team of 4 professionals (2 Data Scientists, 1 BI Developer, and yourself as Data … CI/CD pipelines for our data infrastructure, ensuring automated testing and smooth deployments. Participating in code reviews and contributing to team standards for data pipeline development. Keeping on top of the latest datasets available within the automotive space and making recommendations about new data sources. Supporting and expanding our Microsoft Azure infrastructure … optimising it for data pipeline performance. Writing comprehensive data documentation for analytics-focused entities, accelerating your colleagues' understanding of available data. What You'll Need to Succeed Essential Requirements: 2-4 years of experience building robust data pipelines in a commercial environment or through complex personal projects. Strong Python skills including experience with More ❯

Job summary Claire House has an exciting opportunity for a collaborative and influential individual with excellent communication skills to lead the production, management, and protection of data within Claire House as part of an ambitious digital transformation strategy. About Us: Claire House is a place of positivity and laughter, where we help seriously and terminally ill children live … whatever their age. Main duties of the job In this role, you will be : Overseeing, training and leading a small D&I team, inspiring them to ensure good data management principles. Responsibility for setting team goals and priorities, ensuring projects and submissions are delivered on time and within scope. Updating, managing and maintaining a visible record of team … team. Working with leadership to establish key reporting measures and establishing a regular reporting cycle, delivering accurate, timely and relevant information to leadership, ELT and Board. Championing the data cause within the organisation. Keeping up to date with the latest technology, techniques and methods and proposing ways of using them effectively in the organisation. Developing interactive visualisations and More ❯

and health security Detect: use cutting edge environmental and biological surveillance to proactively detect and monitor infectious diseases and threats to health Analyse: use world-class science and data analytics to assess and continually monitor threats to health, identifying how best to control and mitigate the risks Respond: take rapid, collaborative and effective actions nationally and locally to … lead strong and sustainable global, national, regional and local partnerships designed to save lives, protect the nation from public health threats and reduce inequalities. Job overview The UKHSA Data Design & Architecture (DD&A) team is responsible for supporting data architecture and data solutions across the organisation. We are a small team of solution architects … data architects, and data modellers. We also work closely with other parts of the organisation who also are involved in development and maintenance of infrastructure and software, including Programme Teams, Engineering & Enablement, Surveillance Systems, Data Services & Quality, Genomics, Enterprise Architecture and the Development and Operations team. The DD&A team supervises and actively develops More ❯

Data Architect – Data & AILocation: Hybrid – Burton on Trent Salary: £70,000 REED Technology are working with a client who are looking for a hands-on Data Architect with a passion for building scalable data solutions? This is a fantastic opportunity to join a data-first business with major investment in … its data function, working on modern platforms and with cutting-edge AI and ML initiatives. Key Responsibilities Design and deliver enterprise data models and data architectures Support roadmaps for data platforms, integration, and data processing Work with engineers, data scientists, and stakeholders to deliver trusted, high-quality data solutions Align solutions with governance, compliance, and business requirements Contribute to data standards and best practices Skills and Experience Proven experience as a Data Architect Strong knowledge of data modelling, processing, and integration Hands-on experience with modern data platforms (Azure, Databricks or similar) Ability to translate business needs into More ❯

Data Architect - Data & AI Location: Hybrid - Burton on Trent Salary: £70,000 REED Technology are working with a client who are looking for a hands-on Data Architect with a passion for building scalable data solutions? This is a fantastic opportunity to join a data-first business with major investment … in its data function, working on modern platforms and with cutting-edge AI and ML initiatives. Key Responsibilities Design and deliver enterprise data models and data architectures Support roadmaps for data platforms, integration, and data processing Work with engineers, data scientists, and stakeholders to deliver trusted, high-quality … data solutions Align solutions with governance, compliance, and business requirements Contribute to data standards and best practices Skills and Experience Proven experience as a Data Architect Strong knowledge of data modelling, processing, and integration Hands-on experience with modern data platforms (Azure, Databricks or similar) Ability to translate business needs More ❯

skills and experience, we're looking for people who are innovative, commercial and value the work that they do. Our London office is currently looking for a Senior Data Engineer. The Role The Senior Data Engineer will be responsible for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and … analysis. They play a crucial role in building and managing the data pipelines that enable efficient and reliable data integration, transformation, and delivery for all data users across the enterprise. Key Responsibilities Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and … load it into the appropriate data storage systems Collaborates with data scientists and analysts to optimize models and algorithms for data quality, security, and governance Integrates data from different sources, including databases, data warehouses, APIs, and external systems Ensures data consistency and integrity during the integration process, performing More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or … email WHO WE ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security … projects within UK Govt. Departments in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience More ❯

Are you a Data Engineer, seeking a new challenge? Do you have passion for future vehicle development? If so, Expleo have an opportunity for you! Our client, a prestigious Automotive Manufacturer, is currently recruiting for a Data Engineer to join their Customer Relationship Centre team. As a Data Engineer you will play a key … Engineering, or a related field Experience as a Data Engineer, ideally within a customer service or contact centre environment Knowledge of SQL, Python, and data pipeline development Skilled in Google Cloud Platform (GCP) and cloud data tools Background in CRM systems and customer data structures Understanding of data warehousing … concepts and cloud architecture Experience with ETL tools and frameworks Airflow, Git, CI/CD pipeline Data Insights reporting experience Competent with real-time data processing and streaming technologies Proficiency in Tableau or other data visualisation tools is desirable ** PLEASE NOTE ** To meet with current legislation, right to work checks will be carried More ❯

Job Title: Manager - Cloud Data Architect (AWS & Snowflake) Protiviti's UK ED&A practice offers a comprehensive range of data use cases delivered through various delivery and commercial routes. We work on the full data life cycle with highly skilled and experienced data professionals. Our solutions range from data strategy … and governance through the development, design and implementation of advanced analytics and digitisation. About the Role We are seeking a Manager-level Cloud Data Architect with deep expertise in AWS cloud services , Snowflake , and AWS-native data platforms to lead the design and implementation of scalable, secure, and high-performance data solutions. You will … play a pivotal role in shaping our cloud data strategy, driving innovation, and mentoring teams to deliver enterprise-grade data architectures that enable advanced analytics and Business Intelligence for our clients. Key Responsibilities Architecture & Design Design end-to-end cloud data architectures using AWS and Snowflake, ensuring scalability, security, and performance. Define and promote More ❯

Job Title: Manager - Cloud Data Architect (AWS & Snowflake) Protiviti's UK ED&A practice offers a comprehensive range of data use cases delivered through various delivery and commercial routes. We work on the full data lifecycle with highly skilled and experienced data professionals. Our solutions range from data strategy and … governance through the development, design and implementation of advanced analytics and digitisation. About the Role We are seeking a Manager-level Cloud Data Architect with deep expertise in AWS cloud services , Snowflake , and AWS-native data platforms to lead the design and implementation of scalable, secure, and high-performance data solutions. You will play … a pivotal role in shaping our cloud data strategy, driving innovation, and mentoring teams to deliver enterprise-grade data architectures that enable advanced analytics and business intelligence for our clients. Key Responsibilities Architecture & Design Design end-to-end cloud data architectures using AWS and Snowflake, ensuring scalability, security, and performance. Define and promote best More ❯

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to … a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. You will collaborate with stakeholders to understand their strategic … objectives and identify opportunities to leverage data and data quality. You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems. More ❯

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to … a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. You will collaborate with stakeholders to understand their strategic … objectives and identify opportunities to leverage data and data quality. You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems. More ❯

Purpose of the Job: Design, build, and maintain robust data systems and pipelines that support data storage, processing, and analysis on the Cloud. Work with large datasets, ensuring data quality, scalability, and performance, while collaborating. closely with data scientists, analysts, and other engineering teams to understand their data needs and … provide them with high-quality, accessible data. They are responsible for ensuring that the underlying data infrastructure supports the organizations broader data and business goals, enabling more effective data-driven decision-making. Key Accountabilities: Design and implement scalable, efficient, and secure data architectures, ensuring optimal data flow across systems in … and process across the team along with BI lead. Influence the evolution of business and system requirements and contribute to the design of technical solutions to feed a delivery pipeline that increasingly employs Agile methods such as SCRUM and Kanban You will be required to develop unit tested code and then support test cycles including post implementation validation. You More ❯

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Engineer will include: Understand the business/product strategy and … Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

Practice Group/Department: Integrations/Development & Data Management Job Description We're Norton Rose Fulbright - a global law firm with over 50 offices and 7,000 employees worldwide. We provide the world’s preeminent corporations and financial institutions with a full business law service. At Norton Rose Fulbright, our strategy and our culture are closely entwined. We … as the relevant skills and experience, we're looking for people who are innovative, commercial and value the work that they do. We are embarking on an exciting Data Programme of work and are looking for a talented Data Engineer to join our team. You will play a crucial role in building and managing data pipelines that enable efficient and reliable data integration, transformation and delivery for all data users across the EMEA Region. Responsibilities Design and develop data pipelines that extract data from various sources, transform it into the desired format, and load it into the appropriate data storage systems Implement data More ❯

About PTSG Ltd PTSG Ltd is a market leader in specialist services to the construction and FM sectors, delivering safety, compliance, and maintenance solutions nationwide. As Data Integration Specialist you will be responsible for designing, implementing, and maintaining data integrations that support the seamless flow of data between systems, applications, and databases. This is … a great opportunity for someone to work collaboratively on brand new platforms, focusing on green field development, across a multi company organisation. Reporting to the Data Engineering Manager, the Data Integration Specialist will deliver all aspects of data integration from demand planning through to handover into operational IT, retaining a responsibility to support IT … 8FH) on a hybrid basis (working from home with an office day at least once a week). This role would suit someone who has experience as a Data Engineer , looking for their next career move into a rapidly growing, data driven organisation. What you will be doing: Collaborate with cross-functional teams, including IT, business More ❯

Data Architect Salary : Up to £85,000 (Based on candidate experience) Employee Package: Outstanding employee benefits Hybrid Model : Once a week (London) Job Type: Permanent Job Summary Our client, a leading IT services and consulting firm, is looking for a skilled Data Architect to support enterprise-wide data architecture initiatives. This role focuses on … transforming core data assets into trusted, reusable resources that drive service delivery improvements, business growth, and AI innovation across multiple departments. Understanding of public sector compliance, regulations, and cross-departmental data sharing challenges Key Responsibilities: Build scalable data architecture for high-value organizational data assets Work with product teams and stakeholders to …/foundational data experience, cloud-native platforms knowledge, AI/ML data requirements understanding, data federation/cached services familiarity, data pipeline development, and Dell Data Lakehouse/DDAE administration experience. To be considered, please ensure you complete your application on the Computappoint website. Services offered by Computappoint Limited More ❯

Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the … latest big data tools, frameworks and offerings (data mesh, etc.), while also being involved in enabling credible and collaborative problem solving to execute on a strategy. Job responsibilities You will develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions You will develop … intricate data processing pipelines, addressing clients' most challenging problems You will collaborate with data scientists to design scalable implementations of their models You will write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines You will use different distributed storage and computing technologies from the More ❯