1 to 25 of 289 Data Pipeline Jobs

Job Title: Data Platform Architect Location: London Contract Details: Fixed Term Contract for 6 months Responsibilities: Design and support the implementation and configuration of our client's new Data Fabric and iPaaS technologies, ensuring scalability, reliability, security, and cost-effectiveness. Collaborate closely with the Data Product Managers, Data Platform Manager, Data Governance and Information Architecture team, Group IT, Security, and other Architects to understand platform requirements and translate them into technical designs and solutions. Integrate Data Fabric (e.g., Apache Trino) and/or iPaaS solutions (e.g., Snaplogic … principles and patterns such as data lake, data warehouse, data mart, data mesh, data pipeline, data catalogue, data quality, and data governance. Develop high-level and detailed technical designs and gain approval through more »

that align with business objectives. You may also be required to lead or support the delivery of technical workshops to customers. Data Pipeline Development & Optimization: Design, implement, and optimise robust ETL/ELT workflows to ingest, transform, and process large volumes of data, utilizing tools … manage Databricks jobs, ensuring efficient execution and optimization of data workflows. CI/CD & DevOps: Lead efforts to automate data pipeline deployments using Azure DevOps, CI/CD pipelines, and Terraform for infrastructure-as-code. Networking: Design and configure secure networking for data … mesh, lakehouse architecture (with medallion architecture design principles), and streaming and batch processing. Extensive experience with data modeling, ETL/ELT pipeline design, and pipeline optimisation. Proficiency with CI/CD pipelines, Azure DevOps, and infrastructure automation tools like Terraform. Knowledge of secure networking configurations more »

Data Architect – Dynamics 365 CRM, D365 CRM, Microsoft Dynamics CRM, Data Migration, Data Architect, Data Modelling, Data Warehousing, ETL, Data Integration, Cloud Architecture, Azure, SQL, Database Design, Data Governance, Data Security, Data Migration, Business Intelligence, Analytics, Data Strategy, Data Management, Master Data Management, Data Lakes, Data Pipelines, Customizations, Configuration – Contract – West Midlands - £625pd We are looking for experienced Data Architect, preferably with expertise in Dynamics 365/D365 … CRM/CE for an exciting contract opportunity. This is a 6-12-month role where as well as defining the data taxonomy and ontology, you will steer the direction of the business in relation to data retention and ageing from all their data more »

We are searching for an experienced Senior Data Engineer someone to help deliver an ambitious and exciting data transformation programme for one of our technology clients. The position is offered on a remote basis with very occasional trips to the office (this is likely to be … less than 2 or 3 times per year). This is an extremely exciting Senior Data Engineer role which would be ideal for an experienced professional, someone who is ready to lead and innovate. Our client is a 100% data-driven company who pride themselves on … deploying the best engineering practices across their products, solutions and services. In this role, you will: Assemble large, complex data sets. You will craft and manage data sets that meet both functional and non-functional business requirements. Build advanced data solutions - you will develop more »

Data Lead – Palantir experience + Python, PySpark, SQL, Big Data 12 Months initial contract Hybrid (Maidenhead) – 2 days onsite per week Inside IR35 My client a top Global company are currently looking to recruit a Data Lead with Palantir experience to join their team … on a contract basis. Please note if successful you will need to set up via an Umbrella Company/PAYE. The Data Lead will direct all data resources (analysts and engineers) to manage operational, tactical, and strategic data focused activities. The role will assure … operational capability to support business critical activities, enhance and strengthen portfolio ambitions, administer resource workloads, and resource performance against business priorities. Strategically the Data Lead will be setting the vision and executing the UK Data Strategy, seek key improvements to current processes, improve data more »

Role Title: Data Lead Contract: Until July 2025 Location: Maidenhead (Hybrid) Pay: Competitive SRG are working with a leading pharmaceutical company based in Maidenhead. They are seeking a Data Lead to join their team. Role Overview The Data Lead will direct all data resources (analysts and engineers) to manage operational, tactical, and strategic data focused activities. The role will assure operational capability to support business critical activities, enhance and strengthen portfolio ambitions, administer resource workloads and resource performance against business priorities. Strategically the Data Lead will be … setting the vision and executing the UK Data Strategy, seek key improvements to current processes, improve data capabilities through constantly evolving our offering to scale our capability with the growth of the business and the needs of our customers and increase the data maturity more »

Job description Job Title: Data Engineer Grade: Band 2 Contract type: Permanent Location: London Salary: £61,000 per annum plus civil service pension scheme. Higher ranges may be available for exceptional candidates. Hours: Flexible working and part time hours will be considered. Closing date for applications is … are not able to sponsor work visas or accept temporary visas as we are looking to hire on a permanent basis. Introduction: The Data Engineer is a role within the NAO's Digital Services (DS) function. With responsibility for the design, delivery and maintenance of robust data analytics solutions, the role looks to ensure optimal performance, scalability and reliability. They will work closely with business stakeholder, data scientists and other digital functions to understand requirements and deliver effective data solutions. The post holder will develop and construct data products more »

Global Data Platform Design Lead Location: Surrey (2 days per week) Salary: Up to - £90k per annum % bonus and benefits Permanent Posted by: Mentmore Recruitment Our Client is seeking a Global Data Platform Design Lead to join their team as they embark on an ambitious data strategy programme of work to uplift the data capabilities so they can respond simply and quickly to the needs of their customers. The programme aims to improve how and when their people use data, so it informs and shapes their thinking and enables meaningful … global data platform strategy and roadmap that is modern, adopts industry standards across the spectrum of platform engineering, data engineering (pipeline development) and data operations. Designing and implementing a global approach to data platform standards with a view of business units more »

by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. A fantastic new opportunity has become available Data Engineer or Data Strategy Consultant with one of our Financial One of the world's leading financial institutions, serving individuals, small- and … and governments with a full range of banking, investment management and other financial and risk management products and services based in Chester. Role : Data Engineer or Data Strategy Consultant Location : Bromley (3 days a week onsite) Duration : 12 Months Rate: Circa £600/Day Experience and … Skills required : Strong proficiency in SQL and Python. Experience with data warehousing and data lakehouse architectures. Expertise in data modelling methodologies (3NF, dimensional, data vault) for enterprise-level data stores. Hands-on experience with SQL and/or PL/ more »

Reporting to the General Manager of Data Engineering & Analytics, you'll manage several multi-disciplinary data delivery teams aligned to one of our key customer journey stages with a remit to deliver a wide variety of data analytics, and data integration initiatives. … Our priority is the delivery of high-quality, well-modelled, clean, and trustworthy data assets for use across the business. Our data teams also work hard to support all our data assets and ensure the business realise maximum benefit and return on investment from … understanding, and practical experience, of analytical data modelling techniques is essential (e.g. dimensional modelling, data vault, etc) Data Pipeline - Experience working with a wide variety of data sources and data transformation techniques. Any experience with dBt would be an more »

Data Engineer Data Engineer - Azure Data Bricks, Azure Data Factory (ADF), Purview, Azure Event Hubs, Messaging, APIs, Medallion Architecture, Delta Tables, Delta Live Tables, Data Wrangling, Agile Methodology - Remote (Midlands) - £55-75k + bens An experienced Data Engineer is urgently required to take responsibility for helping to define and implement my clients data strategy and for the design, build and implementation of a new Enterprise data platform. The role is a key appointment and viewed as transformational for this highly-successful … solution provider with an enviable customer base and an impressive portfolio of products Data Engineer Role and Responsibilities: - Work collaboratively with Architects to define, architect and implement an Enterprise data platform - Build, test and maintain a series of complex data platform pipelines - Assume full more »

Head of Data Platform and Solutions - 6 Month FTC London/Hybrid (2-3 days worked remotely) £120,000 - £150,000 pa - pro rata. An exciting opportunity has arisen to join a well known, global organisation in the Law sector. This company, who are famed for their working … culture and offices, are growing a Data and AI team and require a Head of Data Architecture and Platform to join on a 6 month FTC. The Head of Data Platform & Architecture will ensure that the company's data solutions are robust … Architect and Data Modeller on data platform design and on data engineering resources on data pipeline engineering Collaborate with enterprise architects to develop an integrated data solution architecture that aligns with the Firm’s broader IT strategy Design more »

Role: Azure Data Architect & Modeler Contract Duration: 10-12 weeks Location: Remote (UK-based) with occasional travel Start Date: Immediate Overview A leading organisation is currently transforming its data strategy to enhance business outcomes through data-driven decision-making. They seek an experienced professional … with expertise in Azure data engineering and advanced data modelling. This role will support the implementation of the company's next-generation data architecture, ensuring that data models meet enterprise information management, business intelligence, and machine learning objectives. Core Responsibilities Data Architecture & Engineering: Design and deploy data pipelines and storage solutions on Azure Develop robust data integration processes across various systems Optimise batch and streaming data transformation processes Ensure data security and compliance with retention policies Build and test Synapse data more »

Are you an experienced Informatica Cloud specialist with Data Engineering skills ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a hybrid working role and you will be based from either their London, Leeds, Manchester or Edinburgh … including AWS, Azure, or Google Cloud. ETL Processes: Proven ability in developing optimal and reliable ETL processes ingested from a wide variety of data sources, both structured and unstructured. Data Transformation: Strong skills in data transformation, data cleansing, and data mapping using Informatica Cloud tools. SQL: Advanced working knowledge in SQL and relational databases (e.g., Microsoft SQL Server, Oracle). Big Data Technologies: Familiarity with big data technologies such as Hadoop, Spark, or Kafka is a plus. Data Warehousing: Experience in data more »

Lead Data Engineer London (central) x3 days per week in office Up to £100,000 Salary + Discretionary Bonus OVERVIEW ESG driven asset management company are hiring for a Lead Data Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great scope for career progression & you’ll be leading and managing a small team of Data … from the Data Engineering work to contribute towards the Data Science/Analytics. Work across the whole Data pipeline (Data Engineering, Data Warehousing, Analytics) Help shape the strategy and road map for whole Data function and contribute more »

Data Engineering Lead London (central) x3 days per week in office Up to £100,000 Salary + Discretionary Bonus OVERVIEW ESG driven asset management company are hiring for a Lead Data Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great scope for career progression & you’ll be leading and managing a small team of Data … from the Data Engineering work to contribute towards the Data Science/Analytics. Work across the whole Data pipeline (Data Engineering, Data Warehousing, Analytics) Help shape the strategy and road map for whole Data function and contribute more »

Are you passionate about building cutting edge data solutions that drive innovation? Join Saffron Building Society as a Data Engineer, working on our new cloud-data platform you will be at the forefront of transforming raw data into actionable insights, powering decisions … across the organisation If you thrive on solving complex data challenges and want to make a real impact, we want you on our team! Details: Designing, implementing, and maintaining data pipelines and extract, load, transform (ETL) processes to ensure efficient and accurate data flow. … Implementing and optimising ETL processes with dbt (the data build tool) transforming raw data into actionable insights, ensuring data quality and accuracy. Developing and maintaining data models and data architectures within Azure Synapse to support business needs using Kimball methodology more »

Role: Lead Data Engineer with expertise in Azure Data Services and Power BI Location: Hybrid/Home based/Flexible Salary: £70,000 - £90,000 p/a + bonus + benefits Must be eligible for SC Clearance Are you passionate about turning data … your skills can shape business strategies? One of my clients hae recently won a £50m project which has opened up opportunities for x2 Data leads to join their team. As a dedicated MS specialist company, they work with the latest MS tech tools and Azure services from Power … BI to ADF, Data Lake storage, Azure Synaps, Purview for data governance and many more, meaning you will always be upskilled and aligned with the newest versions of the tech and services. Key Responsibilities: Design, develop, and maintain data pipelines using Azure Data more »

in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “Application Support Request”. Role : Senior Data Engineer Job Type: Permanent Location: London Ready to use your skills in data engineering to drive innovation and business value at a … retail leader? Are you passionate about building data pipelines that enable powerful analytics and data-driven decisions? Join us as a Senior Data Engineer! Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just … a dynamic and innovative team, working on cutting-edge technologies to deliver impactful data products for our retail chain Key responsibilities: ETL Pipeline Development : Develop, optimize, and maintain ETL pipelines to efficiently extract, transform, and load data from various sources, ensuring high data more »

is a leading IT corporation globally recognized for its expertise in providing top-notch IT and Ed-tech services. Specializing in digital marketing, data science, data analytics, business analytics, cyber security, UI-UX design, web development, and app development, we are dedicated to innovation, excellence, and … empowering talents worldwide. About the Role: Oeson is seeking enthusiastic individuals who are looking to learn with us in the field of Data Engineering while working on live projects internationally. We are not just offering a flexible work environment but also offering to work with people in a … Projects You Will Work On: Data Warehousing ETL (Extract, Transform, Load) Processes Data Modelling and Database Management Data Pipeline Development Data Quality Assurance Big Data Technologies (e.g., Hadoop, Spark) Data Visualization Roles & Responsibilities: Collaborate with experienced data more »

Are you an experienced Data Engineer ? Do you have extensive Informatica skills ? Have you worked with Snowflake and AWS ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a hybrid working role and you will be based … Experience with cloud integration using AWS ETL Processes: Proven ability in developing optimal and reliable ETL processes ingested from a wide variety of data sources, both structured and unstructured. Snowflake experience is required. Data Transformation: Strong skills in data transformation, data cleansing … and data mapping using Informatica Cloud tools. SQL: Advanced working knowledge in SQL and relational databases (e.g., Microsoft SQL Server, Oracle). Data Warehousing: Experience in data warehousing, including data modeling and implementing data pipelines. Data Management: Multi more »

Are you an experienced Data Engineer ? Do you have extensive Informatica skills ? Have you worked with Snowflake and AWS ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a hybrid working role and you will be based … Experience with cloud integration using AWS ETL Processes: Proven ability in developing optimal and reliable ETL processes ingested from a wide variety of data sources, both structured and unstructured. Snowflake experience is required. Data Transformation: Strong skills in data transformation, data cleansing … and data mapping using Informatica Cloud tools. SQL: Advanced working knowledge in SQL and relational databases (e.g., Microsoft SQL Server, Oracle). Data Warehousing: Experience in data warehousing, including data modeling and implementing data pipelines. Data Management: Multi more »

Job Spec It is for an experienced SQL Developer, who has had hands experience of Performance tuning, writing and maintaining complex stored procedures, data warehousing etc. It is not for a report writer (SSRS) or SSIS developer. Looking for a SQL server development that has a deep understanding … of building solutions that are performant and is able to debug complex issues. About Wealth Data & Analytics Team Data & Analytics provide a sustainable data platform infrastructure for Wealth and the Private Bank to support the multiple channels of their business areas. This includes data warehousing as well as provisioning services to regulatory, colleague, digital, client reporting and analytics channels that are compliant with GDMS data controls and technology governance controls of the bank. The application domain includes and integrates a number of Barclay’s internally developed applications covering Client Data more »

Job summary Information Services objective is to provide data and analytics capabilities to support patient care, quality, performance, financial flows and service development. Enabling operational and clinical excellence, through data excellence. To underpin these objectives, the Data Engineering Team's purpose is to firstly … build, develop and assure the Trust's Data Platform and secondly to use modern technologies, tools & techniques to leverage this asset for the organisation. The role will be responsible for developing and improving the data platform in Microsoft Azure, including the integration of artificial intelligence into … the data warehouse and analytics. This involves managing data pipelines, databases, Azure cloud environment, system security, system planning and technical documentation. You will provide strong technical leadership with the vision to grow the service and introduce new concepts that deliver data excellence. The role more »

Job Title: Senior Data Engineer Location: North East Salary: Competitive We're on the lookout for strong and enthusiastic Data Engineers for an exciting opportunity with one of our fantastic clients. This is your chance to join a thriving organization that's at the forefront of … data innovation, where you'll be working alongside a team of experienced and talented professionals. If you're passionate about building cutting-edge data solutions and want to take the next step in your career, this could be the perfect role for you. Our client offers … you with the tools and support to make a real impact. Whether it's working with the latest cloud technologies or solving complex data challenges, this is a great opportunity to elevate your skills and be part of something truly transformative. If you’re a dedicated data more »