1 to 25 of 479 Permanent Data Pipeline Jobs in the UK

that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … re underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data … data engineering projects. You will work closely with cross-functional teams and contribute to the strategic direction of our data initiatives. RESPONSIBILITIES Data Pipeline Development: Lead the design, implement, and maintain scalable data pipelines for ingesting, processing, and transforming large volumes of data from various sources using tools such More ❯

best platform, people, and partners together to create limitless opportunities for growth. For more information, visit About Choreograph: A Leading WPP Media Brand Choreograph is WPP's global data products and technology company. We're on a mission to transform marketing by building the fastest, most connected data platform that bridges marketing strategy to scaled activation. … We work with agencies and clients to transform the value of data by bringing together technology, data and analytics capabilities. We deliver this through the Open Media Studio, an AI-enabled media and data platform for the next era of advertising. We're endlessly curious. Our team of thinkers, builders, creators and problem solvers … are over 1,000 strong, across 20 markets around the world. Role Summary and Impact We are seeking a meticulous and experienced Data Architect to play a crucial role in designing, documenting, and ensuring the quality of our next-generation media data lake on the Microsoft Azure platform. This role will focus on developing and upholding More ❯

Data Architect Location: Hybrid working (minimum 2 days a week in Staffordshire Head Office) Type: Full-time Salary: Up to £70,000 Are you a visionary Data Architect ready to shape the future of enterprise data and AI ? I have an amazing opportunity to join my national market leading client to lead the design … and delivery of scalable, secure, and high-performing data solutions that power transformation across a complex, data-rich organisation. What you'll be doing As a Data Architect, you'll be at the heart of enterprise-wide change programmes, working closely with the Lead Data Architect to: Design and deliver enterprise Data & AI architecture aligned with strategic goals. Develop conceptual, logical, and physical data models for both operational and analytical use cases. Define data architecture for solutions involving ETL , data integration, and migration. Establish and maintain data architecture assets, including standards, policies, and integration patterns. Collaborate with Data Stewards, Analysts More ❯

Key Responsibilities: Data Pipelines and … ETL Processes ETL Design: Design and implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions. Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data factory and engineering tools … recovery processes to maintain data integrity. Azure Services Utilise Azure Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer. Ensure the scalability and reliability of data solutions using Azure's suite of services. Collaboration More ❯

uniquely collaborative model across the firm and throughout all levels of the client organization, generating results that allow our clients to thrive. What You'll Do Join the Data Layer Team, a global portfolio transforming our organization into a data-driven enterprise! The Data Layer Team is a portfolio of 30 people who build … essential data platforms, products, and capabilities to empower our clients and colleagues with high-quality, actionable insights. Our focus is on creating scalable data solutions and advancing our data infrastructure to drive informed decision-making across the company. As Use Case Enablement Product Analyst within BCG's Data Layer Team, you will … collaborate with Use Case Enablement Product Owner and cross-functional teams to gather and analyze business and data requirements. Your role is critical to bridging the gap between business stakeholders and technical teams, ensuring that new GenAI use cases are well-scoped, feasible, and aligned with user needs. You will work with various Gen AI use cases and More ❯

skills and experience, we're looking for people who are innovative, commercial and value the work that they do. Our London office is currently looking for a Senior Data Engineer. The Role The Senior Data Engineer will be responsible for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and … analysis. They play a crucial role in building and managing the data pipelines that enable efficient and reliable data integration, transformation, and delivery for all data users across the enterprise. Key Responsibilities Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and … load it into the appropriate data storage systems Collaborates with data scientists and analysts to optimize models and algorithms for data quality, security, and governance Integrates data from different sources, including databases, data warehouses, APIs, and external systems Ensures data consistency and integrity during the integration process, performing More ❯

Job summary The role holder is responsible for the leading the design, development, and ongoing enhancement of organisations data infrastructure and pipelines to support advanced data collection, storage, processing, and analysis. Main duties of the job The role holder is accountable for a team of data engineers, fostering a culture of technical excellence and … continuous improvement. The role holder will work collaboratively with cross-functional teams, including analysts, software engineers, and key stakeholders, to ensure that data solutions are robust, scalable, and aligned with the strategic goals of delivering high-quality care for our patients. About us Since 2012, CHEC has been working with the NHS to increase patient choice and provide … engineering solutions and provide comprehensive reports. Identify and address performance bottlenecks, optimise data processing and query performance for scalability. Implement monitoring frameworks to oversee data pipeline health, swiftly resolving issues to maintain system integrity. Conduct performance tuning to fulfil scalability and availability targets. Develop and enforce stringent data security measures, including access controls More ❯

SQL Developer or Senior Data Analyst or Data Engineer, SQL Azure V12, SQL, Relational databases, ETL, SSIS, SSMS, Analytical and problem solving softer skills. This role is 2 days a week in the office and 3 days remote working. You can either be based in Cambridge or Sheffield, so candidates commutable to either location is fine. … Lithium3 are working with our client exclusively to recruit a Senior Data Engineer (Who could also be a Senior Data Analyst or SQL Developer background) to join their established team who sit between the … main Enterprise Data Warehouse Build function and the visualisation team for reporting. This individual will be responsible for managing, maintaining expanding and optimising the data pipeline and architecture, and supporting end users through data and report delivery. This team is very much doing Projects , working with technical and non-technical stakeholders on business More ❯

SQL Developer or Senior Data Analyst or Data Engineer, SQL Azure V12, SQL, Relational databases, ETL, SSIS, SSMS, Analytical and problem solving softer skills. This role is 2 days a week in the office and 3 days remote working. You can either be based in Cambridge or Sheffield, so candidates commutable to either location is fine. … Lithium3 are working with our client exclusively to recruit a Senior Data Engineer (Who could also be a Senior Data Analyst or SQL Developer background) to join their established team who sit between the … main Enterprise Data Warehouse Build function and the visualisation team for reporting. This individual will be responsible for managing, maintaining expanding and optimising the data pipeline and architecture, and supporting end users through data and report delivery. This team is very much doing Projects , working with technical and non-technical stakeholders on business More ❯

SQL Developer or Senior Data Analyst or Data Engineer, SQL Azure V12, SQL, Relational databases, ETL, SSIS, SSMS, Analytical and problem solving softer skills. This role is 2 days a week in the office and 3 days remote working. You can either be based in Cambridge or Sheffield, so candidates commutable to either location is fine. … Lithium3 are working with our client exclusively to recruit a Senior Data Engineer (Who could also be a Senior Data Analyst or SQL Developer background) to join their established team who sit between the … main Enterprise Data Warehouse Build function and the visualisation team for reporting. This individual will be responsible for managing, maintaining expanding and optimising the data pipeline and architecture, and supporting end users through data and report delivery. This team is very much doing Projects , working with technical and non-technical stakeholders on business More ❯

SQL Developer or Senior Data Analyst or Data Engineer, SQL Azure V12, SQL, Relational databases, ETL, SSIS, SSMS, Analytical and problem solving softer skills. This role is 2 days a week in the office and 3 days remote working. You can either be based in Cambridge or Sheffield, so candidates commutable to either location is fine. … Lithium3 are working with our client exclusively to recruit a Senior Data Engineer (Who could also be a Senior Data Analyst or SQL Developer background) to join their established team who sit between the … main Enterprise Data Warehouse Build function and the visualisation team for reporting. This individual will be responsible for managing, maintaining expanding and optimising the data pipeline and architecture, and supporting end users through data and report delivery. This team is very much doing Projects , working with technical and non-technical stakeholders on business More ❯

Senior Data Engineer/Technical Lead Hybrid - London with 2/3 days WFH Circ £85,000 - £95,000 + Bonus An excellent opportunity is available for a Senior Data Engineer/Technical Lead looking to move into a Management/Leadership position. This is an exciting newly created hands-on Data Engineer Managers … post that will be responsible for leading and mentoring a small team of Data Engineers whilst overseeing data platform development and optimisation. Our client is a well-established and rapidly growing global ecommerce business with its headquarters based in London. Having implemented a new MS Fabric based Data platform, the need is now to … scale up to meet the demand to deliver data driven insights and strategies right across the business globally. The role will require someone that's happy to be hands-on (potentially up to 50% of the time) as you'll be troubleshooting, doing code reviews, steering the team through deployments, acting as an escalation point for technical issues More ❯

Senior Data Engineer/Technical Lead Hybrid - London with 2/3 days WFH Circ £85,000 - £95,000 + Bonus An excellent opportunity is available for a Senior Data Engineer/Technical Lead looking to move into a Management/Leadership position. This is an exciting newly created hands-on Data Engineer Managers … post that will be responsible for leading and mentoring a small team of Data Engineers whilst overseeing data platform development and optimisation. Our client is a well-established and rapidly growing global ecommerce business with its headquarters based in London. They've been expanding at pace and have ambitious plans to take the business even further. … Having implemented a new MS Fabric based Data platform, the need is now to scale up to meet the demand to deliver data driven insights and strategies right across the business globally. The role will require someone that's happy to be hands-on (potentially up to 50% of the time) as you'll be troubleshooting More ❯

This newly created Data Engineer Managers position is an excellent opportunity for a hands-on Senior Data Engineer/Technical Lead/Engineering Team Lead etc looking to move into a management position. The postholder will lead and mentor a team of 3 Data Engineers whilst overseeing data platform development and optimisation. … Our client is a well-established and rapidly growing global ecommerce business with its headquarters based in London. The Data Engineer Manager will play a pivotal role at the heart of our clients data & analytics operation. Having implemented a new MS Fabric based Data platform, the need is now to scale up and meet … the demand to deliver data driven insights and strategies right across the business globally. Therell be a hands-on element to the role as you'll be troubleshooting, doing code reviews, steering the team through deployments and acting as the escalation point for data engineering. This is a hybrid role based in Central/West London More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or … email WHO WE ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security … projects within UK Govt. Departments in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience More ❯

Join our rapidly expanding team as a hands-on Cloud Data Analytics Platform Engineer and play a pivotal role in shaping the future of data at Citi. We're building a cutting-edge, multi-cloud data analytics platform that empowers our users with secure, scalable, and efficient data insights. This role sits … at the intersection of infrastructure, data engineering, and architecture, offering a unique opportunity to work with the latest cloud-native technologies and influence our data strategy. This is a hands-on role requiring deep technical skills and a passion for building and optimizing data platforms. What You'll Do: Architect and Build: Design and … data zones. Familiarity with data governance tools and frameworks. IaC Proficiency: Solid experience with Terraform and preferably Harness, Tekton, or Lightspeed for CI/CD pipeline management. Kubernetes Mastery: Strong command of Kubernetes, especially in the context of data processing workloads. Security Focus: A firm grasp of cloud security principles and best practices. More ❯

Purpose of the Job: Design, build, and maintain robust data systems and pipelines that support data storage, processing, and analysis on the Cloud. Work with large datasets, ensuring data quality, scalability, and performance, while collaborating. closely with data scientists, analysts, and other engineering teams to understand their data needs and … provide them with high-quality, accessible data. They are responsible for ensuring that the underlying data infrastructure supports the organizations broader data and business goals, enabling more effective data-driven decision-making. Key Accountabilities: Design and implement scalable, efficient, and secure data architectures, ensuring optimal data flow across systems in … and process across the team along with BI lead. Influence the evolution of business and system requirements and contribute to the design of technical solutions to feed a delivery pipeline that increasingly employs Agile methods such as SCRUM and Kanban You will be required to develop unit tested code and then support test cycles including post implementation validation. You More ❯

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Engineer will include: Understand the business/product strategy and … Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Engineer will include: Understand the business/product strategy and … Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

Konexo, the consulting arm of Eversheds Sutherland, is adding to our specialist Data Bench. We want to connect with Data Scientists, Data Engineers and Data Analysts who have supported regulatory remediation and transformation programmes in financial services. About Konexo Financial Services Konexo Financial Services delivers regulatory remediation, compliance, risk and financial crime … project teams who deliver practical, outcomes-driven solutions. What we look for Experience on large scale remediation across AML, KYC, Sanctions, Conduct and Customer Outcomes Strong skills in data analysis, modelling and MI to support compliance and risk remediation Building and optimising data pipelines and governance frameworks Turning data into insight that strengthens regulatory … Proficiency with Python, SQL, R, Power BI and cloud platforms such as Azure, AWS or GCP Example interim roles we cover and are seeking to add to our Data bench Data Scientist Data Engineer Senior Data Analyst BI Developer/Power BI Specialist Data Quality Lead Data Governance More ❯

with a flexible, student-powered workforce. The platform enables partnersfrom local pubs to multinational chainsto optimise staffing in real-time, enhancing efficiency and profitability. The Role As a Data Engineer, you'll play a pivotal role in shaping the data infrastructure. Your responsibilities will include: Building and Maintaining Data Pipelines: Design and implement scalable … data scientists, software engineers, and internal stakeholders to understand data needs and deliver solutions that drive data-driven decisions. Monitoring and Troubleshooting: Oversee pipeline performance, address issues promptly, and maintain comprehensive data documentation. What Youll Bring Technical Expertise: Proficiency in Python and SQL; experience with data processing frameworks such … architecture, data modelling, and scalable data solutions. Backend Development: Willingness to develop proficiency in backend technologies (e.g., Python with Django) to support data pipeline integrations. Cloud Platforms: Familiarity with AWS or Azure, including services like Apache Airflow, Terraform, or SageMaker. Data Quality Management: Experience with data versioning and quality More ❯

Data Engineer Sr - Informatica ETL Expert page is loaded Data Engineer Sr - Informatica ETL Expert Apply locations Two PNC Plaza (PA374) Birmingham - Brock (AL112) Dallas Innovation Center - Luna Rd (TX270) Strongsville Technology Center (OH537) time type Full time posted on Posted 3 Days Ago job requisition id R185351 Position Overview Job Description Summary At PNC, our … day to foster an inclusive workplace culture where all of our employees feel respected, valued and have an opportunity to contribute to the company's success. As a Data Engineer within PNC's Technology organization, you will be based in Pittsburgh, PA; Cleveland, OH; Birmingham, AL or Dallas, TX. The position is primarily based in a PNC location. … manager's discretion. PNC will not provide sponsorship for employment visas or participate in STEM OPT for this position Key responsibilities - - Design, Develop and maintain scalable and efficient data pipelines and ETL processes - Collaborate with analysts and stakeholders to gather requirements and implement data solutions that meet business needs - Proposes & designs data solutions to More ❯

private and commercial banking, wealth planning and investment management. We believe in traditional relationship and service-led banking powered by modern technology. Job purpose Develop and maintain complex data systems that support the Bank's operations and reporting needs, ensuring they meet all essential data requirements, following strong engineering and automation best practices and collaborating with … Significant hands-on experience with the Azure Data Stack, critically ADF and Synapse (experience with Microsoft Fabric is a plus) Highly developed python and data pipeline development knowledge, must include substantial PySpark experience Demonstrable DevOps and DataOps experience with an understanding of best practices for engineering, test and ongoing service delivery An understanding of Infrastructure … as Code concepts (Demonstrable Terraform experience a plus) Demonstrable experience of Data Pipeline testing, including automated testing, data validation and code assurance Demonstrable experience of working within Agile Delivery projects An understanding of data formats for ingest, transformation and analytics, data security, access control and authorisation, GDPR, data privacy More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions … a focused mentality on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science … projects to tight deadlines Ability to work unsupervised and to manage a varied workload efficiently Minimum criteria You'll need all of these. Solid understanding of data pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions … a focused mentality on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science … projects to tight deadlines Ability to work unsupervised and to manage a varied workload efficiently Minimum criteria You'll need all of these. Solid understanding of data pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI More ❯