101 to 125 of 917 Data Pipeline Jobs in the UK

Data Engineer Location: Newcastle upon Tyne Salary: Up to £80,000 The Opportunity We are seeking a Data Engineer to join a growing data team responsible for developing and maintaining a modern cloud-based data platform. This role offers the opportunity … work on large-scale data challenges, build robust data solutions and contribute to the continued evolution of the organisation's data capabilities. The successful candidate will play a key role in designing, developing and optimising data pipelines that support reporting, analytics ...

fields of management consulting and investment fund management. Based in Newcastle upon Tyne at their enviable facilities, my client seek a Data Engineer for Full-Stack Data Products, to join their elite Tyneside team as part of rapid expansion of the business to cope with client … engineering best practices. Architecture : Participate in architecture and technical design discussions. Testing: Write automated unit, integration, and end-to-end tests. Data Pipeline Development : Design and develop sophisticated data pipelines to import data from internal and external sources and seamlessly integrate into data ...

tomorrow’s public sector skill demands. This high-impact initiative offers a unique opportunity to join a team dedicated to building a scalable, data-driven recruitment ecosystem. Through redesigning, building, and rolling out a sophisticated Big Data system, our diverse roles span across architecture, project management … data analytics, development, and technical support, giving you the chance to shape a dynamic, next-gen digital infrastructure . You’ll be integral to our mission of crafting a seamless, powerful platform that empowers the public sector with the talent to navigate an evolving digital landscap e. ...

including RBAC, encryption at rest/in transit, privileged access management, and audit logging, in support of ISO27001 compliance. Own the ETL/ELT pipeline architecture connecting source systems to the data warehouse, including data quality validation and error handling. Develop and implement routines … equivalents (e.g., Azure SQL, Snowflake). Experience with ETL/ELT tooling (e.g., SSIS, dbt, Azure Data Factory) and data pipeline design. Understanding of data modelling principles (normalisation, dimensional modelling/star schema for data warehousing). Experience of diagnosing ...

Data Engineer - Dartford - Hybrid (3 Days) - Up to £50,000 We are working in partnership with a well-established international technology business that delivers cutting-edge solutions to commercial and industrial markets across the globe. As part of its ongoing investment in digital transformation and data innovation, the company is looking to appoint a Data Engineer to join its growing internal IT function. This is an excellent opportunity for a data-driven professional to play a pivotal role in shaping and enhancing the organisation's data and Business ...

Azure Data Engineer £450 to £465 per day | Contract | Inside IR35 We are looking for an experienced Azure Data Engineer to join a major data transformation programme, delivering modern cloud-based data solutions using the Microsoft Azure platform. You'll play … role in designing and building scalable data pipelines, supporting enterprise reporting and analytics, and migrating legacy data into a modern Azure Lakehouse environment. Key Responsibilities Develop and maintain data pipelines using Azure Data Factory, Databricks and Azure Lakehouse. Design ETL/ ...

Senior Data Engineer Valid UK Right to Work Required Location: Buckinghamshire (Hybrid - 2-3 days office-based) Salary: £65k+ Benefits The Opportunity We're partnering with a growing organisation in Buckinghamshire looking to appoint an experienced Senior Data Engineer to help modernise and scale their cloud … based data platform. You'll play a key role in designing, developing and maintaining robust data solutions, improving data quality and enabling business-wide reporting and analytics. Working closely with Data Analysts, BI Developers and wider stakeholders, you'll help deliver reliable ...

Data Engineer – NPPV 3 Cleared – Contract – Outside IR35 – Hybrid – Midlands VIQU have partnered with a well-established public-sector organisation in the Midlands, who are seeking a Data Engineer to join a major RMS (Records Management System) replacement programme. The successful Data Engineer will … responsible for designing and building robust data pipelines, supporting large-scale data migration activities, and enabling reporting and analytics capabilities across a complex enterprise environment. Key responsibilities: Design, develop, and optimise scalable ETL/ELT pipelines to support data migration, integration, and reporting requirements. ...

recruiting exclusively for a Junior Data Engineer to join a growing organisation investing heavily in its cloud-based data platform. This is an excellent opportunity for a recent graduate or early-career professional looking to build a career in data engineering, working with modern … Azure technologies and large-scale business data. You'll work alongside experienced data and BI professionals to develop and maintain data pipelines, integrate data from a variety of systems, and help deliver trusted, high-quality data for reporting and business decision-making. ...

Senior Manager, Databricks Architect, AI & Data, FS Location: London Other locations: Primary Location Only Date: 11 Jul 2026 Overview The EY Financial Services AI & Data team is continuing to grow and develop unique advisory propositions aligned to market needs and demand. We are currently looking … exceptional Senior Manager to lead on developing our Data Engineering Capability with an initial focus on Databricks. This is a senior architecture role and will require an individual with an exceptional track record of delivering data transformation programs in the Financial Services sector. The AI & Data ...

transforming, validating and serving complex datasets. Design scalable data models, schemas and storage systems for structured, semi-structured and geospatial data. Build pipeline orchestration using directed acyclic graphs, or DAGs, to manage dependencies, retries, scheduling and observability. Develop systems for data quality testing, lineage, versioning … products, customers and AI systems. Develop workflows for batch processing, event-driven processing and long-running computational jobs. Create monitoring and alerting for pipeline failures, unexpected data changes and quality regressions. Work directly with customers and domain experts to understand source systems and data problems. ...

tools. Ability to foster user engagement through training , workshops, and user-friendly documentation. AI/ML Program Exposure: Experience delivery-managing data pipeline readiness, ELT/ETL architectures, and data preparation specifically geared toward AI model integration Technical Fluency: A strong conceptual understanding of modern … data ecosystems, data warehousing, pipeline orchestration tools (e.g., dbt, Airflow), and data governance standards Cross-Functional Communication: Outstanding stakeholder management skills, with a demonstrated ability to foster collaboration between technical developers and non-technical roles Life at RWS Life ...

Advertisement: Software Developer/Senior Data Engineer Location: London Contract Length: 12 Months Daily Rate: £700 (Umbrella) Are you ready to be part of a transformative journey? Our client is embarking on a major enterprise-wide data platform transformation, and they need a talented Software Developer …/Senior Data Engineer to join their dynamic team! About the Role: You will play a pivotal role in designing and building a state-of-the-art data platform that consolidates data from various business areas into a centralised environment for reporting, analytics ...

Databricks Data Architect London - Hybrid Working We're working with a global consulting and digital transformation organisation that is delivering some of the UK's most ambitious cloud and data modernisation programmes. As a Senior Databricks Data Architect, you'll play a pivotal role … designing and delivering modern data platforms that transform how organisations leverage data. You'll work at the intersection of architecture, engineering and business strategy, helping clients move from legacy environments to scalable, cloud-native data ecosystems. This is an opportunity to influence architecture decisions, establish data ...

Data & Analytics Architect – Senior Manager The SAP Data & Analytics Architect – Senior Manager leads enterprise-wide data transformation initiatives leveraging SAP’s modern analytics and data platform capabilities, including SAP Business Data Cloud (BDC), SAP Datasphere, SAP Analytics Cloud … HANA Cloud. This role combines strategic advisory, solution architecture, delivery leadership, and stakeholder engagement to design and implement scalable, high-quality data and analytics solutions that support business transformation objectives. Key Responsibilities Strategy & Leadership Define and drive SAP Data & Analytics strategies aligned with business and digital ...

# Senior Data Architect - London, UK - FulltimeLondonApply for this job* Permanent* Experienced Professionals* Architecture* ID 522521-en\_GB**About the Job you are considering:**Join Capgemini’s **Integration & Data (I&D)** practice, where we **Consult with Purpose, Continuously Evolve, and Architect Tomorrow**. As a **Data … well as streaming data and unstructured data sources including Cassandra HBase Kafka and Spark* Strong ETL and data pipeline experience particularly with modern big data toolsets such as Airflow and Nifi or equivalent* Strong programming background in either Java Python ...

Azure Data Engineer Rate - up to £350/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based … Central London. They are seeking an experienced Azure Data Engineer to join the project on an initial 6-month contract, with strong potential for extension. Key Responsibilities - Azure Data Engineer: Design, build and maintain scalable and secure data pipelines on the Azure platform. Develop ...

Data Operations Manager up to £75,000 + Benefits London (Hybrid) This is a fantastic opportunity to join one of the UK's most innovative insurance brands, where you can take ownership of Data Operations across a large-scale, business-critical data environment supporting … support resources Driving incident management, service improvements and SLA performance Ensuring environments remain scalable, compliant and fit for purpose Overseeing data pipeline reliability and operational performance Supporting deployment, release and change management processes Providing regular operational reporting and KPI tracking to senior stakeholders Working closely with Data ...

Snowflake Data Architect Location: Wembley (Fully on-site) Salary: £110,000 + Permanent Benefits The Opportunity We are seeking an experienced Snowflake Data Architect to play a key role in shaping and evolving a modern enterprise data platform. This is an opportunity to define … architecture standards, drive best practice across data engineering teams, and build scalable solutions that support analytics, automation, and emerging AI capabilities. The successful candidate will be responsible for establishing data modelling standards, designing robust integration architectures, driving platform optimisation, and ensuring the delivery of high-quality ...

Type: Permanent Location: London, UK Mode of Working: Hybrid Working Hours: 40 hours per week (Full-time) Are you looking to build innovative data engineering solutions using PySpark, Microsoft Fabric, and Azure technologies? We have an exciting opportunity for you - Developer (PySpark + Fabric) Careers … impact that matters through challenging projects that demand innovation, collaboration, and thought leadership. Be part of a leading global financial markets infrastructure and data provider. Work within a team transforming and accelerating SDLC processes for critical application and data engineering platforms. Contribute to ambitious business transformation ...

Lead Data Engineer Hands-on technical leadership building data systems that actually work We're looking for a Lead Data Engineer to join an enterprise data engineering capability and play a critical role in designing, building, and improving real-world data … . This is not a line-management role . Instead, it's a senior, hands-on technical leadership position for someone with deep data engineering experience who leads through delivery, judgement, and technical credibility rather than hierarchy. You'll work in a complex environment spanning legacy platforms, modern ...

Data Engineer - Newcastle upon Tyne (Hybrid- 3 days onsite) - SQL, Airflow, Python, Power BI - Future Microsoft Fabric Transformation Project - Up to £55,000 Are you a Data Engineer looking for an opportunity where you can influence the direction of a growing data platform rather … than simply maintain existing processes? We're working with a technology-driven organisation investing heavily in its data capabilities and embarking on an exciting data transformation journey. This role offers the chance to work hands-on with Azure SQL, Airflow, Python and Power BI while playing ...

Media, Retail and CPG, and Public Services. Consolidated revenues as of $13+ billion. For more information on how we process your personal data, please refer to HCLTech’ s Candidate Data Privacy Notice. Investment Banking FIC experience (credit, rates, fx, or EM) is a prerequisite. FIC Data Role – CV Screening Checklist FIC/Front Office Exposure Experience with Fixed Income/Currencies/Sales/Trading data Worked closely with front-office stakeholders Data Architecture/Engineering Awareness Understanding of data pipelines, ETL, reporting layers Exposure to data ...

Description \n Market Data Engineering Team Lead Market Data | Zema | Python | Data Engineering | ETL/ELT \n A leading global commodities organisation is looking for a Market Data Engineering Team Lead to own and evolve its enterprise market data platform. … This is a strategic leadership role with a strong technical focus, responsible for shaping the market data architecture while leading a high-performing engineering team. \n You'll drive the design and delivery of scalable market data solutions, ensuring reliable ingestion, normalisation and distribution of data ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling … modern data mesh architecture. The role focuses on integrating legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies ...