1 to 25 of 117 Data Pipeline Jobs in the South East

Data Sharing Lead Portsmouth | Personal Contract (dependent on skills and qualifications) Full-time Joint-contribution pension from 6% (12% total) – Enhanced maternity & family leave – Life assurance – HolidayPlus – Virtual GP & Employee Assistance Programme plus retail and leisure discounts & many more. REQ5603 The Data Sharing Lead is responsible … developing and overseeing our data sharing activities relating to requests received from external stakeholders but also those data sets we wish to publish proactively. The role covers everything from process, data and elements of technical oversight as well as engaging and collaborating with business ...

stringent service level agreements (SLAs) and business requirements. What experience you need to be the successful Data Engineer: Proficiency in Palantir Foundry pipeline development: Extensive experience in building, maintaining, and optimising data pipelines and transformations within Palantir Foundry, leveraging tools such as Foundry Code Workbooks … integration. Strong coding skills in Python (Pandas) and PySpark: Essential experience in using Python (Pandas) and PySpark for data manipulation, transformation, and pipeline development within Palantir Foundry, ensuring high performance and scalability across various data flows. Experience in data modelling and ontology development ...

core part of HDI's data transformation agenda, enabling improved decision-making, automation, and analytics maturity. Key accountabilities Data Pipeline Engineering & Integration Design, develop, and maintain end to end ingestion pipelines into appropriate data technologies such as Snowflake from internal systems (policy admin … sizing, storage costs, and compute efficiency. Implement workload separation, time travel optimisation, clustering, and pruning strategies. Documentation & Knowledge Sharing Produce comprehensive documentation for pipelines, data models, data flows, and architecture components. Provide technical guidance to junior team members and evangelise engineering best practices. Skills & experience Technical ...

Description We’re looking for a talented and passionate Core Data Engineer to join our Group Technology team in Milton Keynes. You’ll play a key role in delivering Connells Group Reporting Data, covering architecture, data modelling, design, and pipelines. You’ll work closely … Maintain the Common Data Model to ensure organisation-wide consistency. Apply Agile principles for iterative and collaborative development. Ensure data pipeline quality, reliability and performance. Develop, test and implement monitoring to ensure effective operation. Support cross-functional data projects, providing expertise as required. ...

Location: London, Watford or Bristol (Hybrid working options available) The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires strong expertise in Azure cloud services, Databricks, data engineering … DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain and enterprise data products. Overseeing Data Analysts ...

Full time hours. We are happy to discuss flexible working! Top 3 skills needed for this role: Expert in building scalable, high-quality data pipelines Hands-on experience with cloud data platforms The ability to optimise, automate, and deliver reliable data solutions independently What … this role is all about: Join us as a Data Engineer and become a driving force behind high-impact, high-performance data solutions. You’ll take ownership of designing and supercharging data pipelines that keep our business moving, bringing fresh thinking and technical flair ...

financial and tax planning, offering home finance and annuities propositions, and providing collective fund solutions to third party customers. Job Purpose The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires … strong expertise in Azure cloud services, Databricks, data engineering, and DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain ...

ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries … lineage practices using Microsoft Purview . Build and maintain CI/CD pipelines to automate deployment of Fabric assets, notebooks, and data pipeline A bit about YOU! As much as we just love working with great, fun people, there are some obvious required Skills and Experience ...

Data Engineering Lead Milton Keynes Hybrid Permanent Full time - 35 hours £75,000 - £85,000 Join the ICAEW At ICAEW, you'll be part of an organisation that's shaping the future of business, finance and the accountancy profession on a global scale. Our bold 2030 Strategy puts … looking for a role with purpose, influence and opportunity, ICAEW is a place where your future can truly take shape. Role Profile The Data Engineering Lead is responsible for building and leading the data engineering capability at ICAEW, ensuring that data is collected, transformed ...

Data Quality Analyst - London (Hybrid) - Azure, Databricks, SQL, Power BI - Up to £55,000 This is an opportunity to join a global organisation that takes data quality seriously and sees it as essential to how the business operates and reports. The organisation continues to invest … data platforms and governance, with a clear focus on reliability, consistency and long-term improvement. You'll be part of a Global Data Team where quality matters, collaboration is encouraged, and people are trusted to take ownership. If you enjoy getting into the detail of data ...

analysts in developing predictive models and advanced analytics solutions.* Architect, maintain, and scale robust data infrastructures, including ETL/ELT pipelines, data lakes, and warehouses.* Establish and maintain a comprehensive data governance framework meeting regulatory and security standards.* Partner with cross-functional teams … functions. * Hands-on experience with machine learning, predictive modelling, statistical analysis, and integration strategy/implementation. * Experience implementing and managing ETL/ELT pipelines, data lakes, and data warehouses. * Proven track record of successfully leading organization-wide transformation of data strategy & supporting governance. ...

Trading Data Engineer Abingdon, Oxfordshire (Hybrid - 1-2 days per week in office) Up to £55,000 DOE + Bonus + Excellent Benefits Applicants must be within a 1 hour 30 minute commute of Abingdon. Due to significant company growth, a newly created and exciting opportunity has arisen … Delta Lake tables and SQL databases, applying strong data modelling and optimisation strategies. Develop monitoring dashboards and alerting to ensure transparency around pipeline health and data freshness. Implement data validation and reconciliation checks across multiple market data sources. Optimise pipeline ...

Data Analyst - London (Hybrid) - Azure, Databricks, SQL, Power BI - Up to £55,000 This is a great opportunity to join a globally recognised organisation that has been delivering landmark, high-value projects for decades and continues to invest heavily in technology, data and long-term capability. … first culture built around approachable leadership, inclusion and respect. The Global IT function plays a critical role in modernising how the organisation uses data, and data quality is seen as a core enabler. You'll join a collaborative Global Data Team where quality, governance ...

Data Engineer Full Time/Permanent £55,000 - £60,000 plus up to 20% bonus, private medical and other extensive benefits Hybrid - 1-2 days a week in the North Oxfordshire head office The Company: My client is an industry leading and award-winning financial services organisation … possess: Proven experience with databricks Proficiency in programming languages such as Python, Spark, SQL. Strong experience with SQL databases. Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. Knowledge ...

Company: Live Nation Department: International Data and Audience Location: Farringdon, London Reports to: Director, BI & Analytics, International Working Hours: Full time Job Type: Permanent Role Description We’re looking for an Analytics Engineer to play a critical role in enabling data access, platform operations, and analytical … data modelling across Live Nation's international data ecosystem. You will work with rich datasets and manage data workflows in large-scale data environments, ensuring reliable and performant data access in Databricks, BigQuery, Tableau and Data Studio. ...

Data Quality Analyst A global organisation undergoing significant digital and data transformation is looking for a Data Quality Analyst to join its growing data function. This role plays a critical part in ensuring data is accurate, consistent, and trusted across … enterprise reporting and analytics. You'll work closely with business stakeholders, data engineers, and product teams to identify data quality risks early, diagnose issues at source, and embed strong governance and quality practices across data platforms. Key Responsibilities Partner with business stakeholders to identify ...

seeking a highly detail-oriented and experienced VP-level Technical Systems Analyst to support the analysis and implementation of a new enterprise data platform with a focus on Risk and ESG reporting . The successful candidate will bring 5 + years of experience in business and systems analysis … within banking or financial services , with strong capability across technical requirements definition, data architecture, and database-driven solution design . This role will play a critical part in supporting regulatory and ESG-driven data initiatives in a complex, multi-stakeholder environment. Key Responsibilities Contribute ...

will be responsible for: Designing, implementing, and maintaining scalable data pipelines and ETL processes Developing and optimising databases and data storage solutions for structured and unstructured data Collaborating with data scientists and analysts to deliver reliable, high-quality data … building and maintaining ETL pipelines and data workflows Familiarity with cloud data platforms (AWS, Azure, GCP) and data pipeline orchestration tools (Airflow, Prefect, etc.) Understanding of data modelling, schema design, and performance optimisation Experience with agile development methodologies, including Scrum ...

company seeking a Senior Associate - Marketing Technology to support and evolve its enterprise marketing ecosystem. This position operates at the crossroads of marketing, data, and technology, with a strong emphasis on marketing tech data, AI & machine learning, and data workflows. You will play … role in enhancing platform performance, strengthening integrations, and enabling scalable, data-driven marketing operations. This opportunity is ideal for someone who thrives in complex environments and enjoys improving how systems, data, and teams connect. Key Responsibilities Optimise and maintain core marketing technology platforms to ensure strong ...

Data Engineer (BigQuery/Dataflow) Salary: Up to £85,000 + Bonus + Benefits Location: London - Hybrid (3 days per week onsite) Working Hours: 40 hours per week - Full time Job Type: Permanent A globally established organisation is seeking an experienced GCP Data Engineer to help … build modern, scalable cloud data platforms within a complex enterprise environment. This GCP Data Engineer role will focus on designing data architectures on Google Cloud Platform, building high-performance pipelines, and enabling reliable, secure and governed data solutions that support business growth ...

Fabric Data Engineer Up to £70,000 I am seeking an experienced Data Engineer to support the design, development and optimisation of modern cloud-based data platform within a global manufacturing organisation specialising in the production of high-quality equipment. Sitting within a global … data and analytics function, this role is central to managing the data platform and delivering high-quality reporting capabilities that support operational, financial and strategic decision-making across multiple international regions. This role is ideal for someone with strong hands-on experience across modern data ...

Title: Data Engineer – Azure Data Platform Location : London (Hybrid) Our client is hiring a Data Engineer to help build and scale enterprise-grade data solutions on the Microsoft Azure platform. This role involves delivering reliable, high-performance data pipelines that … deliver data-driven solutions Drive automation and optimization of data workflows Requirements: Experience in data engineering and pipeline development Strong expertise in Azure (Synapse, Data Lake) Proficiency in Python, PySpark, and T-SQL Knowledge of data warehousing ...

Overview: We are working with a leading UK-based wealth and investment management firm seeking a skilled Data Engineer to support the build and evolution of their modern data platform. This role will focus on developing scalable data pipelines and contributing to a cloud … native lakehouse architecture. Key Responsibilities: Design, build, and maintain robust data pipelines using Azure-based services Develop and optimize data workflows within Databricks Implement and manage data ingestion processes, including real-time streaming with Kafka Structure and maintain data across bronze, silver ...

successful multinational technology business is looking for a Data Reliability Engineer to join its growing data team in Central London. This role is hybrid – you’ll be able to work from home 2 days per week.This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. You’ll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. You’ll take ownership of data reliability end-to-end, designing ...

Title : Senior Data Engineer Target Start Date: 20th June 2026 Contract Type: Permanent, Part Time, Full Time, Job Share option available Salary Range: £54,000 - £81,000 Location: Eastleigh and Reigate Closing Date for applications: 18th April Senior Data Engineer: We are currently recruiting … Senior Data Engineer to join our innovative Data team. You will join a collaborative team of data and AI engineers, scientists, developers, analysts, and architects. Together, you will design and build modern machine learning and AI services that support analytics and improve products across ...