1 to 25 of 119 Data Pipeline Jobs in the South East

data engineer volunteers can support with: MapAction external projects that require a Data Engineer skillset (e.g.: data pipeline automation, hazard exposure platforms, multi-risk models, conflict incident reporting, etc...) Work with external partners such as UN agencies, International NGOs and Academic Institutions Conduct … automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Assist in the automation, provision and management of development environments, source-code, build-tools, pipelines and deployments Support ...

data engineer volunteers can support with: MapAction external projects that require a Data Engineer skillset (e.g.: data pipeline automation, hazard exposure platforms, multi-risk models, conflict incident reporting, etc ) Work with external partners such as UN agencies, International NGOs and Academic Institutions Conduct … automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Assist in the automation, provision and management of development environments, source-code, build-tools, pipelines and deployments Support ...

Broster Buchanan are partnered global business within the food industry with a turnover of £8Bn+ who are looking for a Fabric Data Engineer to join as they set up an exciting new project team within the group. This would suit an experienced Azure Data Engineer with … offer. Responsibilities: Help set up and deliver the future direction of strategy and approach to the management, storage and usage of data Collaborate with their wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing ...

seeking an experienced Data Architect to join our Group Technology team on a 6-month contract. You will help realise the value of the immense Connells Group data landscape for the benefit of customers, colleagues and the overall business. You will use your expertise to define … evolve and communicate the existing Estate Agency enterprise data architecture, to democratise safe access to consolidated and unified data, modelled to help engineering teams develop single customer and property views. The data architecture will also support system migration and integration, to establish effective master ...

Data Platform Manager UK/Remote Circa £65k - £75k per annum + bonus & benefits Are you ready to take ownership of a data platform and shape how data drives business decisions? This is a rare opportunity to step into a leadership role where … combine hands-on data engineering with strategic product management, all while building and mentoring a high-performing team. You'll play a pivotal role in evolving a modern data platform (Microsoft Fabric/Azure Synapse), ensuring it delivers real business value, scalability, and innovation. ...

part of this position. Main Responsibilities Conduct and automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Ensure find-ability. availability, scalability, reproducibility, accessibility, interoperability and reusability … Jupyter Notebooks Experience working with geospatial data (raster and vector) Databases (NoSQL, SQL, Graph Dbs, Principles of RDBs) Data pipeline design skills Knowledge of cloud platforms like GCP, AWS or Azure Experience and understanding of CI/CD pipelines Collaborative code management using Git & GitHub ...

Azure Data Engineer Up to £65,000 - Fully Remote We are seeking a Data Engineer to join a well-established, international organisation operating within a sustainability-focused industry. Our client is a global leader in chemical cleaning and environmental solutions, offering a fully integrated service across … Azure Data Factory, Azure Data Lake and Azure Synapse Analytics Solid understanding of ETL processes, data integration and pipeline development Advanced SQL skills as well as Python/PySpark experience for data processing Exposure to Power BI or other reporting tools ...

exciting technology-led organisation in London is looking for a Lead Data Engineer to join their growing platform team as they continue to build out their data and analytics capability. Based in: London Hybrid working: 1-2 days a week in the office Permanent role Start … delivery of a modern cloud data platform supporting analytics, AI and client-facing data products Owning data pipeline architecture across ingestion, transformation and data product layers Setting and maintaining data engineering standards, patterns and best practices across squads Mentoring ...

Lead Data Engineer | Azure | SQL | Python | Team Leadership We're partnering with a market-leading, highly regulated organisation to recruit a newly created Lead Data Engineer position. This is a fantastic opportunity for a hands-on data engineering leader to take ownership … growing data function, leading a team while remaining actively involved in technical delivery. Acting as the bridge between senior leadership and the data team, you'll be responsible for the data engineering roadmap, platform development, engineering standards, and delivery capability. This is a genuine ...

Method Resourcing are delighted to partner with an innovative SaaS business based in London looking to hire a Senior Data Engineer to join their talented team as they continue to grow. The Senior Data Engineer will be a key member of the Data & Analytics … growth. Experience integrating data from diverse sources, maintaining accuracy and consistency throughout the ETL process. Skilled at troubleshooting complex data pipeline and infrastructure issues. Collaborative team player, able to align data solutions with business objectives across cross-functional teams. Familiar with CI/ ...

About the role As a HR Data Delivery Lead will be responsible for end-to-end delivery of data products, pipelines, and reporting solutions across multiple teams. This role will be accountable for connecting data from the new Oracle HCM Cloud … Problem-solving mindset with attention to detail. Responsibilities Delivery Leadership Lead end-to-end delivery of data initiatives (ETL/ELT pipelines, data models, dashboards, reporting products) Own delivery plans, milestones, RAID logs, and dependencies across multiple squads Ensure on-time, in-scope delivery of data ...

belonging for all our colleagues is central to our journey as a global business. Who You Are/Your Next Challenge The Data Engineer plays a critical role in enabling Finance & Treasury to deliver accurate, timely, and insight‐driven reporting by building scalable data solutions, maintaining … core data infrastructure, and supporting the modernisation of Finance systems. This role is responsible for engineering robust data pipelines, managing datasets across the Microsoft Fabric platform, and ensuring Finance has reliable, consistent, and governed data to support transformation, automation, and improved operational efficiency. ...

Lead Data Engineer London Bridge (2 days office-based, 3 days remote working) Up to £80,000 We’re looking for a Lead Data Engineer to play a pivotal role in shaping how Hyde uses data to make better decisions, improve services for residents … work in a complex or enterprise environment. You bring deep technical expertise in modern data platforms, cloud infrastructure and data pipeline development. You understand data architecture, integration, security and governance, and can apply this knowledge in a practical way. You can translate complex ...

Data Engineer - Microsoft Fabric - London (Hybrid) - Up to £65,000 This is a fantastic opportunity to join a well-established international organisation operating across multiple countries and delivering over 1 million services annually. The business is well into a major data transformation programme, with Microsoft Fabric … , supporting integration, modelling, and optimisation Close collaboration with business stakeholders to understand data usage, identify gaps and deliver effective solutions Pipeline optimisation, data quality improvements, and automation initiatives Benefits Salary up to £65,000 Hybrid working - just 1 day per week ...

business expands, we are looking for ambitious, talented people to join us. We are looking for a technically proficient Senior Data Engineer to join our growing Data team. Your primary focus will be on ensuring data quality, stability, and reliability from the moment data arrives in its rawest form to when it is used in decision-making dashboards and customer-facing reports. You will optimise the transformation pipeline from start to finish, guaranteeing that datasets are robust, tested, secure, and business-ready. Our data platform is built using Databricks, with ...

business expands, we are looking for ambitious, talented people to join us. We are looking for a technically proficient Senior Data Engineer to join our growing Data team. Your primary focus will be on ensuring data quality, stability, and reliability from the moment data arrives in its rawest form to when it is used in decision-making dashboards and customer-facing reports. You will optimise the transformation pipeline from start to finish, guaranteeing that datasets are robust, tested, secure, and business-ready. Our data platform is built using Databricks, with ...

Lead Data Engineer Hands-on technical leadership building data systems that actually work We're looking for a Lead Data Engineer to join an enterprise data engineering capability and play a critical role in designing, building, and improving real-world data … . This is not a line-management role . Instead, it's a senior, hands-on technical leadership position for someone with deep data engineering experience who leads through delivery, judgement, and technical credibility rather than hierarchy. You'll work in a complex environment spanning legacy platforms, modern ...

Lead Backend Software Engineer – Data Services Federated Data Services | Distributed Systems | Apache Spark | DataFusion | Python | Kubernetes Location: London (2 days per week onsite) Rate: £700–£800 per day (Outside IR35) Duration: Initial 6-month contract with likely extension Overview We're looking for an experienced Lead … Backend Software Engineer to join a high-profile programme building secure, cloud-native data services that will support data-driven research and innovation at national scale.This is a founding engineering role, offering the opportunity to shape the architecture, engineering standards, and core data services ...

Data Engineering Lead – Up to £46,000 + Bonus + Exceptional Benefits (Civil Service Pension) + Hybrid (Stratford, London) We're looking for a Data Engineering Lead who thrives at the intersection of data, technology, and business strategy. This is an exciting opportunity … lead the development of enterprise-wide data solutions that provide clear visibility of performance, value delivery, and strategic outcomes.Working with senior stakeholders across technology, finance, product, and portfolio teams, you'll transform complex and fragmented datasets into meaningful insights that enable better decision-making across the organisation.If ...

Data Engineer - Microsoft Fabric - London (Hybrid) - Up to £65,000 This is an exciting opportunity to join a well-established, international organisation operating across 15 countries and delivering over 1 million services each year. The business is well underway on a major data transformation, with Microsoft … modelling, optimisation Business stakeholders to understand how CRM data is used, where gaps exist, how data solutions can improve outcomes Pipeline optimisation, data quality improvements, automation initiatives Benefits Salary up to £65,000 Hybrid working - just 1 day per week in the London ...

Data Engineer | Microsoft Fabric | Dynamics 365 | £65,000 | Hybrid (Brentford, 1 Day per Week) I'm working with a forward-thinking organisation that is making significant investment in its data, analytics, AI, and automation capabilities. As part of a major digital transformation programme, they are looking … hire an experienced Data Engineer to play a key role in the delivery of a large-scale Microsoft Fabric migration and Dynamics 365 implementation . This is an excellent opportunity to join a business that views data as a strategic asset and is committed to building ...

employers actively hiring across these roles. Job Description: UK-Based (On-Site, Hybrid or Remote) About the Role We're looking for experienced Data Engineers at all levels—from Data Engineer through to Senior, Lead, Principal, Analytics Engineer and Data Platform Engineer positions … Technical Expertise: Strong SQL—comfortable with complex transformations, performance tuning and warehouse-specific dialect Strong Python skills (or Scala/Java where relevant) for pipeline development and tooling Hands-on experience with dbt or equivalent transformation tooling Orchestration experience (Airflow, Dagster, Prefect or equivalent) Production experience with at least ...

Business Analytics Lead Drive Data-Driven Manufacturing Excellence We are looking for a Business Analytics Lead to play a pivotal role in transforming operational data into actionable business insight across our Paper Division. Leading a small but highly capable data engineering team, you will … build and develop the OT-to-business data infrastructure that underpins operational analytics, advanced analytics, and strategic decision-making. By connecting manufacturing systems with business platforms, you'll help unlock performance improvements, optimise asset utilisation, and support critical 80/20 business priorities. This is an exciting opportunity ...

Data Engineer – Build the Future with Data & AI Join a high-performing team building cutting-edge data, machine learning and AI solutions on a modern cloud platform. You'll design scalable data pipelines, develop innovative data products, and work with … latest technologies in a collaborative, agile environment. Main Responsibilities as Data Engineer: Build and support data products within our modern data platform Design and deliver solutions with engineers, scientists and product teams Develop and optimise data pipelines across the analytics platform Integrate ...

Data Engineer Remote Working/London circ £60,000 - £70,000 Experienced Data Engineer required for this remote working/hybrid position based in West London (near Feltham, Hanworth, Hounslow etc). Ideally the successful candidate will be able to work on site once or twice … client would also consider candidates looking for a remote working role as long as they can be onsite once a month. The Data Engineer will join a small team and play a key role in developing and managing data integration projects as our client transitions data ...