1 to 25 of 471 Remote/Hybrid Data Pipeline Jobs in the UK

Minimum 10+ years of experience as a Data Engineer or similar role. Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices. Excellent problem-solving and analytical skills and strong communication and teamwork skills. … Databricks ML and Azure ML to develop predictive models and drive business insights. Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage ...

Title: Data Engineer Location: UK Job Type: Full-time About Scrumconnect: Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services … Science, Architecture, etc.) to identify emerging and cross-community issues affecting your role and escalate as necessary. Describe technical, data, pipeline, and production issues to colleagues of different specialisms. Communicate within the team and across teams to monitor expectations around delivery of data ...

Title: Data Engineer Location: UK Job Type: Full-time About Scrumconnect: Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services … Science, Architecture, etc.) to identify emerging and cross-community issues affecting your role and escalate as necessary. Describe technical, data, pipeline, and production issues to colleagues of different specialisms. Communicate within the team and across teams to monitor expectations around delivery of data ...

member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Job Title: Data Engineer Job Location: Preston – Hybrid- 1 day a week onsite. We offer a range of hybrid and flexible working arrangements – please speak to your recruiter about … modelling practices Designing and implementing ETL pipelines using SSIS for data integration to ensure ETL processes performs optimally Troubleshooting; identifying and fixing pipeline bottlenecks and data issues Understanding of data governance, data quality, and best practices The Data Management ...

Description & Summary We are hiring Data & AI Consultants into our Technology Consulting practice. You will deliver client-facing engagements across analytics, BI, data engineering, data governance, data science, AI and workflow automation, in sectors including financial services, public sector, healthcare and life … teams within the Consulting, Advisory department, applying expertise in project management, stakeholder management, communication and process improvement to drive impactful results. As a Data & AI Consultant, you will work alongside clients across diverse sectors, using your technical, analytical and consulting skills to deliver practical data ...

platforms so they are reliable, secure, and easy to change. You will work across engineering and operations to automate delivery, improve data pipeline observability, and embed good governance so analytics and AI workloads can run at scale. You will be part of the Data Platforms … restricted environments. Delivering data applications in an automated and continuous fashion. Utilising tools like Airflow for orchestration and automating data pipeline deployments using DevOps tools and techniques (Docker, Containers, Terraform, Kubernetes) Building data pipelines using both cloud-native and open-source data ...

About the role... Are you an experienced Data Architect looking for your next challenge? Cooper Parry is on a rapid growth trajectory, and we’re seeking a Data Architect to lead the design and evolution of our enterprise data platform. This role will play … experience with Microsoft Fabric Deep understanding of: Modern data lakehouse architectures Dimensional and analytical data modelling Data pipeline orchestration Strong SQL skills and experience with distributed data processing Experience designing enterprise‐scale analytics platforms in Azure Ability to translate business requirements ...

stringent service level agreements (SLAs) and business requirements. What experience you need to be the successful Data Engineer: Proficiency in Palantir Foundry pipeline development: Extensive experience in building, maintaining, and optimising data pipelines and transformations within Palantir Foundry, leveraging tools such as Foundry Code Workbooks … integration. Strong coding skills in Python (Pandas) and PySpark: Essential experience in using Python (Pandas) and PySpark for data manipulation, transformation, and pipeline development within Palantir Foundry, ensuring high performance and scalability across various data flows. Experience in data modelling and ontology development ...

data engineer volunteers can support with: MapAction external projects that require a Data Engineer skillset (e.g.: data pipeline automation, hazard exposure platforms, multi-risk models, conflict incident reporting, etc...) Work with external partners such as UN agencies, International NGOs and Academic Institutions Conduct … automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Assist in the automation, provision and management of development environments, source-code, build-tools, pipelines and deployments Support ...

data engineer volunteers can support with: MapAction external projects that require a Data Engineer skillset (e.g.: data pipeline automation, hazard exposure platforms, multi-risk models, conflict incident reporting, etc ) Work with external partners such as UN agencies, International NGOs and Academic Institutions Conduct … automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Assist in the automation, provision and management of development environments, source-code, build-tools, pipelines and deployments Support ...

data engineer volunteers can support with: MapAction external projects that require a Data Engineer skillset (e.g.: data pipeline automation, hazard exposure platforms, multi-risk models, conflict incident reporting, etc ) Work with external partners such as UN agencies, International NGOs and Academic Institutions Conduct … automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Assist in the automation, provision and management of development environments, source-code, build-tools, pipelines and deployments Support ...

data engineer volunteers can support with: MapAction external projects that require a Data Engineer skillset (e.g.: data pipeline automation, hazard exposure platforms, multi-risk models, conflict incident reporting, etc ) Work with external partners such as UN agencies, International NGOs and Academic Institutions Conduct … automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Assist in the automation, provision and management of development environments, source-code, build-tools, pipelines and deployments Support ...

data engineer volunteers can support with: MapAction external projects that require a Data Engineer skillset (e.g.: data pipeline automation, hazard exposure platforms, multi-risk models, conflict incident reporting, etc ) Work with external partners such as UN agencies, International NGOs and Academic Institutions Conduct … automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Assist in the automation, provision and management of development environments, source-code, build-tools, pipelines and deployments Support ...

data engineer volunteers can support with: MapAction external projects that require a Data Engineer skillset (e.g.: data pipeline automation, hazard exposure platforms, multi-risk models, conflict incident reporting, etc...) Work with external partners such as UN agencies, International NGOs and Academic Institutions Conduct … automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Assist in the automation, provision and management of development environments, source-code, build-tools, pipelines and deployments Support ...

data engineer volunteers can support with: MapAction external projects that require a Data Engineer skillset (e.g.: data pipeline automation, hazard exposure platforms, multi-risk models, conflict incident reporting, etc ) Work with external partners such as UN agencies, International NGOs and Academic Institutions Conduct … automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Assist in the automation, provision and management of development environments, source-code, build-tools, pipelines and deployments Support ...

data engineer volunteers can support with: MapAction external projects that require a Data Engineer skillset (e.g.: data pipeline automation, hazard exposure platforms, multi-risk models, conflict incident reporting, etc ) Work with external partners such as UN agencies, International NGOs and Academic Institutions Conduct … automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Assist in the automation, provision and management of development environments, source-code, build-tools, pipelines and deployments Support ...

data engineer volunteers can support with: MapAction external projects that require a Data Engineer skillset (e.g.: data pipeline automation, hazard exposure platforms, multi-risk models, conflict incident reporting, etc ) Work with external partners such as UN agencies, International NGOs and Academic Institutions Conduct … automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Assist in the automation, provision and management of development environments, source-code, build-tools, pipelines and deployments Support ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You Will Be Working With The Data Platforms team is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety … projects and sectors. Data Platforms is the home of the Data Engineers, Platform Engineers, Solutions Architects and Business Analysts who are focused on driving our customers digital and data transformation journey using the modern cloud platforms. We specialise on using the latest frameworks, reference ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud‐native data platforms, with strong expertise in AWS and native data services. Familiarity with Infrastructure ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud‐native data platforms, with strong expertise in AWS and native data services. Familiarity with Infrastructure ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud native data platforms, with strong expertise in AWS and native data services. Familiarity with Infrastructure ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud native data platforms, with strong expertise in AWS and native data services. Familiarity with Infrastructure ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud native data platforms, with strong expertise in AWS and native data services. Familiarity with Infrastructure ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud native data platforms, with strong expertise in AWS and native data services. Familiarity with Infrastructure ...

Broster Buchanan are partnered global business within the food industry with a turnover of £8Bn+ who are looking for a Fabric Data Engineer to join as they set up an exciting new project team within the group. This would suit an experienced Azure Data Engineer with … offer. Responsibilities: Help set up and deliver the future direction of strategy and approach to the management, storage and usage of data Collaborate with their wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing ...