26 to 50 of 62 Data Pipeline Jobs in the Midlands

you're inspired to think big and bring your ambition to work every day, which is why, at British Airways the sky is never the limit. The role: Data Scientist/Senior Data Scientist Join British Airways as a Data Scientist in our cutting-edge Operations Decision Support (ODS) product team. This full-stack … role sits at the heart of our transformation, combining data science, machine learning, and optimisation to build industrialised decision-support software. If you're passionate about solving real-world problems through intelligent, data-driven solutions and thrive in a collaborative, agile environment-this is your opportunity to make a real impact. What you'll do: Design … with software engineering teams, product & change teams to turn their models into industrialized products that are used by the airline every day to make better decisions. Build robust data pipelines, automate data cleaning, and deliver scalable, production-grade Python code using best practices such as typing, testing, and modular design. Integrate models into orchestration frameworks (e.g. More ❯

Contribute to security engineering projects, transitions, and transformations. Work closely with security operations and associated security incident response systems Stay informed about emerging threats and security best practices. Data Ingestion and Enrichment: Configure Elasticsearch pipelines for data ingestion from various sources, primarily from Kafka Enhance data enrichment by integrating threat intelligence feeds and contextual … towards achieving these. Skills Required for the Role Security and Compliance with Elastic Security: Set up access controls, authentication, and encryption using Elastic Security features. Ensure compliance with data protection regulations. Detection Rule Development: Ability to create, test, and optimise detection rules to identify suspicious activities and potential threats based on the MITRE ATT&CK Framework Performance Tuning … with Elasticsearch and Logstash: Fine-tune query performance using Elasticsearch indices and mappings. Monitor Logstash pipelines and optimize resource utilization. Kibana Visualization and Monitoring: Leverage Kibana for data visualization, dashboards, and real-time monitoring. Create custom visualizations to track data quality metrics and system performance. Elastic integration Integration of the SIEM with critical systems to provide More ❯

Data Engineer (Minerva MMTAR Functional Core Build) Max Pay: £537 SC is required, Duration: 6 months initially Location: Telford: If local to Telford, requirement will be 2 days per week on site. If not local, expectation will be to attend once/twice a month. Via Umbrella Key Responsibilities: Design, development, and deployment of data integration … and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices … for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS More ❯

actively including and empowering our people. Above all, we are purpose-driven, committed to positively impacting our people, the planet, and our global communities. We are investing in data, technology and analytics as a strategic priority. The team brings together a number of capabilities that sit within different parts of Croud, into one unit that will drive cutting … edge development in a number of critical areas for the business. The role sits within the Data Engineering team and reports to the Head of Data Engineering. The team's remit is to drive innovation & revenue through the development & delivery of revenue-generating/client-facing data engineering solutions used across the agency. The … Data Engineer will be part of a growing team that delivers highly impactful data solutions across our extensive client portfolio and also the agency's own product offerings. We seek individuals who are proactive, self-starters with a meticulous eye for detail, and who can communicate clearly and effectively across our diverse internal and external stakeholders. More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Viya 4. Support the migration of legacy SAS platforms to cloud-native SAS Viya 4 environments, including namespace separation and Kubernetes orchestration. Implement and manage configuration objects, service data, and translation objects within SAS environments. Collaborate with data engineers and DevOps teams to integrate SAS with Oracle, GitLab CI/CD pipelines, and other enterprise platforms. … Monitor and optimise platform performance, ensuring high availability and compliance with security standards. Provide technical support and troubleshooting for SAS users and developers. Automate environment provisioning and data transfers using approved EA integration patterns. Participate in community knowledge sharing and contribute to best practice documentation. Essential Skills and Experience: SAS Enterprise Guide (EG) - workflow orchestration and user support. … Viya 4 - platform configuration, migration, and containerisation (Kubernetes). SAS Visual Analytics (VA) and SAS Visual Investigator (VI) - dashboard and investigation tool support. Oracle - integration and data pipeline support. Configuration Management - experience managing service objects, deployment artefacts, and environment baselines. Testing Lifecycle Knowledge - including test strategy design, environment comparison utilities, and automated testing integration. Desirable Attributes: Experience More ❯

Viya 4. Support the migration of legacy SAS platforms to cloud-native SAS Viya 4 environments, including namespace separation and Kubernetes orchestration. Implement and manage configuration objects, service data, and translation objects within SAS environments. Collaborate with data engineers and DevOps teams to integrate SAS with Oracle, GitLab CI/CD pipelines, and other enterprise platforms. … Monitor and optimise platform performance, ensuring high availability and compliance with security standards. Provide technical support and troubleshooting for SAS users and developers. Automate environment provisioning and data transfers using approved EA integration patterns. Participate in community knowledge sharing and contribute to best practice documentation. Essential Skills and Experience: SAS Enterprise Guide (EG) - workflow orchestration and user support. … Viya 4 - platform configuration, migration, and containerisation (Kubernetes). SAS Visual Analytics (VA) and SAS Visual Investigator (VI) - dashboard and investigation tool support. Oracle - integration and data pipeline support. Configuration Management - experience managing service objects, deployment artefacts, and environment baselines. Testing Lifecycle Knowledge - including test strategy design, environment comparison utilities, and automated testing integration. Desirable Attributes: Experience More ❯

Viya 4. Support the migration of legacy SAS platforms to cloud-native SAS Viya 4 environments, including namespace separation and Kubernetes orchestration. Implement and manage configuration objects, service data, and translation objects within SAS environments. Collaborate with data engineers and DevOps teams to integrate SAS with Oracle, GitLab CI/CD pipelines, and other enterprise platforms. … Monitor and optimise platform performance, ensuring high availability and compliance with security standards. Provide technical support and troubleshooting for SAS users and developers. Automate environment provisioning and data transfers using approved EA integration patterns. Participate in community knowledge sharing and contribute to best practice documentation. Essential Skills and Experience: SAS Enterprise Guide (EG) – workflow orchestration and user support. … Viya 4 – platform configuration, migration, and containerisation (Kubernetes). SAS Visual Analytics (VA) and SAS Visual Investigator (VI) – dashboard and investigation tool support. Oracle – integration and data pipeline support. Configuration Management – experience managing service objects, deployment artefacts, and environment baselines. Testing Lifecycle Knowledge – including test strategy design, environment comparison utilities, and automated testing integration. Desirable Attributes: Experience More ❯

Viya 4. Support the migration of legacy SAS platforms to cloud-native SAS Viya 4 environments, including namespace separation and Kubernetes orchestration. Implement and manage configuration objects, service data, and translation objects within SAS environments. Collaborate with data engineers and DevOps teams to integrate SAS with Oracle, GitLab CI/CD pipelines, and other enterprise platforms. … Monitor and optimise platform performance, ensuring high availability and compliance with security standards. Provide technical support and troubleshooting for SAS users and developers. Automate environment provisioning and data transfers using approved EA integration patterns. Participate in community knowledge sharing and contribute to best practice documentation. Essential Skills and Experience: SAS Enterprise Guide (EG) – workflow orchestration and user support. … Viya 4 – platform configuration, migration, and containerisation (Kubernetes). SAS Visual Analytics (VA) and SAS Visual Investigator (VI) – dashboard and investigation tool support. Oracle – integration and data pipeline support. Configuration Management – experience managing service objects, deployment artefacts, and environment baselines. Testing Lifecycle Knowledge – including test strategy design, environment comparison utilities, and automated testing integration. Desirable Attributes: Experience More ❯

Viya 4. Support the migration of legacy SAS platforms to cloud-native SAS Viya 4 environments, including namespace separation and Kubernetes orchestration. Implement and manage configuration objects, service data, and translation objects within SAS environments. Collaborate with data engineers and DevOps teams to integrate SAS with Oracle, GitLab CI/CD pipelines, and other enterprise platforms. … Monitor and optimise platform performance, ensuring high availability and compliance with security standards. Provide technical support and troubleshooting for SAS users and developers. Automate environment provisioning and data transfers using approved EA integration patterns. Participate in community knowledge sharing and contribute to best practice documentation. Essential Skills and Experience: SAS Enterprise Guide (EG) - workflow orchestration and user support. … Viya 4 - platform configuration, migration, and containerisation (Kubernetes). SAS Visual Analytics (VA) and SAS Visual Investigator (VI) - dashboard and investigation tool support. Oracle - integration and data pipeline support. Configuration Management - experience managing service objects, deployment artefacts, and environment baselines. Testing Lifecycle Knowledge - including test strategy design, environment comparison utilities, and automated testing integration. Desirable Attributes: Experience More ❯

Viya 4. Support the migration of legacy SAS platforms to cloud-native SAS Viya 4 environments, including namespace separation and Kubernetes orchestration. Implement and manage configuration objects, service data, and translation objects within SAS environments. Collaborate with data engineers and DevOps teams to integrate SAS with Oracle, GitLab CI/CD pipelines, and other enterprise platforms. … Monitor and optimise platform performance, ensuring high availability and compliance with security standards. Provide technical support and troubleshooting for SAS users and developers. Automate environment provisioning and data transfers using approved EA integration patterns. Participate in community knowledge sharing and contribute to best practice documentation. Essential Skills and Experience: SAS Enterprise Guide (EG) - workflow orchestration and user support. … Viya 4 - platform configuration, migration, and containerisation (Kubernetes). SAS Visual Analytics (VA) and SAS Visual Investigator (VI) - dashboard and investigation tool support. Oracle - integration and data pipeline support. Configuration Management - experience managing service objects, deployment artefacts, and environment baselines. Testing Lifecycle Knowledge - including test strategy design, environment comparison utilities, and automated testing integration. Desirable Attributes: Experience More ❯

ranks 189 on the Fortune 500. Further information about Lear is available at or on Position overview: As an Application Solution Architect, you will design and implement scalable, data-driven solutions using Palantir Foundry. You'll work closely with business stakeholders, data engineers, and developers to translate business needs into robust technical architectures that leverage Foundry … technical constraints. Design scalable and efficient data models and ontologies within Foundry. Define and oversee the development of data pipelines and workflows using Foundry's Pipeline Builder and Code Repositories. Lead integration of external systems and APIs into Foundry for seamless data flow. Work with cross-functional teams to gather requirements, define architecture … TECHNICAL/PERSONNEL SKILLS : Experience designing scalable data models and ontologies. Understanding of semantic data modelling and entity relationships. Familiarity with Foundry's Ontology SDK, Pipeline Builder, and Code Workspaces. Experience integrating external systems and APIs into Foundry. Knowledge of data transformation, cleansing, and enrichment techniques. Awareness of data privacy, access More ❯

Viya 4. - Support the migration of Legacy SAS platforms to cloud native SAS Viya 4 environments, including namespace separation and Kubernetes orchestration. - Implement and manage configuration objects, service data, and translation objects within SAS environments. - Collaborate with data engineers and DevOps teams to integrate SAS with Oracle, GitLab CI/CD pipelines, and other enterprise platforms. … Monitor and optimise platform performance, ensuring high availability and compliance with security standards. - Provide technical support and troubleshooting for SAS users and developers. - Automate environment provisioning and data transfers using approved EA integration patterns. - Participate in community knowledge sharing and contribute to best practice documentation. Key Experience: - SAS Enterprise Guide (EG) - workflow orchestration and user support. - SAS Data … Viya 4 - platform configuration, migration, and containerisation (Kubernetes). - SAS Visual Analytics (VA) and SAS Visual Investigator (VI) - dashboard and investigation tool support. - Oracle - integration and data pipeline support. - Configuration Management - experience managing service objects, deployment artefacts, and environment baselines. - Testing Lifecycle Knowledge - including test strategy design, environment comparison utilities, and automated testing integration. - Experience with cloud More ❯

you the chance to help make the UK a safer place through innovation, working in partnership with government and law enforcement organisations on some of the most challenging data and technology problems out there. We strongly encourage candidates of all different backgrounds and identities to apply. We are committed to building an inclusive, safe and supportive environm ent … Here are some things we've worked on recently that might give you a better sense of the kind of work you could be leading on: Building a data analytics tool using a Neo4J graph database. A DevOps platform to support 3000 users. Processing digital forensic data to enable search and insight generation. A search and … reporting system backed by an ElasticSearch cluster. A custom workflow tool using Camunda, with a React/TS front-end An AI assurance capability Orchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. Accountabilities: Understands the technical aspects of the project and the wider customer business model. More ❯

Senior Data Engineer UST are currently recruiting for a Senior Data Engineer with proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. About the role The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong … coding skills in Python PySpark and SQL. You will have expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required. Job Description: Work as part of a self-organised Ab Initio … any inconsistencies with the standards (written or best practices) You will be able to estimate the delivery timescales and justify these estimates You will be aware of the Jenkins pipeline principles Knowledge of Agile practices Experience that would be advantageous: You will be aware of AWS interactions and file storage You will have a core understanding of Lambda programming More ❯

We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Title: Data Visualisation Engineer Clearance required: Must hold an Active SC Clearance Location: Telford/Hybrid 6 months contract Job description: Purpose: This project seeks to streamline that experience by delivering a … a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data More ❯

apply End Date: September 5, 2025 (30+ days left to apply) job requisition id R Role Summary: This role demands skills and perseverance to modernise tech stacks and data pipelines of well established StarMine Quant models in Python to provided specifications, and to build brand-new quantitative/predictive models with help of machine learning algorithms working in … collaboration with our data science and Research teams. Build data pipelines to break down complicated calculations into stages. Main Responsibilities/Accountabilities: We engage with product owners, architects and other specialists to craft and build sophisticated, world-class analytics models to address our customer needs. Building and maintaining efficient, reusable, reliable and secure enterprise software, adhering … like Terraform. Proficient with Git. Proficient with CI/CD automation using GitLab or similar. Azure Fabric experience Vision to use machine learning and AI algorithms to the data Education/Certifications: A relevant degree or equivalent experience is desirable, but the right approach to work is just as important. AWS/Azure certification a nice to have. More ❯

a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualisation using Denodo. Proficiency in SAS More ❯

a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualisation using Denodo. Proficiency in SAS More ❯

a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualisation using Denodo. Proficiency in SAS More ❯

a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills & Experience: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in More ❯

a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills & Experience: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in More ❯

a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills & Experience: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in More ❯

as specialist practices Publicis Media Exchange (PMX), Performics, Publicis Sport & Entertainment, Publicis Media Content and NextTECHnow. Together they combine deep expertise in media investment, strategy, insights and analytics, data and technology, commerce, performance marketing and content. Publicis Media is part of Publicis Groupe and is present in more than 100 countries with over 23,500 employees worldwide. Our … encourages applications from underrepresented groups. We are committed to equality of opportunity and welcome applications from individuals, regardless of their background. Job Description We are looking for a Data Engineer to join our Product Development team. You will work closely with the Scrum Master to deliver our technical builds, approach, and prioritisation. Are you a developer, data or software engineer with experience working with advertising/media dataset, and a history of creating data pipelines and structures that can be used in front end applications or creating automations that make data work harder? If so this is the role for you! Qualifications To be successful in this role you will need More ❯

DOE) + Benefits SQL Database Developer needed for a permanent career opportunity based in Derby . A chance to join an established + growing software business who develop data solutions for large Retail brands. Must be willing to work in the Derby office on a full-time basis. Start ASAP during Summer 2025. Key experience + responsibilities: Designing … SQL Server database solutions that power core business applications. Strong hands-on SQL Server database development skills including: complex stored procedures T-SQL, indexing, relational/dimensional modelling, data dashboards. Building/optimising data pipelines and integrations across cloud platforms. Any cloud platforms experience would be helpful including: such as Snowflake, Databricks, BigQuery, Azure SQL. Working … closely with key stakeholders including data architects, analysts, testers and managers. Working across the full SQL development life-cycle including: design, development, documentation and testing. Advantageous Skills: Power BI, NoSQL, Azure Synapse, data visualisation tools, Data Lakes, streaming technologies, MDM, Git, DevOps pipelines. Benefits include: to £50k Base (DOE) + 25 days holiday (plus More ❯