9 of 9 DemandTrendContract Data Pipeline Jobs in the Midlands

Technical Data Engineer Location: Northampton or London/Hybrid 2-3 days on-site 6 Months + We are seeking a highly skilled and communicative Technical Data Engineer to join our team. The ideal candidate will have hands-on experience with modern data platforms and tools including Databricks, DBT, and Snowflake. You will play … a key role in designing, developing, and optimizing data pipelines and analytics solutions that drive business insights and decision-making. Key Responsibilities: Design, build, and maintain scalable data pipelines using Databricks and DBT. Develop and optimize data models and transformations in Snowflake. Collaborate with cross-functional teams to understand data requirements and … deliver robust solutions. Ensure data quality, integrity, and governance across platforms. Troubleshoot and resolve data-related issues in a timely manner. Document processes, workflows, and technical specifications clearly and effectively. Required Skills & Experience: Proven hands-on experience with: Databricks (Spark, Delta Lake, notebooks) DBT (data modeling, transformations, testing) Snowflake (SQL, performance tuning, data More ❯

Data Engineer (Minerva MMTAR Functional Core Build) Max Pay: £537 SC is required, Duration: 6 months initially Location: Telford: If local to Telford, requirement will be 2 days per week on site. If not local, expectation will be to attend once/twice a month. Via Umbrella Key Responsibilities: Design, development, and deployment of data integration … and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices … for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS More ❯

Viya 4. Support the migration of legacy SAS platforms to cloud-native SAS Viya 4 environments, including namespace separation and Kubernetes orchestration. Implement and manage configuration objects, service data, and translation objects within SAS environments. Collaborate with data engineers and DevOps teams to integrate SAS with Oracle, GitLab CI/CD pipelines, and other enterprise platforms. … Monitor and optimise platform performance, ensuring high availability and compliance with security standards. Provide technical support and troubleshooting for SAS users and developers. Automate environment provisioning and data transfers using approved EA integration patterns. Participate in community knowledge sharing and contribute to best practice documentation. Essential Skills and Experience: SAS Enterprise Guide (EG) - workflow orchestration and user support. … Viya 4 - platform configuration, migration, and containerisation (Kubernetes). SAS Visual Analytics (VA) and SAS Visual Investigator (VI) - dashboard and investigation tool support. Oracle - integration and data pipeline support. Configuration Management - experience managing service objects, deployment artefacts, and environment baselines. Testing Lifecycle Knowledge - including test strategy design, environment comparison utilities, and automated testing integration. Desirable Attributes: Experience More ❯

days onsite per week End Date: 28/11/2025 Role Overview: We are seeking a highly skilled Hadoop Engineer to support and enhance our Operational Data Platform (ODP) deployed in an on-premises environment. The ideal candidate will have extensive experience in the Hadoop ecosystem, strong programming skills, and a solid understanding of infrastructure-level data analytics. This role focuses on building and maintaining scalable, secure, and high-performance data pipelines within enterprise-grade on-prem systems. Key Responsibilities: Design, develop, and maintain data pipelines using Hadoop technologies in an on-premises infrastructure. Build and optimise workflows using Apache Airflow and Spark Streaming for real-time data processing. … Develop robust data engineering solutions using Python for automation and transformation. Collaborate with infrastructure and analytics teams to support operational data use cases. Monitor and troubleshoot data jobs, ensuring reliability and performance across the platform. Ensure compliance with enterprise security and data governance standards. Required Skills & Experience: Minimum 5 years of experience More ❯

modern serverless technologies, and can collaborate effectively with diverse teams. Key Responsibilities: Develop and deploy serverless applications using Google Cloud Functions (Python or Node.js). Build and optimise data pipelines with Google Cloud Dataflow . Manage and query relational databases using Cloud SQL (PostgreSQL/MySQL). Implement file operations and workflow triggers via Cloud Storage . Configure More ❯

modern serverless technologies, and can collaborate effectively with diverse teams. Key Responsibilities: Develop and deploy serverless applications using Google Cloud Functions (Python or Node.js). Build and optimise data pipelines with Google Cloud Dataflow . Manage and query relational databases using Cloud SQL (PostgreSQL/MySQL). Implement file operations and workflow triggers via Cloud Storage . Configure More ❯

a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills & Experience: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in More ❯

days per month on site in Telford and is inside IR35 so will require working via an FCSA accredited umbrella company. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in SAS More ❯

MuleSoft/Apigee (APG) request/response formats in integration workflows. Design and deploy Google Cloud Functions with Google Cloud Storage triggers for event-driven automation. Work with Data Locker Studio for data management and transfer workflows. Create and maintain Excel-based reports with automated or semi-automated data sources. Use Azure DevOps Git … API Keys, and signed URL authentication methods. Experience with MuleSoft or Apigee middleware integration. Hands-on expertise with GCP Cloud Functions and Google Cloud Storage triggers. Familiarity with Data Locker Studio. Proficiency in Excel-based reporting automation. Knowledge of Azure DevOps Git for source control. Strong communication and documentation skills. Google Cloud certification (e.g., Professional Cloud Developer or … Cloud Engineer). Experience working in agile/Scrum environments. Exposure to data pipelines and event-driven architecture. More ❯