6 of 6 Contract Data Pipeline Jobs in the South West

Data Engineer Hybrid working (2-3 days per week in Gloucester) £450-£550 per day (inside IR35) We are seeking a skilled, Security Cleared, Data Engineer to join our team. The ideal candidate will have a strong background in data architecture and engineering, specifically within the AWS ecosystem. You will be responsible for designing … and implementing data pipelines that support large-scale data processing and analytics. Key Responsibilities: - Develop, construct, test, and maintain data architectures and data processing systems. - Collaborate with data scientists and analysts to understand data requirements and ensure data availability. - Design and optimise data models … to support business intelligence and reporting needs. - Monitor and troubleshoot data systems to ensure high availability and performance. - Implement best practises for data management, security, and compliance. Required Skills: - Active Security Clearance - Proficiency in AWS services related to data processing and storage, such as Amazon S3, Redshift, and EMR. - Strong experience with big data More ❯

will play a key role in ensuring that critical business services have the capacity and resilience to meet regulatory and operational demands. You will focus on developing robust data pipelines and solutions that support capacity monitoring, reporting, and forecasting across complex IT environments. Role Overview: Develop ETL processes to extract and normalise capacity data from infrastructure … sources. Automate data ingestion and processing into SQL Server databases. Normalising raw infrastructure and monitoring data into structured formats suitable for graphing and trending Collaborate with DBAs and technical teams to ensure transparency and supportability. Build data flows that support capacity reporting and trending, using modern technologies. Skills & Experience Required: 3+ years' experience in … ETL/data processing roles. Proficiency with ETL tools, SQL Server, RESTful APIs. Experience working with infrastructure data (e.g., Nutanix, VMware, Dell EMC desirable). Scripting experience in Python, SQL (T-SQL), Excel VBA. Knowledge of data optimisation, large datasets, JSON/XML formats. Experience of setting up SQL DTSS and Control/M More ❯

ETL Application Developer Capacity Management & Data Engineering 6 month contract - Inside IR35 London - Moorgate tube Day rate to be confirmed Our leading bank client is seeking an experienced ETL Application Developer to join their technology resilience and capacity management team. This is a contract opportunity based in London. As an ETL Application Developer, you will play a key … role in ensuring that critical business services have the capacity and resilience to meet regulatory and operational demands. You will focus on developing robust data pipelines and solutions that support capacity monitoring, reporting, and forecasting across complex IT environments. Key Responsibilities: Design, develop, and maintain ETL processes to collect, transform, and load capacity and infrastructure data from multiple sources. Collaborate with cross-functional teams and DBAs to ensure seamless data integration and delivery. Analyse and normalise raw infrastructure and monitoring data for reporting, trending, and predictive analytics. Develop and implement automated methods to forecast future capacity requirements using historical data. Support compliance with regulatory standards (including DORA) by providing accurate More ❯

systems engineering to help shape and deliver the future of our client's systems landscape. This role is instrumental in defining strategy, managing capabilities, and enhancing tool and data integrations within a complex engineering environment. Key Responsibilities: Define and oversee the strategic direction of the software and systems architecture. Provide leadership in capability management and future capability planning. … Develop and evolve technical solutions aligned with long-term engineering goals. Design and enhance metric dashboards using Power BI and integrate with relevant databases. Ensure seamless interaction and data flow between tools such as IBM DOORS and Cameo. Apply a holistic infrastructure viewpoint to assess and evolve the tool-chain. Use Python and Back End development skills to … automate, integrate, and optimise systems and work-flows. Contribute to IT and system architecture frameworks that support engineering and data management. Collaborate with internal teams to understand current tool usage and data pipelines, and drive improvements. Skills & Experience: Demonstrable experience as a Software Architect within systems engineering or complex engineering environments. Deep understanding of IT infrastructure More ❯

systems engineering to help shape and deliver the future of our client's systems landscape. This role is instrumental in defining strategy, managing capabilities, and enhancing tool and data integrations within a complex engineering environment. Key Responsibilities: Define and oversee the strategic direction of the software and systems architecture. Provide leadership in capability management and future capability planning. … Develop and evolve technical solutions aligned with long-term engineering goals. Design and enhance metric dashboards using Power BI and integrate with relevant databases. Ensure seamless interaction and data flow between tools such as IBM DOORS and Cameo. Apply a holistic infrastructure viewpoint to assess and evolve the tool-chain. Use Python and back-end development skills to … automate, integrate, and optimise systems and work-flows. Contribute to IT and system architecture frameworks that support engineering and data management. Collaborate with internal teams to understand current tool usage and data pipelines, and drive improvements. Skills & Experience: Demonstrable experience as a Software Architect within systems engineering or complex engineering environments. Deep understanding of IT infrastructure More ❯

develop simulation tools to support product integration and create software that enhances manufacturing processes by streamlining and supporting operations. Key Responsibilities: Design and develop real-time test and data capture software on Linux using C++, with a focus on performance and reliability. Build and maintain scalable, multi-threaded applications that interface with high-speed SFPDP cards across multi … channel data pipelines. Define and implement deterministic data sequencing and synchronization logic to support accurate capture and replay functionality. Collaborate with hardware teams to ensure seamless integration and precise timing alignment between software and capture systems. Lead and contribute to system-level integration, verification, and validation, ensuring robust performance across all components. Perform in-depth performance … specifications, and test procedures to support knowledge transfer and formal testing activities. What do you need?: You'll support the development and integration of real-time test and data capture systems in a Linux environment, using C++ (C# is a plus), high-speed SFPDP cards, and multi-threaded pipelinescontributing to software design, verification, and system validation, alongside the More ❯