26 to 50 of 58 ETL Jobs in the South West

software engineering fundamentals: version control, testing, deployment CI/CD and lifecycle management troubleshooting and optimisation Experience working with databases , storage systems, and basic ETL workflows. Experience with AWS or another cloud environment (advantageous). Familiarity with ML frameworks or libraries (preferred but not essential). Experience Level ...

problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs Build and edit operational workflows, including front ends and decision-support toolsets, inclusive ...

time What we need from you... § Hands-on AI developer experience - we're tech-agnostic, so we work with a range of cloud, ETL/ELT, data warehouse, BI + AI tools (eg ChatGPT, OpenAI, Gemini, Claude, N8N, Zapier, Coda...) § Evidence that you're an AI-advocate and experiment with ...

time What we need from you... § Hands-on AI developer experience - we’re tech-agnostic, so we work with a range of cloud, ETL/ELT, data warehouse, BI + AI tools (eg ChatGPT, OpenAI, Gemini, Claude, N8N, Zapier, Coda...) § Evidence that you’re an AI-advocate and experiment with ...

promote standard integration patterns, and update conceptual data models as required. What the company look for Experience in Data solutions design including Message brokering, ETL, Data consumption use via applications, API Strong communication due to working with stakeholders across the business Reporting tools Understanding of data use in Reporting, Analytics ...

ability to manage cash efficiently and make data-driven decisions. Key Responsibilities End-to-End Data Pipeline Development Design, implement, and maintain scalable ETL/ELT pipelines for collecting, transforming, and delivering data across systems. Ensure data quality, reliability, and timeliness throughout the pipeline. Data Integration & Movement Develop secure and … solutions for data movement between internal and external systems. Work with both structured and unstructured data sources . Analytical Insights Analyze large datasets to extract actionable insights and present findings in a business-friendly format. Collaborate with data scientists and business stakeholders to identify opportunities for impactful analysis. Algorithm Support ...

enhance GIS applications using modern frameworks and mapping technologies. Build web-mapping tools, dashboards and geospatial interfaces for operational and strategic use. Create automated ETL workflows and spatial data integrations between key council systems. Design, optimise and maintain spatial databases with a focus on availability, performance and data quality. Spatial … Experience developing web-mapping applications (ArcGIS API, Leaflet, OpenLayers, Mapbox etc.) Solid understanding of geoprocessing, coordinate systems, topology and data automation. Experience with ETL pipelines (FME, ArcGIS ModelBuilder, Python GDAL/OGR, Geopandas). Able to break down complex requirements and deliver practical, well-engineered solutions. Confident communicator capable ...

governance, and risk policies. Skills & Experience - Essential Strong SQL Server or Snowflake skills. Advanced knowledge of low-code/no-code data engineering/ETL tools - ideally Markit EDM (v19.2+) or similar (e.g. Informatica). Proven delivery experience in Financial Services/Banking sector. Deep understanding of SDLC, systems integration … bank with long-term stability, world-class resources, and clear career progression routes. Enterprise Data Architect, EDM Developer, Data Engineering Lead, Data Architect, ETL Developer, Data Solutions Architect, Senior Data Engineer (Financial Services). Apply today for full details. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy ...

take ownership of migration tasks, proactively identify risks, and collaborate closely with technical and business stakeholders. Key Responsibilities Design, develop, and execute ETL processes to migrate data from legacy systems to target platforms. Write and optimise complex SQL queries (preferably MySQL) to support data extraction, transformation, and validation. Apply … Essential: Proven experience in public sector large-scale data migration projects. Strong SQL development skills within MySQL environments. Solid understanding of data transformations and ETL workflows. Knowledge and application of data quality dimensions in migration processes. Familiarity with case management systems and associated data structures. Strong problem-solving mindset, with ...

take ownership of migration tasks, proactively identify risks, and collaborate closely with technical and business stakeholders. Key Responsibilities Design, develop, and execute ETL processes to migrate data from legacy systems to target platforms. Write and optimise complex SQL queries (preferably MySQL) to support data extraction, transformation, and validation. Apply … Essential: Proven experience in public sector large-scale data migration projects. Strong SQL development skills within MySQL environments. Solid understanding of data transformations and ETL workflows. Knowledge and application of data quality dimensions in migration processes. Familiarity with case management systems and associated data structures. Strong problem-solving mindset, with ...

take ownership of migration tasks, proactively identify risks, and collaborate closely with technical and business stakeholders. Key Responsibilities Design, develop, and execute ETL processes to migrate data from legacy systems to target platforms. Write and optimise complex SQL queries (preferably MySQL) to support data extraction, transformation, and validation. Apply … Essential: Proven experience in public sector large-scale data migration projects. Strong SQL development skills within MySQL environments. Solid understanding of data transformations and ETL workflows. Knowledge and application of data quality dimensions in migration processes. Familiarity with case management systems and associated data structures. Strong problem-solving mindset, with ...

take ownership of migration tasks, proactively identify risks, and collaborate closely with technical and business stakeholders. Key Responsibilities Design, develop, and execute ETL processes to migrate data from legacy systems to target platforms. Write and optimise complex SQL queries (preferably MySQL) to support data extraction, transformation, and validation. Apply … Essential: Proven experience in public sector large-scale data migration projects. Strong SQL development skills within MySQL environments. Solid understanding of data transformations and ETL workflows. Knowledge and application of data quality dimensions in migration processes. Familiarity with case management systems and associated data structures. Strong problem-solving mindset, with ...

take ownership of migration tasks, proactively identify risks, and collaborate closely with technical and business stakeholders. Key Responsibilities Design, develop, and execute ETL processes to migrate data from legacy systems to target platforms. Write and optimise complex SQL queries (preferably MySQL) to support data extraction, transformation, and validation. Apply … Essential: Proven experience in public sector large-scale data migration projects. Strong SQL development skills within MySQL environments. Solid understanding of data transformations and ETL workflows. Knowledge and application of data quality dimensions in migration processes. Familiarity with case management systems and associated data structures. Strong problem-solving mindset, with ...

take ownership of migration tasks, proactively identify risks, and collaborate closely with technical and business stakeholders. Key Responsibilities Design, develop, and execute ETL processes to migrate data from legacy systems to target platforms. Write and optimise complex SQL queries (preferably MySQL) to support data extraction, transformation, and validation. Apply … Essential: Proven experience in public sector large-scale data migration projects. Strong SQL development skills within MySQL environments. Solid understanding of data transformations and ETL workflows. Knowledge and application of data quality dimensions in migration processes. Familiarity with case management systems and associated data structures. Strong problem-solving mindset, with ...

Looking For: Expert .NET Developer: Deep knowledge of .NET 8 and .NET 4.8 SQL Server Proficiency: Strong fundamentals in querying, table design, and ETL processing large datasets (performance tuning not required) ADO.Net Expertise: Familiarity with EntityFramework or other ORMs is a plus, but not essential Async & Multithreading Mastery: Experience ...

Looking For: Expert .NET Developer: Deep knowledge of .NET 8 and .NET 4.8 SQL Server Proficiency: Strong fundamentals in querying, table design, and ETL processing large datasets (performance tuning not required) ADO.Net Expertise: Familiarity with EntityFramework or other ORMs is a plus, but not essential Async & Multithreading Mastery: Experience ...

Looking For: Expert .NET Developer: Deep knowledge of .NET 8 and .NET 4.8 SQL Server Proficiency: Strong fundamentals in querying, table design, and ETL processing large datasets (performance tuning not required) ADO.Net Expertise: Familiarity with EntityFramework or other ORMs is a plus, but not essential Async & Multithreading Mastery: Experience ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership Who Are We? Our client is a trusted and growing supplier to the National Security sector … systems with analytics and business intelligence platforms. Responsibilities include: Design, build, and maintain data pipelines, including ingestion, orchestration, and enrichment Develop data-streaming and ETL solutions (e.g. NiFi) Model databases and integrate data from diverse sources Ensure data quality, consistency, and security Monitor and optimise system performance Write clean, secure ...

and platforms that enable analytics, reporting and operational data products across government. Work with data architects, analysts and stakeholders to translate requirements into robust ETL/streaming solutions, ensure data quality and compliance with standards, and drive automation and reuse to support evidence-based policy and service delivery. Your responsibilities … will include, but aren’t limited to: Design, build and operate ETL and streaming pipelines for large, varied datasets. Implement and enforce data modelling, lineage and quality standards. Optimise storage, processing and query performance on cloud/on-prem platforms. Integrate data sources via APIs, batch and real-time ingestion ...

and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this … guidance - Data engineering and aligning of data to business needs - Cloud technologies (Azure/AWS) - Understanding of Agile methodology - Data warehousing and Data Lakes - ETL/ELT - DevOps understanding - API integrations ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

Real Time Monitoring and Predictive AI Key responsibilities: Design and maintain scalable data pipelines. Structure, transform, and optimize data in Snowflake. Implement multi-source ETL/ELT flows (ERP, APIs, files). Leverage the AWS environment, including S3, IAM, and various data services. Prepare data for Data Science teams and … services including S3, IAM, Glue, and Lambda. Languages: Advanced SQL and Python for data manipulation, automation, and ML integration. Data Engineering: Proven experience in ETL/ELT pipeline design. AI/ML Integration: Ability to prepare data for model training and deploy AI models into production workflows (batch or real ...

Real Time Monitoring and Predictive AI Key responsibilities: Design and maintain scalable data pipelines. Structure, transform, and optimize data in Snowflake. Implement multi-source ETL/ELT flows (ERP, APIs, files). Leverage the AWS environment, including S3, IAM, and various data services. Prepare data for Data Science teams and … services including S3, IAM, Glue, and Lambda. Languages: Advanced SQL and Python for data manipulation, automation, and ML integration. Data Engineering: Proven experience in ETL/ELT pipeline design. AI/ML Integration: Ability to prepare data for model training and deploy AI models into production workflows (batch or real ...

Real Time Monitoring and Predictive AI Key responsibilities: Design and maintain scalable data pipelines. Structure, transform, and optimize data in Snowflake. Implement multi-source ETL/ELT flows (ERP, APIs, files). Leverage the AWS environment, including S3, IAM, and various data services. Prepare data for Data Science teams and … services including S3, IAM, Glue, and Lambda. Languages: Advanced SQL and Python for data manipulation, automation, and ML integration. Data Engineering: Proven experience in ETL/ELT pipeline design. AI/ML Integration: Ability to prepare data for model training and deploy AI models into production workflows (batch or real ...

pipelines and orchestration workflows Design database schemas and data models Integrate and enrich data from multiple sources, ensuring consistency and quality Design and implement ETL/ELT processes (e.g., using Apache NiFi) Produce reusable, maintainable code with a test-driven approach Maintain and enhance existing data platforms and services Investigate … into actionable tasks Monitor and optimise system performance for reliability and efficiency Required Skills Apache Kafka Apache NiFi SQL and NoSQL databases (e.g., MongoDB) ETL/ELT development with Groovy, Python, or Java About the Employer With over 60 years of experience supporting government and defence programmes, this employer delivers ...