1 to 25 of 34 ETL Jobs in the South West

and operational decision-making. Key Responsibilities Design, build and maintain scalable data pipelines (batch and/or streaming) within secure environments Develop and optimise ETL/ELT processes for high-volume, structured and semi-structured datasets Work with stakeholders to translate complex requirements into technical data solutions Ensure data platforms ...

and optimisation At least one data engineering programming language (e.g., Python) Data modelling (dimensional, star schema, analytics-optimised models) Building and maintaining production-grade ETL/ELT pipelines Orchestration and scheduling tools Version control (e.g., Git) CI/CD principles for data workloads Environment separation (Dev/Test/Prod ...

. Understanding of ML architectures, hyperparameter tuning, and performance optimisation. Experience with MLOps tools and CI/CD pipelines. Familiarity with data engineering concepts (ETL, data pipelines, SQL). Ability to analyse complex data and communicate insights effectively. Strong problem-solving skills and attention to detail. Excellent collaboration and stakeholder ...

pipelines, and modelling — not just one area Been hands-on with tools like Snowflake, dbt, and Azure (or similar cloud environments) Designed and maintained ETL/ELT pipelines, ideally using tools like Azure Data Factory Strong SQL skills, including complex querying and performance optimisation Experience working with CI/ ...

design, performance optimisation, and modelling best practices. • Hands-on experience designing and implementing Power BI datasets, dashboards, and paginated reports. • Proven track record delivering ETL pipelines, data warehousing, and modern visualisation platforms end-to-end. • Strong commercial acumen - the ability to translate data into decisions that drive growth, not just ...

Data Engineer Hands-on Python experience for cloud data engineering Experience working with GCP or strong transferable cloud experience like AWS Experience across ETL, data pipelines, and data warehousing Ability to lead pieces of work independently and handle stakeholder requests Comfortable working across both modern platforms and some legacy systems ...

data scientists and consultants on projects tackling real-world challenges. From a technical perspective, we're looking for someone comfortable with: Building and maintaining ETL pipelines and integrations Working with SQL and Python ( R is a bonus) Experience working with AWS or Azure Supporting analytical workflows and collaborating with data ...

mind. A passion for learning and experimenting with emerging technologies and sharing this knowledge with others. Experience with data engineering and pipelines, including ETL processes and working with both traditional relational databases and modern vector databases. An understanding of Site Reliability Engineering best practices and Platforms/DevOps best practices. ...

working closely with IT, operational teams, suppliers and project stakeholders. Key Responsibilities Design, develop and support system integrations between platforms Build and optimise scalable ETL/ELT pipelines Ensure structured, reliable and validated data availability Maintain documentation of data schemas, conventions and definitions Implement robust validation, logging and error-handling ...

processing Provide technical leadership and guidance to cross-functional teams, ensuring best practices in data architecture, security, and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large ...

standards, mentoring developers and ensuring that data solutions are scalable, reliable and aligned with enterprise data governance practices. Responsibilities Design, build and maintain scalable ETL/ELT data pipelines within Microsoft Fabric Lakehouse environments Develop and optimise data ingestion/transformation workflows Develop Python and PySpark processes for data transformation … Hands-on expertise with Microsoft Fabric, Lakehouse architecture and Data Pipelines Experience developing Python or PySpark solutions for large-scale data processing Understanding of ETL/ELT design patterns, data modelling and modern data platform architecture Experience developing Power BI datasets, semantic models and reports What's on Offer Salary ...

reliable, accurate and on time – and that issues get unblocked quickly and sensibly. The Role: Own and improve the monthly release run book, monitoring ETL/data pipelines and checks to keep delivery on track. Make light technical fixes (patching existing Python/SQL scripts, restarting/re-running jobs ...

reliable, accurate and on time – and that issues get unblocked quickly and sensibly. The Role: Own and improve the monthly release run book, monitoring ETL/data pipelines and checks to keep delivery on track. Make light technical fixes (patching existing Python/SQL scripts, restarting/re-running jobs ...

C++). • Develop clean, responsive front-end interfaces using frameworks like Vue.js or React • Collaborate with data scientists and engineers to integrate ML models, ETL pipelines, and cloud-based data storage solutions. • Implement secure, compliant and scalable data access layers, ensuring compliance with data privacy standards. • Contribute to system architecture … e.g. Docker compose, Swarm or Kubernetes) in a Linux-based environment. • Solid understanding of RESTful API design, microservices architectures, and asynchronous workflows. • Familiarity with ETL processes, data warehousing and distributed systems. • Ability to obtain UK Security Clearance (SC). We'd love it if you also have: • Experience with data ...

interfaces using frameworks like Vue.js or React, to present complex datasets and user workflows. • Collaborate with data scientists and engineers to integrate ML models, ETL pipelines, and cloud-based data storage solutions. • Optimise system performance and reliability for high-volume data operations across distributed environments. • Implement secure, compliant and scalable … e.g. Docker compose, Swarm or Kubernetes) in a Linux-based environment. • Solid understanding of RESTful API design, microservices architectures, and asynchronous workflows. • Familiarity with ETL processes, data warehousing and distributed systems. • Ability to obtain UK Security Clearance (SC). We’d love it if you also have: • Experience with data ...

migration projects. - Strong skills in Data Mapping, Data Migration, Data Transformation, Data Cleansing and Data Validation. - Experience in SQL, understanding datasets and creating ETL pipelines. - Understanding of MS Nav or Business Central. RESPONSIBILITIES - Lead data work stream for an organisation's system migration. - Define an end-to-end migration approach ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership Who Are We? Our client is a trusted and growing supplier to the National Security sector … systems with analytics and business intelligence platforms. Responsibilities include: Design, build, and maintain data pipelines, including ingestion, orchestration, and enrichment Develop data-streaming and ETL solutions (e.g. NiFi) Model databases and integrate data from diverse sources Ensure data quality, consistency, and security Monitor and optimise system performance Write clean, secure ...

Lead Infrastructure Architect, AWS, ETL, hybrid. Lead Infrastructure Architect required for a leading financial services company. The successful candidate will act as the lead architect for a Technology Operations Resiliency and Recovery Testing Programme. The role is responsible for reviewing, modernising, and embedding resiliency standards, as well as designing improvements ...

using a mixture of, .NET, C#, ASP.NET Core, ASP.NET, Blazor, Database Technologies (SQL Server, PL/SQL, T-SQL, SQL Server Management Studio - SSIS), ETL, Integration Platforms, Agile and Frontend Development (JavaScript/jQuery, React, Blazor) and Software Testing for this long-term and critical development programme. This … Software Engineer, .NET, C#, ASP.NET Core, ASP.NET, Blazor, Database Technologies, SQL Server, PL/SQL, T-SQL, SQL Server Management Studio, SSIS, Power BI, ETL, Integration Platforms, Agile, Frontend Development, JavaScript, jQuery, React, Blazor, Software Testing, AWS, Azure, Cloud, CI/CD, DevOps, Software Architecture, Design Patterns. The role comes ...

best practices and mentoring others. Key Responsibilities of the Senior Data Engineer: • Build and maintain scalable data infrastructure using cloud technologies • Develop and optimise ETL pipelines for efficient data processing • Support data science and analytics to optimise energy assets • Implement infrastructure as code (Terraform/AWS) • Ensure data quality, integrity … Data Engineer: • Strong experience building data pipelines, platforms, and storage systems • Advanced Python skills with a focus on production-quality code • Solid understanding of ETL processes and best practices • Experience with SQL/NoSQL databases and big data tools (e.g. Spark, Pulsar) • Hands-on experience with cloud platforms (AWS, Azure ...

while balancing your involvement across various initiatives to provide direction, technical leadership and oversight wherever it’s needed. Skills & Experience Strong consultancy background across ETL/ELT, data warehousing and big‐data solutions, with hands‐on delivery experience and proven leadership/mentoring in an onshore–offshore model. Proficiency with … ETL tools and cloud data services (AWS preferred — e.g., Glue; with exposure to Azure Data Factory), plus experience implementing CI/CD for data; knowledge of Informatica tools is beneficial. Experience working with major databases such as Postgres, Redshift, Oracle, SQL Server or Snowflake, along with strong SQL capability and ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

Designing, developing, testing, and monitoring data migration pipelines using InterSystems IRIS-based technologies. Configuring and deploying supporting infrastructure for data migration, including terminology services, ETL tooling, and cloud environments. Creating and maintaining data mappings and transformation logic aligned to target data models and business rules. Managing clinical data transformation, including … and release practices. What We're Looking For Strong experience in data migration, data engineering, and data modelling. Hands-on experience designing and building ETL pipelines for complex, coded clinical data sets. Proven development experience with InterSystems IRIS and HealthShare, including EMPI, provider data, integration engines, and associated components. Understanding ...

future government and enterprise needs Technical Environment You will work extensively with: Azure Data Platform Databricks (Lakehouse architecture) Cosmos DB Azure Data Factory Talend (ETL) Power BI & Qlik Large-scale data processing and analytics Master Data Management (MDM) concepts and tooling Required Experience Proven experience as a Senior/Lead … data transformation programmes Strong background designing and delivering modern cloud data platforms on Azure Hands-on experience with Databricks, Azure data services, and modern ETL pipelines Deep understanding of data architecture patterns , including lakehouse and federated models Experience working with imperfect and complex data sources Comfortable operating as the single ...

testing of the supporting infrastructure and environments required for data migration, including populating and making available a terminology server, agreeing firewall rules, and implementing ETL and analysis tooling based on the Cloud Azure platform. Creation and maintenance of data mappings and transformation logic for the data migration pipelines, ensuring alignment … patient data and ensure resilient batch orchestration and environment promotion practices Previous experience and skillset: Demonstrable knowledge Data Migration and Data modelling Experience of ETL Development (Clinical Coded Data/InterSystems IRIS-HealthShare) Design Required - experience of development in InterSystems HealthShare and HealthConnect with a strong understanding of EMPI ...