476 to 500 of 589 ETL Jobs in the UK excluding London

IR35 We are seeking Data Engineers to support delivery within a large-scale data exploitation programme. The role will focus on developing and maintaining ETL pipelines within an established Talend framework, alongside working with Oracle RDS databases and CI/CD pipelines. Key Responsibilities Design, develop, and maintain ETL solutions … retrospectives, and reviews Collaborate with cross-functional teams to ensure successful delivery of programme objectives Essential Skills & Experience Strong hands-on experience developing ETL solutions using Talend Proven experience working with Oracle databases , ideally Oracle RDS Strong SQL development and data modelling expertise Experience working within structured Software Development Life ...

will primarily work with AWS data sources, including DynamoDB and CloudWatch, and deliver curated datasets to Power BI and potentially Microsoft Fabric. Key Responsibilities Extract data from DynamoDB, CloudWatch and other AWS data sources Design and implement data transformation, cleansing and aggregation processes Develop efficient and reusable data pipelines using … Work with stakeholders to understand reporting requirements and translate them into appropriate data models and measures Key Requirements Strong experience in data engineering and ETL development Hands-on experience with AWS, particularly DynamoDB and CloudWatch Experience working with Power BI Experience building and maintaining data pipelines Understanding of data quality ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

will primarily work with AWS data sources, including DynamoDB and CloudWatch, and deliver curated datasets to Power BI and potentially Microsoft Fabric. Key Responsibilities Extract data from DynamoDB, CloudWatch and other AWS data sources Design and implement data transformation, cleansing and aggregation processes Develop efficient and reusable data pipelines using … Work with stakeholders to understand reporting requirements and translate them into appropriate data models and measures Key Requirements Strong experience in data engineering and ETL development Hands-on experience with AWS, particularly DynamoDB and CloudWatch Experience working with Power BI Experience building and maintaining data pipelines Understanding of data quality ...

full time on site when required Must hold active Enhanced DV Clearance (West) Circa £700 p/d inside IR35 Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing scalability, performance, security and maintainability. Partner with stakeholders … PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. Solid grounding in data architecture, modelling and modern data platform design. Cloud experience, preferably AWS, and familiarity with CI/CD and ...

overall vulnerability attack surface of the Bank. Leverage Python, SQL, and other languages/platforms to automate data ingestion, transformation, enrichment, and quality validation (ETL) Develop and maintain visualizations and reports in Power BI or MS-Reporting Services (SSRS) MS-Integration Services (MSIS) that support operational teams, cyber leadership, and … Experience with SQL Server Integration Services (SSIS), including DevOps integration, scripting tasks, packaging, deployment, and conditional workflows Hands-on experience with data ingestion and ETL pipelines (batch and near real time) Python development experience used for automation, data processing, and integration Experience with SSRS, including subscriptions, report management, Tablix, matrix ...

build a modern Microsoft data platform and support the development of reusable data services. Key responsibilities include: Designing and implementing end-to-end ETL/ELT pipelines from requirements gathering through to production deployment. Developing and maintaining scalable data models, transformations, and data products using modern Azure technologies. Optimising data … understanding and relationships across data domains. YOUR SKILLS AND EXPERIENCE You will bring strong capability in: Microsoft Azure data engineering technologies. Designing and developing ETL/ELT data pipelines. SQL development and data modelling. CI/CD processes and deployment best practices. THE BENEFITS You will receive a salary ...

build a modern Microsoft data platform and support the development of reusable data services. Key responsibilities include: Designing and implementing end-to-end ETL/ELT pipelines from requirements gathering through to production deployment. Developing and maintaining scalable data models, transformations, and data products using modern Azure technologies. Optimising data … understanding and relationships across data domains. YOUR SKILLS AND EXPERIENCE You will bring strong capability in: Microsoft Azure data engineering technologies. Designing and developing ETL/ELT data pipelines. SQL development and data modelling. CI/CD processes and deployment best practices. THE BENEFITS You will receive a salary ...

helping to build a modern Microsoft data platform and support the development of reusable data services.Key responsibilities include: Designing and implementing end-to-end ETL/ELT pipelines from requirements gathering through to production deployment. Developing and maintaining scalable data models, transformations, and data products using modern Azure technologies. Optimising … understanding and relationships across data domains. YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Microsoft Azure data engineering technologies. Designing and developing ETL/ELT data pipelines. SQL development and data modelling. CI/CD processes and deployment best practices. THE BENEFITS: You will receive a salary ...

helping to build a modern Microsoft data platform and support the development of reusable data services.Key responsibilities include: Designing and implementing end-to-end ETL/ELT pipelines from requirements gathering through to production deployment. Developing and maintaining scalable data models, transformations, and data products using modern Azure technologies. Optimising … understanding and relationships across data domains. YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Microsoft Azure data engineering technologies. Designing and developing ETL/ELT data pipelines. SQL development and data modelling. CI/CD processes and deployment best practices. THE BENEFITS: You will receive a salary ...

helping to build a modern Microsoft data platform and support the development of reusable data services.Key responsibilities include: Designing and implementing end-to-end ETL/ELT pipelines from requirements gathering through to production deployment. Developing and maintaining scalable data models, transformations, and data products using modern Azure technologies. Optimising … understanding and relationships across data domains. YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Microsoft Azure data engineering technologies. Designing and developing ETL/ELT data pipelines. SQL development and data modelling. CI/CD processes and deployment best practices. THE BENEFITS: You will receive a salary ...

large-scale enterprise data environment, supporting: Data pipeline and analytics development SQL and Python engineering Bug fixing and technical enhancements Data modelling and ETL/ELT Performance and infrastructure optimisation Data quality and governance AI-assisted coding, testing and debugging Process and architecture improvement The team is particularly interested … Strong SQL Data Engineering or Analytics Engineering experience Databricks or comparable platforms such as Snowflake, Hadoop or SQL Server Python and ideally PySpark ETL/ELT and data modelling Strong problem-solving and critical-thinking skills Good understanding of data architecture and infrastructure Ability to work independently Experience using ...

Finance, you'll turn business requirements into reliable data solutions and help shape how critical financial information flows through the organisation. Responsibilities: Build scalable ETL and ELT pipelines within AWS Develop and optimise data models in Amazon Redshift Create and manage workflows using Apache Airflow Integrate NetSuite and other Finance … experience Hands-on experience with AWS data services Amazon Redshift or comparable cloud data-warehouse experience Apache Airflow or similar orchestration experience Strong ETL/ELT, data-modelling and production pipeline knowledge The confidence to work directly with Finance and technical stakeholders Experience with NetSuite, ERP integration or financial data ...

secure and reliable data platforms. Key Responsibilities Design, build and maintain high-throughput data pipelines using Apache Spark and cloud-native technologies. Develop scalable ETL/ELT workflows for structured and unstructured datasets. Build and optimise data-processing solutions within AWS environments. Develop performant solutions using Java or Scala alongside … Scala. Strong AWS experience, ideally including technologies such as S3, EMR, Glue and IAM. Advanced SQL development skills. Strong experience designing and developing ETL/ELT pipelines. Experience working with large-scale and distributed data-processing environments. Databricks and/or Snowflake. #J-18808-Ljbffr ...

advanced analytics, cloud transformation, and multi-million-pound client engagements. Key Responsibilities: Design and build scalable big data pipelines using Quantexa Develop and optimise ETL/ELT processes for high-volume, complex datasets. Deliver entity resolution and network analytics solutions using Quantexa. Integrate data from multiple structured and unstructured sources … scale data modelling. Strong cloud experience across GCP, AWS, or Azure . Experience with Databricks, Snowflake, or Hadoop ecosystems . Knowledge of data ingestion, ETL/ELT frameworks, and batch/real-time processing. Applications are now open. ...

Architect - Manager Design and implement end-to-end data solutions from ingestion and processing through to analytics and visualisation. Design scalable data pipelines and ETL processes across modern and legacy platforms. Develop conceptual, logical and physical data models, including dimensional, relational and data vault. Own end-to-end data architecture … architecture methods, tools and technologies. Experience you'll need as a AI & Data Architect - Manager 5+ years experience in data engineering and architecture , including ETL, data pipelines and data storage. Experience leading data engineering projects or workstreams. Strong experience with cloud platforms and cloud data services . Experience with modern ...

building reliable, scalable data and platform capabilities. You'll be working across: Databricks, Python, SQL and Spark High-volume data ingestion and transformation Production ETL/ELT pipelines APIs, SFTP/FTPS and automated data retrieval CI/CD, automated testing and deployment Platform reliability, monitoring and troubleshooting Azure infrastructure … operate effectively. What we're looking forDatabricks is the big one. Alongside that, we're looking for strong Python, SQL/Spark and ETL/ELT experience, good knowledge of databases and data warehousing, including dimensional/Kimball principles, plus an understanding of platform, DevOps and systems engineering. They also ...

team and support in moving data safely and accurately between systems as we consolidate and modernise our platform landscape. This isn't a generic ETL role. You'll be working on live migrations between operational systems (CRM, billing, and platform migrations) where the real risk isn't moving the data … values, automation-driven overwrites) during discovery, and design for it rather than letting it surface as a defect in testing Build and maintain the ETL/ELT pipelines that move data between systems, including transformation logic for edge cases (e.g. multiple active records per customer, hardcoded vs. derived fields ...

design event‐driven and asynchronous integration patterns. Collaborate with stakeholders to ensure seamless data flow across interconnected systems. Design, develop, and maintain background ETL processes for data ingestion, transformation, and loading. Build and optimize data pipelines that support analytics, reporting, and operational workflows. Ensure data integrity, reliability, and traceability across … similar message brokers for asynchronous processing. Practical experience with cloud services, preferably Microsoft Azure and/or GCP. Demonstrated expertise in designing and implementing ETL pipelines and background processes. Strong understanding of system architecture principles – microservices, event‐driven design, and API gateways. Soft Skills Strong team player with excellent collaboration ...

Optimove is seeking a data-driven ProdOps and Support Engineer to monitor production, handle integrations, and troubleshoot ETL/data workflows in a fast-paced SaaS environment. Based in the Dundee office with hybrid work (two days on-site), you will collaborate with customers and internal teams, learn new technologies ...

ETL Systems Ltd in Rickmansworth is seeking a Senior FPGA Engineer to lead the design and development of advanced FPGA solutions for satellite communications. This role involves hands-on engineering, mentoring junior staff, and collaborating with cross-functional teams to ensure high-performance results. The ideal candidate will possess strong ...

ETL Systems Ltd in Rickmansworth is seeking a Senior FPGA Engineer to lead the design and development of advanced FPGA solutions for satellite communications. This role involves hands-on engineering, mentoring junior staff, and collaborating with cross-functional teams to ensure high-performance results. The ideal candidate will possess strong ...

associated non-financial risk. Working knowledge of mathematics including statistics, time series analysis and numerical algorithms. Experience with programming in Python and SQL for extract transform load (ETL) operations and data analysis (including performance optimization). Experience in using languages such as R, Java, C++ is beneficial. Experience in developing ...