226 to 250 of 265 ETL Jobs in the UK excluding London

and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this … guidance - Data engineering and aligning of data to business needs - Cloud technologies (Azure/AWS) - Understanding of Agile methodology - Data warehousing and Data Lakes - ETL/ELT - DevOps understanding - API integrations ...

and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this … guidance - Data engineering and aligning of data to business needs - Cloud technologies (Azure/AWS) - Understanding of Agile methodology - Data warehousing and Data Lakes - ETL/ELT - DevOps understanding - API integrations ...

and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this … guidance - Data engineering and aligning of data to business needs - Cloud technologies (Azure/AWS) - Understanding of Agile methodology - Data warehousing and Data Lakes - ETL/ELT - DevOps understanding - API integrations ...

and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this … guidance - Data engineering and aligning of data to business needs - Cloud technologies (Azure/AWS) - Understanding of Agile methodology - Data warehousing and Data Lakes - ETL/ELT - DevOps understanding - API integrations ...

pipelines for a new Data Lake Work with Python, SQL, Spark, AWS, Docker, CI/CD Orchestrate workflows using Airflow, Prefect, or Dagster Support ETL, API integrations, and high-quality data validation Translate business needs into technical solutions with full ownership What You Need STEM degree (Computer Science, Engineering, Maths … etc.) 2+ years in data engineering/analytics/software Strong Python + SQL 2+ years ETL, APIs, CI/CD, Docker, AWS Ideally but not essential experience with Airflow/Prefect/Dagster Background in Financial Services, FinTech, Insurance, PE/VC, or Banking Package & Benefits High performance bonus ...

data infrastructure. The Role You'll be responsible for the day-to-day management of SQL Server and Azure-based data systems, supporting ETL processes, and driving improvements across data platforms. This is a great opportunity for someone who enjoys solving problems, improving systems, and working collaboratively across teams. … Responsibilities Maintain and manage SQL Server and Azure data environments Ensure data system security, patching, and performance tuning Support ETL services and data operations Analyse and remediate legacy data structures Contribute to transformation and change initiatives Identify opportunities to improve data processes and suggest solutions Produce high-quality technical documentation ...

Innovation Support technical delivery when needed, including designing scalable Azure/Microsoft data solutions. Drive innovation through cloud migrations, data lake implementations, and robust ETL/ELT pipeline development. Skills & Experience You'll thrive in this role if you have: Leadership Proven ability to build strong relationships and foster … Strong background in Data Engineering or Data Warehouse development using Microsoft Fabric, Azure Databricks, Synapse, Data Factory, and/or SQL Server. Expertise in ETL/ELT design with SQL and Python. Solid understanding of data lakes, medallion lakehouse architecture, and large-scale dataset management. Strong BI and data warehousing ...

with some management experience Experience handling large datasets, complex data pipelines, big data processing frameworks and technologies Experience with data modelling, Databricks, data integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing concepts and dimensional modelling experience Any data engineering skills … solutions for delivering high-quality care. The ideal candidate will lead the design and execution of cloud-based based scalable data storage solutions, oversee ETL pipeline development and optimisation, establish and manage data schemas and dictionaries, develop data integration solutions, and lead data cleansing, validation, and enrichment processes. Duties include ...

Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality frameworks, and reconciliation checks Strong error handling, monitoring, and retry ...

expect to Use Power BI to create interactive reports, dashboards, and visualizations. Design and develop robust, efficient, and scalable data models. Create and maintain ETL pipelines to extract data from various sources, transform it, and load it into our data models. Mentor and support more junior members of the squad. ...

expect to Use Power BI to create interactive reports, dashboards, and visualizations. Design and develop robust, efficient, and scalable data models. Create and maintain ETL pipelines to extract data from various sources, transform it, and load it into our data models. Mentor and support more junior members of the squad. ...

Data Engineer (Strong SQL, ETL, Python) - SC Cleared OR Eligible Stevenage (Hybrid) 2-3 days onsite Up to £80,000 High-impact programme - Revolutionary platform I am looking for a Security-Cleared Data Engineer to take the reins on a range of highly ambitious Data Migration projects supporting a range … process Key Responsibilities Analyse existing data structures and understand business and technical requirements for migration initiatives. Design and deliver robust data migration strategies and ETL solutions. Develop automated data extraction, transformation, and loading (ETL) processes using industry-standard tools and scripts. Work closely with stakeholders to ensure seamless migration and ...

Data Scientist (GIS) - Remote (Data Scientist, Data Science, Data Analyst, Data Analysis, ETL, Sparse data, Spatial data processing, QGIS, Spatial data storage, PostGIS, Jupyter notebooks, Python, Azure Data Factory, Cosmos DB, PostgreSQL, Statistics, Data Analytics, C# .NET, Data Scientist, Data Science, Data Analyst, Data Analysis) Our client is a prestigious … last 12 months. They are looking for a Data Scientist with a strong GIS focus to be responsible for analysing large datasets to extract actionable insights, build predictive models and develop data-driven solutions to complex problems. You will play a major part in data visualization, statistical analysis and collaboration ...

scheme Career progression opportunities City centre parking What you will be doing: Developing and maintaining data integrations between internal and client systems. Building reliable ETL processes to manage and transform large data sets. Working closely with clients and internal teams to support smooth onboarding and data flows. Contributing … solutions. You’ll bring: Strong C#/.Net Core and SQL skills. Experience working with REST APIs , JSON, and data pipelines. An understanding of ETL processes and data transformation. The ability to collaborate across technical and non-technical teams. Experience with Azure Knowledge of Power BI is a nice ...

scheme Career progression opportunities City centre parking What you will be doing: Developing and maintaining data integrations between internal and client systems. Building reliable ETL processes to manage and transform large data sets. Working closely with clients and internal teams to support smooth onboarding and data flows. Contributing … technical solutions. Youll bring: Strong C#/.Net Core and SQL skills. Experience working with REST APIs , JSON, and data pipelines. An understanding of ETL processes and data transformation. The ability to collaborate across technical and non-technical teams. Experience with Azure Knowledge of Power BI is a nice ...

building robust data pipelines and integrating complex data sources. This is an outside IR35 engagement, offering flexibility and autonomy. Key Responsibilities Design and implement ETL/ELT pipelines with strong error handling and retry logic. Develop incremental data processing patterns for large-scale datasets. Work with AWS services including Glue … extraction). Integrate data from REST APIs , PIM systems, and potentially SAP. Ensure data quality, governance, and lineage tracking throughout the project. Required Skills ETL/ELT pipeline design and data validation frameworks. Advanced Python (pandas, numpy, boto3) and SQL (complex queries, optimisation). Experience with AWS Glue , Step Functions ...

Data Engineer/Data Engineering/Data Consultant/Lakehouse/Delta Lake/Data Warehousing/ETL/Azure/Azure Databricks/Python/SQL/Based in the West Midlands/Solihull/Birmingham area, Permanent role, £ + car/allowance (£5,000) + 15% bonus. … Experience in a Data Engineer/Data Engineering role Large and complex datasets Azure, Azure Databricks Microsoft SQL Server Lakehouse, Delta Lake Data Warehousing ETL Database Design Python/PySpark Azure Blob Storage Azure Data Factory Desirable: Exposure ML/Machine Learning/AI/Artificial Intelligence ...

process Key Responsibilities Analyse existing data structures and understand business and technical requirements for migration initiatives. Design and deliver robust data migration strategies and ETL solutions. Develop automated data extraction, transformation, and loading (ETL) processes using industry-standard tools and scripts. Work closely with stakeholders to ensure seamless migration and … skills for complex query development, performance tuning, indexing, and data transformation across on-premise databases and AWS cloud environments. Strong hands-on experience with ETL processes and tools (Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi) or scripting using Python, PySpark, and SQL. Solid understanding of data warehousing and modelling techniques (Star ...

pipelines and orchestration workflows Design database schemas and data models Integrate and enrich data from multiple sources, ensuring consistency and quality Design and implement ETL/ELT processes (e.g., using Apache NiFi) Produce reusable, maintainable code with a test-driven approach Maintain and enhance existing data platforms and services Investigate … into actionable tasks Monitor and optimise system performance for reliability and efficiency Required Skills Apache Kafka Apache NiFi SQL and NoSQL databases (e.g., MongoDB) ETL/ELT development with Groovy, Python, or Java About the Employer With over 60 years of experience supporting government and defence programmes, this employer delivers ...

and experience will you need? Data Engineering Design & Delivery (Practitioner) - You can design and oversee the implementation of complex, enterprise-scale data processes and ETL pipelines, translating complex customer requirements into robust, scalable solutions. Data Standards & Governance (Expert) - You have deep expertise in establishing and maintaining data engineering standards across … adherence to organisational and community standards for consistency and compliance. Problem Solving & Incident Management (Practitioner) - You can lead investigations into complex data issues, including ETL pipeline failures and platform-level problems, applying solutions that consider strategic, tactical, and operational impacts. Leadership & Team Development (Practitioner/Expert) - You have experience leading ...

systems Evaluate, optimise and secure data sets used by internal customers across the organisation Apply best practice in data quality, governance and compliance Develop ETL, API and data exchange solutions to support engineering and business workflows Contribute to the technology roadmap by researching and recommending new tools and approaches Support … proof Skills and Experience Essential: Strong SQL experience such as MS SQL or Oracle Experience with NoSQL technologies such as MongoDB, InfluxDB or Neo4J ETL, ESB, API or similar data integration experience Development experience such as Python Exposure to big data tools or architectures such as the Hadoop ecosystem Experience ...

Lead Engineer with a strong data engineering skills (ETL pipeline creation, data warehousing, data visualization etc) and a solid understanding of Database Architecture & Modelling is sought by a high growth PE backed scale up based in Birmingham. With recent investment driving global expansion this Lead Engineer will play a crucial … flexible working alongside a collaborative, autonomous team culture. This Lead Engineer should have most of the following key skills - Strong Data engineering skills including ETL pipeline creation, data warehousing and visualization - Strong database architecture understanding - PostgreSQL, MongoDB, MS SQL - Event sourcing/messaging - Kafka, CQRS etc - Experience working ...

expert within Azure Databricks and PySpark. You'll help to upskill our teams knowledge of Databricks, get involved in data modelling and ETL pipeline development, integrations, and performance tuning. This is an ever evolving project as the business becomes more and more data driven and your knowledge of Databricks will … project. What you’ll be doing: Leading the design and implementation of a new Databricks-based data warehousing solution Designing and developing data models, ETL pipelines, and data integration processes Large scale data processing using PySpark Monitoring, tuning, and optimising data platforms for reliability and performance Upskilling the wider team ...

utilities like gpload, pxf, and GP Spark for efficient data loading and integration. * Ensure database security, compliance, and adherence to best practices. * Knowledge about ETL processes and its implementation * Knowledge of SQL and complex query writing. * Implement monitoring solutions to proactively identify and resolve issues. * Develop scripts in Shell/… writing * Expertise in Shell/Python/Ansible scription knowledge * Expertise in Patroni for HADR and streaming replication Desirable skills/knowledge/experience: * ETL processes and its implementation * Building data ingestion pipelines with tools like Informatica, Talend etc * Cloud computing experience with AWS, Microsoft Azure, Google Cloud This ...

growth mindset and the ability to prioritise, adapt and collaborate across departments. Responsibilities: Lead day to day team activities and data projects. Manage ETL processes, reporting, dashboards, and data release cycles. Peer review solutions, resolve defects, and implement improvements. Shape the strategy of the data warehouse and data services. Collaborate … with BI and technology teams to influence data direction. Skills & Attributes: Strong technical background (must be hands-on). ETL/Informatica experience (ETL essential) Advanced SQL, Power BI and Excel for data analysis. Experience with SFTP and APIs is a plus. Excellent communicator, able to translate business needs into ...