1 to 25 of 558 ETL Jobs in the UK

Key Responsibilities: Data Pipelines and ETL Processes ETL Design: Design and implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions. Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data factory and engineering tools like Apache Spark to ensure seamless … these tools. You will need to demonstrate the following skills and experience; Proven experience as a Data Engineer, with a focus on Azure services. Strong expertise in designing and implementing ETL processes. Experience in using SQL to query and manipulate data. Proficiency in Azure data tooling such as Synapse Analytics, Microsoft Fabric, Azure Data Lake Storage/One Lake, and More ❯

Information Technology, or a related field. Proficiency in SQL, with experience in MSSQL and PostgreSQL. Experience with data visualization tools like Excel, Power BI, Tableau, or similar. Experience with ETL tools, preferably Talend. Basic understanding of OLAP concepts and data warehousing principles. Familiarity with Python for data manipulation and scripting. Strong analytical and problem-solving skills. Experience in agile environments More ❯

practices. Solid understanding of data governance , privacy , and security best practices.Hands-on experience in data architecture , data engineering , or a similar role.Proficiency in data modelling , SQL , data warehousing , and ETL frameworks . Databricks certifications (e.g., Data Engineer Associate/Professional). Experience working in regulated industries (e.g., financial services, healthcare). Exposure to BI tools (e.g., Power BI, Tableau) and More ❯

essential Strong programming skills in Python and SQL; knowledge of Java or Scala is a plus Solid experience with relational databases and data modelling (Data Vault, Dimensional) Proficiency with ETL tools and cloud platforms (AWS, Azure or GCP) Experience working in Agile and DevOps environments Knowledge of AI/ML applications in data workflows is desirable Familiarity with visualisation tools More ❯

work as part of a collaborative team to solve problems and assist other colleagues. - Ability to learn new technologies, programs and procedures. Technical Essentials: - Expertise across data warehouse and ETL/ELT development in AWS preferred with experience in the following: - Strong experience in some of the AWS services like Redshift, Lambda,S3,Step Functions, Batch, Cloud formation, Lake Formation More ❯

seamlessly across data, commercial, and ops teams. Hard Skills Required Programming & Data Science: Python (Pandas, NumPy, scikit-learn, TensorFlow or PyTorch) essential; R (desirable) Data Engineering & Cloud: Advanced SQL, ETL/ELT tools (Airflow/dbt), AWS/Azure/GCP Machine Learning & AI: Classification, regression, clustering, forecasting; NLP (text mining, sentiment, LLM fine-tuning); GenAI frameworks Analytics & Visualisation: BI More ❯

markets, balancing mechanisms, and regulatory frameworks (e.g., REMIT, EMIR). Expert in Python and SQL; strong experience with data engineering libraries (e.g., Pandas, PySpark, Dask). Deep knowledge of ETL/ELT frameworks and orchestration tools (e.g., Airflow, Azure Data Factory, Dagster). Proficient in cloud platforms (preferably Azure) and services such as Data Lake, Synapse, Event Hubs, and Functions. More ❯

to support the successful integration of acquisitions and system upgrades. A strong background in Python programming is preferred, as the successful candidate will leverage Python to build and automate ETL (Extract, Transform, Load) processes, perform data validation and reconciliation, and develop custom scripts to facilitate data extraction and transformation between varied systems. Collecting and documenting data requirements. Pro-actively ensuring … platform and pipelines are reliable and robust, fixing issues as they arise and proposing & implementing stability improvements Develop, deploy and maintain ETL/ELT pipelines to automate financial data collection, transformation, validation and exception reporting Actively engaging with stakeholder across multiple departments. Data platforms administration Ensure relevant technical documentation is in place About you: We are looking for someone who … should have: Excellent writing and communication skills with an attention to detail Experience writing, troubleshooting, and debugging advanced SQL queries Outstanding analytical and problem-solving skills Experience working with ETL/ELT, and reporting and analytic tools Experience designing data warehouse technical architectures and infrastructure components Programming experience in Python Skills and experience we’d love you to have... Understanding More ❯

to support the successful integration of acquisitions and system upgrades. A strong background in Python programming is preferred, as the successful candidate will leverage Python to build and automate ETL (Extract, Transform, Load) processes, perform data validation and reconciliation, and develop custom scripts to facilitate data extraction and transformation between varied systems. Collecting and documenting data requirements. Pro-actively ensuring … platform and pipelines are reliable and robust, fixing issues as they arise and proposing & implementing stability improvements Develop, deploy and maintain ETL/ELT pipelines to automate financial data collection, transformation, validation and exception reporting Actively engaging with stakeholder across multiple departments. Data platforms administration Ensure relevant technical documentation is in place About you: We are looking for someone who … should have: Excellent writing and communication skills with an attention to detail Experience writing, troubleshooting, and debugging advanced SQL queries Outstanding analytical and problem-solving skills Experience working with ETL/ELT, and reporting and analytic tools Experience designing data warehouse technical architectures and infrastructure components Programming experience in Python Skills and experience we’d love you to have... Understanding More ❯

and Business Intelligence Experience in regulated environments Strong analytical and problem-solving skills Excellent communication across all business levels Expertise in Microsoft Data Platform (SQL Server, SSIS, SSAS, SSRS) ETL/ELT pipeline experience Solid understanding of data warehousing and modelling Proficiency in T-SQL and DAX Agile experience (ideally Kanban) Strong interpersonal and teamwork skills Desirable Extras: Knowledge of More ❯

scalable data pipelines and infrastructure in AWS. Strong expertise with AWS services, including Glue, Redshift, Data Catalog, and large-scale data storage solutions such as data lakes. Proficiency in ETL/ELT tools (e.g. Apache Spark, Airflow, dbt). Skilled in data processing languages such as Python, Java, and SQL. Strong knowledge of data warehousing, data lakes, and data lakehouse More ❯

in shaping the future of data-driven decision-making across the institution. This is an exciting opportunity for someone with strong expertise in Azure, ADF, Azure SQL Server, pipelines, ETL, database, Dev-Ops, and Power to contribute to the development of cutting-edge data solutions, influence the organisation's BI strategy, and mentor others in best practices. Key Responsibilities Contribute More ❯

or Scala. - Expertise in SQL and experience with both relational and NoSQL databases. - Familiarity with cloud platforms (e.g., AWS) and their services. - Knowledge of data modeling, data warehousing, and ETL design patterns. - Experience with version control systems (e.g., Git) and CI/CD pipelines . - Strong problem-solving skills and attention to detail. - Excellent communication skills and ability to work More ❯

engineering stakeholders to understand data requirements and design optimal solutions Define and enforce data quality, governance, and monitoring standards across the data platform Optimize the performance and scalability of ETL/ELT workflows and cloud-based data systems Own the roadmap for data infrastructure modernization, recommending new tools, technologies, and practices to improve efficiency and reliability Act as the primary More ❯

platforms. Expertise in modern data tools and frameworks such as Spark, dbt, Airflow, Kafka, Databricks, and cloud-native services (AWS, GCP, or Azure) Understanding of data modeling, distributed systems, ETL/ELT pipelines, and streaming architectures Proficiency in SQL and at least one programming language (e.g., Python, Scala, or Java) Demonstrated experience owning complex technical systems end-to-end, from More ❯

agenda, we should discuss how your expertise could strengthen our growing data practice. As a data engineer/scientist, you will: Design, implement, and maintain scalable data pipelines and ETL processes Develop and maintain data warehouses and data lakes Implement data quality monitoring and validation systems Create and maintain data documentation and cataloguing systems Optimize data storage and retrieval systems More ❯

agenda, we should discuss how your expertise could strengthen our growing data practice. As a data engineer/scientist, you will: Design, implement, and maintain scalable data pipelines and ETL processes Develop and maintain data warehouses and data lakes Implement data quality monitoring and validation systems Create and maintain data documentation and cataloguing systems Optimize data storage and retrieval systems More ❯

agenda, we should discuss how your expertise could strengthen our growing data practice. As a data engineer/scientist, you will: Design, implement, and maintain scalable data pipelines and ETL processes Develop and maintain data warehouses and data lakes Implement data quality monitoring and validation systems Create and maintain data documentation and cataloguing systems Optimize data storage and retrieval systems More ❯

making, and strengthens our customer-centric approach. It's an exciting time to be part of the Data team at the Financial Ombudsman Service Key Responsibilities: Designing and maintaining ETL/ELT pipelines using Azure Data Factory, Synapse and Databricks. Collaborating with data modellers, analysts, and governance leads to ensure data quality and usability. Contribute to the design, implementation and More ❯

must be confident working across: Azure Data Services, including: Azure Data Factory Azure Synapse Analytics Azure Databricks Microsoft Fabric (desirable) Python and PySpark for data engineering, transformation, and automation ETL/ELT pipelines across diverse structured and unstructured data sources Data lakehouse and data warehouse architecture design Power BI for enterprise-grade reporting and visualisation Strong knowledge of data modelling More ❯

modernisation of the data estate, migrating legacy SQL Server warehouses into Azure. You will play a key role in shaping the new cloud data platform. Responsibilities: Build and optimise ETL/ELT pipelines with Azure Data Factory, Synapse, and SQL Database. Lead the migration of on-premises SQL Server/SSIS workloads into Azure. Design data lakes, marts, and models More ❯

DevOps and collaborate with the Software Delivery Manager and data engineering leadership. What you'll need Hands-on Databricks experience Strong Azure Cloud knowledge Proficient in SQL, Python, PySpark ETL & pipeline design (Matillion preferred, alternatives acceptable) Practical data modelling & pipeline architecture Terraform or Bicep for IaC About the company The company is one of the longest-established financial advice networks More ❯

DevOps and collaborate with the Software Delivery Manager and data engineering leadership. What you'll need Hands-on Databricks experience Strong Azure Cloud knowledge Proficient in SQL, Python, PySpark ETL & pipeline design (Matillion preferred, alternatives acceptable) Practical data modelling & pipeline architecture Terraform or Bicep for IaC About the company The company is one of the longest-established financial advice networks More ❯

initiatives Ensure high standards of documentation and data security compliance Technical Skills (desirable): Microsoft Azure Data Services (e.g., Azure Data Factory, Synapse, Databricks, Fabric) Data warehousing and lakehouse design ETL/ELT pipelines SQL, Python for data manipulation and machine learning Big Data frameworks (e.g., Hadoop, Spark) Data visualisation (e.g., Power BI) Understanding of statistical analysis and predictive modelling Experience More ❯

initiatives Ensure high standards of documentation and data security compliance Technical Skills (desirable): Microsoft Azure Data Services (e.g., Azure Data Factory, Synapse, Databricks, Fabric) Data warehousing and lakehouse design ETL/ELT pipelines SQL, Python for data manipulation and machine learning Big Data frameworks (e.g., Hadoop, Spark) Data visualisation (e.g., Power BI) Understanding of statistical analysis and predictive modelling Experience More ❯