226 to 250 of 402 ETL Jobs in the UK

successful outcomes against business objectives, timelines and quality standards Design, develop and optimise scalable data pipelines using Python, Databricks and PySpark Build and enhance ETL/ELT workflows, reusable frameworks and modern data engineering solutions Provide technical leadership and architectural guidance across data platform initiatives Design and govern Lakehouse architectures … Python Extensive experience with Databricks, including workflows, notebooks and Delta Lake Strong experience with Apache Spark/PySpark Experience building and optimising enterprise-scale ETL pipelines Strong understanding of modern data architecture and Lakehouse concepts Advanced SQL and distributed data systems expertise Experience with cloud platforms such as AWS, Azure ...

identify declining value or performance * Translate business-case and benefits metrics into reliable technical data models * Manage the analytics engineering lifecycle from ingestion and ETL or ELT through to front-end visualisation * Define technical standards for value-tracking tools, data models and performance analytics * Ensure leadership reporting is accurate, auditable … metadata management, coding, testing and delivering data engineering solutions * Advanced Power BI and/or Microsoft Fabric experience creating executive-level dashboards * Experience with ETL or ELT tools, scripting, data warehouses and data lakes * Experience integrating fragmented data from operational, financial and project management systems * Experience supporting major digital transformation ...

QUALIFICATION Hands‐on experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team ...

Demonstrable and advanced data science and engineering experience within a financial markets context Able to design efficient SQL (Redshift) and Python code for complex ETL pipelines and feature engineering Substantial experience with joining, analysing, manipulating commercial and regulatory data for visualisation (Tableau) and apps Demonstrable experience in utilising data analytics ...

enterprise data migration programmes, preferably within Finance transformations. Proven track record delivering at least 2 full-cycle Workday Financials implementations . Strong understanding of ETL processes, data validation, reconciliation, and governance. Excellent stakeholder management, communication, and leadership skills. Ability to translate complex technical concepts into clear business language. Mandatory Certifications ...

data domains, ensuring alignment with enterprise architecture standards Design and implement scalable Master Data Management frameworks and integration patterns Architect data ingestion pipelines and ETL processes integrating multiple source systems into an MDM hub Define matching, merging and survivorship rules to ensure trusted master data Establish data quality frameworks including ...

Accounting Controls, Treasury, Product Control or Finance Reporting environments. Knowledge of data and integration architecture, including financial data platforms, reconciliation processes, event sourcing, APIs, ETL pipelines, messaging platforms and large‐scale data transformations. Strong engineering excellence and DevOps mindset, including automation, CI/CD, test automation, release management, engineering metrics ...

Hands‐on experience with cloud platforms (AWS, Azure, GCP). Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow). Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission ...

QUALIFICATION Hands‐on experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team ...

Accounting Controls, Treasury, Product Control or Finance Reporting environments. Knowledge of data and integration architecture, including financial data platforms, reconciliation processes, event sourcing, APIs, ETL pipelines, messaging platforms and large‐scale data transformations. A strong engineering excellence and DevOps mindset, including automation, CI/CD, test automation, release management, engineering ...

Qualification Hands‐on experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team ...

Hands‐on experience with cloud platforms (AWS, Azure, GCP). Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow). Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. ...

least one in serious depth Familiarity with data architecture: warehouses, lakes, lakehouses, streaming, modelling, governance Working understanding of integration patterns (APIs, events, messaging, ETL/ELT, iPaaS) Awareness of security, identity, observability and resilience as architectural concerns Polyglot exposure across modern stacks; able to assess and challenge implementations across languages ...

Event-Driven Architecture design, enabling real-time data flows at enterprise scaleHands-on architectural experience with AWS data services, including AWS Glue (Spark-based ETL), Serverless compute, DynamoDB, S3-based Lake architectures, and associated security and governance t oolingWorking knowledge of ML and Generative AI platform architecture, including the design ...

experience querying large, complex datasets. Proficiency in Python, with experience in advanced analytics techniques, analysing model outputs or supporting ML evaluation workflows. Familiarity with ETL workflows and debugging data issues. Proven experience with experimentation. Hands-on experience with visualisation tools (Looker, Tableau, or similar). Excellent communication skills—able ...

opportunity for an individual who is passionate about data engineering and keen to work with modern cloud solutions. Key Responsibilities Design, develop, and maintain ETL pipelines using Azure services, with a specific focus on Databricks and Azure Data Factory. Develop and optimize ETL processes leveraging Notebooks to ensure efficient data … similar role, with expertise in Azure cloud services. Experience with Azure services like Azure Data Lake and Azure Databricks. Proficiency in designing and managing ETL processes using Notebooks. Experience with Power BI for semantic model creation and report development. Familiarity with integrating various data sources within Azure environments. Basic understanding ...

with business stakeholders to deliver meaningful reporting, ensure data integrity and support strategic projects across multiple business functions. Key Responsibilities Design, develop and maintain ETL processes and data pipelines. Build and optimise data models for reporting and analytics. Develop dashboards and reports using Power BI. Work with stakeholders to define … KPIs and reporting requirements. Ensure the accuracy, integrity and availability of business data. Monitor BI systems and scheduled ETL processes. Troubleshoot technical issues and provide BI application support. Analyse root causes of system failures and implement improvements. Produce reports using Power BI and Excel. Manage BI-related projects from requirements ...

central data platform that delivers high-quality data for business reporting and analytics. Working alongside experienced Data Engineers, you will develop and support ETL processes, data pipelines and data models, ensuring data is transformed into business-ready datasets for Power BI reporting. You'll also contribute to the ongoing development … office in the West Midlands 1-2 times a month Day rate:£160pd- £164pd in scope IR35 Start: ASAP Key Responsibilities Develop and maintain ETL processes and data pipelines. Build and support data warehouse solutions and dimensional data models. Assist in the maintenance and enhancement of the central Azure data ...

central data platform that delivers high-quality data for business reporting and analytics. Working alongside experienced Data Engineers, you will develop and support ETL processes, data pipelines and data models, ensuring data is transformed into business-ready datasets for Power BI reporting. You'll also contribute to the ongoing development … office in the West Midlands 1-2 times a month Day rate: 160pd- 164pd in scope IR35 Start: ASAP Key Responsibilities Develop and maintain ETL processes and data pipelines. Build and support data warehouse solutions and dimensional data models. Assist in the maintenance and enhancement of the central Azure data ...

engineering solutions that reduce manual processes, improve data quality, and enable self-service analytics at scale. You will have strong experience in data architecture, ETL development, and modern data warehousing practices, including the application of Kimball methodology and dimensional modelling, alongside a proven track record of building reliable, high-performance … delivering scalable data solutions in a business environment. Strong experience with SQL and transformation logic in a data warehousing environment. Experience designing and maintaining ETL pipelines and data integration processes. Strong experience of Kimball data modelling techniques (e.g. star schema, dimensional modelling). Experience working within a Microsoft data stack ...

designing and evolving data systems that power Tier 1 datasets, improving reliability, reducing technical debt and modernizing legacy workflows. This includes building advanced ETL pipelines, implementing intelligent automation and developing robust data quality controls and monitoring frameworks to ensure data accuracy, completeness and timeliness. In addition, you will play … takes ownership of both data systems and data quality outcomes, and uses modern technologies including AI and machine learning to enhance data workflows and extract additional value from our datasets. We'll trust you to: Build and maintain highly scalable, resilient and observable data pipelines supporting critical Commodities datasets Modernize ...

designing and evolving data systems that power Tier 1 datasets, improving reliability, reducing technical debt and modernizing legacy workflows. This includes building advanced ETL pipelines, implementing intelligent automation and developing robust data quality controls and monitoring frameworks to ensure data accuracy, completeness and timeliness. In addition, you will play … takes ownership of both data systems and data quality outcomes, and uses modern technologies including AI and machine learning to enhance data workflows and extract additional value from our datasets. We’ll Trust You to: Build and maintain highly scalable, resilient and observable data pipelines supporting critical Commodities datasets Modernize ...

using Databricks on AWS. Build and optimize data processing frameworks using PySpark, Spark SQL, Python, Delta Lake, and Databricks notebooks. Develop end-to-end ETL/ELT pipelines for ingestion, transformation, validation, and consumption. Work with AWS services such as S3, Glue, Lambda, EMR, IAM, KMS, CloudWatch, Secrets Manager, Athena … processing. Strong understanding of Delta Lake and lakehouse architecture. Hands-on experience with AWS S3 as a data lake storage layer. Experience in building ETL/ELT pipelines for batch and near-real-time data processing. Experience with data formats such as Parquet, Avro, ORC, JSON, and CSV. Good understanding ...

enterprise data architectures, including data modelling, governance, metadata, lineage and quality - Defining modern data platforms including data lakes, data warehouses and lakehouse architectures - Designing ETL/ELT pipelines and data integration solutions - Advising on cloud-based data platforms, virtualisation and modern analytics architectures - Providing technical leadership throughout the project lifecycle … deliver robust, scalable solutions across Agile environments Skills & Experience: - Enterprise Data Architecture - Data Warehousing, Data Lakes and Lakehouse solutions - Data Modelling and Data Governance - ETL/ELT Architecture - Cloud platforms (Azure, AWS or GCP) - Relational and NoSQL databases - Data Virtualisation - Analytics and BI platforms (Power BI, SAS, R or similar ...