176 to 200 of 318 ETL Jobs in England

integration, and management, using expertise in Kimball Methodology and Azure Data Factory to ensure reliable, consistent data across all sources. Responsibilities: Build and maintain ETL pipelines using Azure Data Factory to ingest data from multiple sources into Azure SQL Server. Enforce data governance policies, conduct QA checks, and implement monitoring … Forward-thinking approach to scaling data infrastructure in line with business growth. Experience integrating data from diverse sources, maintaining accuracy and consistency throughout the ETL process. Skilled at troubleshooting complex data pipeline and infrastructure issues. Collaborative team player, able to align data solutions with business objectives across cross-functional teams. ...

successful outcomes against business objectives, timelines and quality standards Design, develop and optimise scalable data pipelines using Python, Databricks and PySpark Build and enhance ETL/ELT workflows, reusable frameworks and modern data engineering solutions Provide technical leadership and architectural guidance across data platform initiatives Design and govern Lakehouse architectures … Python Extensive experience with Databricks, including workflows, notebooks and Delta Lake Strong experience with Apache Spark/PySpark Experience building and optimising enterprise-scale ETL pipelines Strong understanding of modern data architecture and Lakehouse concepts Advanced SQL and distributed data systems expertise Experience with cloud platforms such as AWS, Azure ...

identify declining value or performance * Translate business-case and benefits metrics into reliable technical data models * Manage the analytics engineering lifecycle from ingestion and ETL or ELT through to front-end visualisation * Define technical standards for value-tracking tools, data models and performance analytics * Ensure leadership reporting is accurate, auditable … metadata management, coding, testing and delivering data engineering solutions * Advanced Power BI and/or Microsoft Fabric experience creating executive-level dashboards * Experience with ETL or ELT tools, scripting, data warehouses and data lakes * Experience integrating fragmented data from operational, financial and project management systems * Experience supporting major digital transformation ...

QUALIFICATION Hands‐on experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team ...

Demonstrable and advanced data science and engineering experience within a financial markets context Able to design efficient SQL (Redshift) and Python code for complex ETL pipelines and feature engineering Substantial experience with joining, analysing, manipulating commercial and regulatory data for visualisation (Tableau) and apps Demonstrable experience in utilising data analytics ...

data domains, ensuring alignment with enterprise architecture standards Design and implement scalable Master Data Management frameworks and integration patterns Architect data ingestion pipelines and ETL processes integrating multiple source systems into an MDM hub Define matching, merging and survivorship rules to ensure trusted master data Establish data quality frameworks including ...

Accounting Controls, Treasury, Product Control or Finance Reporting environments. Knowledge of data and integration architecture, including financial data platforms, reconciliation processes, event sourcing, APIs, ETL pipelines, messaging platforms and large‐scale data transformations. Strong engineering excellence and DevOps mindset, including automation, CI/CD, test automation, release management, engineering metrics ...

Hands‐on experience with cloud platforms (AWS, Azure, GCP). Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow). Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission ...

QUALIFICATION Hands‐on experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team ...

Accounting Controls, Treasury, Product Control or Finance Reporting environments. Knowledge of data and integration architecture, including financial data platforms, reconciliation processes, event sourcing, APIs, ETL pipelines, messaging platforms and large‐scale data transformations. A strong engineering excellence and DevOps mindset, including automation, CI/CD, test automation, release management, engineering ...

Qualification Hands‐on experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team ...

Hands‐on experience with cloud platforms (AWS, Azure, GCP). Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow). Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. ...

least one in serious depth Familiarity with data architecture: warehouses, lakes, lakehouses, streaming, modelling, governance Working understanding of integration patterns (APIs, events, messaging, ETL/ELT, iPaaS) Awareness of security, identity, observability and resilience as architectural concerns Polyglot exposure across modern stacks; able to assess and challenge implementations across languages ...

experience querying large, complex datasets. Proficiency in Python, with experience in advanced analytics techniques, analysing model outputs or supporting ML evaluation workflows. Familiarity with ETL workflows and debugging data issues. Proven experience with experimentation. Hands-on experience with visualisation tools (Looker, Tableau, or similar). Excellent communication skills—able ...

Collaborative & team player, but also able to work independently & autonomously. Pragmatic approach to solving problems while balancing business goals. Experience building integrations. Proficiency with ETL data pipelines. Agentic AI experience. Usage of AI coding assistants (Claude, Gemini, etc.) for the majority of coding tasks. Why Join Dialpad Work ...

opportunity for an individual who is passionate about data engineering and keen to work with modern cloud solutions. Key Responsibilities Design, develop, and maintain ETL pipelines using Azure services, with a specific focus on Databricks and Azure Data Factory. Develop and optimize ETL processes leveraging Notebooks to ensure efficient data … similar role, with expertise in Azure cloud services. Experience with Azure services like Azure Data Lake and Azure Databricks. Proficiency in designing and managing ETL processes using Notebooks. Experience with Power BI for semantic model creation and report development. Familiarity with integrating various data sources within Azure environments. Basic understanding ...

with business stakeholders to deliver meaningful reporting, ensure data integrity and support strategic projects across multiple business functions. Key Responsibilities Design, develop and maintain ETL processes and data pipelines. Build and optimise data models for reporting and analytics. Develop dashboards and reports using Power BI. Work with stakeholders to define … KPIs and reporting requirements. Ensure the accuracy, integrity and availability of business data. Monitor BI systems and scheduled ETL processes. Troubleshoot technical issues and provide BI application support. Analyse root causes of system failures and implement improvements. Produce reports using Power BI and Excel. Manage BI-related projects from requirements ...

central data platform that delivers high-quality data for business reporting and analytics. Working alongside experienced Data Engineers, you will develop and support ETL processes, data pipelines and data models, ensuring data is transformed into business-ready datasets for Power BI reporting. You'll also contribute to the ongoing development … office in the West Midlands 1-2 times a month Day rate:£160pd- £164pd in scope IR35 Start: ASAP Key Responsibilities Develop and maintain ETL processes and data pipelines. Build and support data warehouse solutions and dimensional data models. Assist in the maintenance and enhancement of the central Azure data ...

designing and evolving data systems that power Tier 1 datasets, improving reliability, reducing technical debt and modernizing legacy workflows. This includes building advanced ETL pipelines, implementing intelligent automation and developing robust data quality controls and monitoring frameworks to ensure data accuracy, completeness and timeliness. In addition, you will play … takes ownership of both data systems and data quality outcomes, and uses modern technologies including AI and machine learning to enhance data workflows and extract additional value from our datasets. We'll trust you to: Build and maintain highly scalable, resilient and observable data pipelines supporting critical Commodities datasets Modernize ...

designing and evolving data systems that power Tier 1 datasets, improving reliability, reducing technical debt and modernizing legacy workflows. This includes building advanced ETL pipelines, implementing intelligent automation and developing robust data quality controls and monitoring frameworks to ensure data accuracy, completeness and timeliness. In addition, you will play … takes ownership of both data systems and data quality outcomes, and uses modern technologies including AI and machine learning to enhance data workflows and extract additional value from our datasets. We’ll Trust You to: Build and maintain highly scalable, resilient and observable data pipelines supporting critical Commodities datasets Modernize ...

enterprise data architectures, including data modelling, governance, metadata, lineage and quality - Defining modern data platforms including data lakes, data warehouses and lakehouse architectures - Designing ETL/ELT pipelines and data integration solutions - Advising on cloud-based data platforms, virtualisation and modern analytics architectures - Providing technical leadership throughout the project lifecycle … deliver robust, scalable solutions across Agile environments Skills & Experience: - Enterprise Data Architecture - Data Warehousing, Data Lakes and Lakehouse solutions - Data Modelling and Data Governance - ETL/ELT Architecture - Cloud platforms (Azure, AWS or GCP) - Relational and NoSQL databases - Data Virtualisation - Analytics and BI platforms (Power BI, SAS, R or similar ...

working across the full data life cycle and is passionate about turning complex data into valuable business insights. The Role Design, develop and maintain ETL processes, data pipelines and integration solutions. Build and optimise data models to support reporting, analytics and business performance tracking. Partner with business stakeholders to gather … experience with Microsoft Azure data technologies, including Azure Data Factory, Azure Synapse Analytics and/or Microsoft Fabric. Experience of designing and supporting ETL processes and data pipelines. Advanced SQL skills with experience working with large and complex datasets. Knowledge of Python for data processing, automation or analytics. Solid understanding ...

Spark within a modern Lakehouse environment. Key Responsibilities Design, develop and maintain scalable data pipelines using Python and Databricks. Build, optimise and support enterprise ETL/ELT workflows using Apache Spark and Delta Lake. Design and develop robust data models and Lakehouse architectures. Implement and manage data workflows within … Extensive hands-on experience with Databricks , including Workflows, Notebooks and Delta Lake. Strong experience with Apache Spark/PySpark . Proven experience building scalable ETL/ELT pipelines. Strong SQL and data modelling skills. Experience designing modern Lakehouse architectures. Experience working with cloud platforms including AWS, Azure or GCP. Experience ...

grows, but the initial focus is on building a scalable, high-quality data platform from the ground up. The Role Design and build scalable ETL/ELT pipelines in Microsoft Fabric using PySpark and SQL Develop transformation logic within Fabric Lakehouses using Delta Lake and medallion architecture principles Integrate data … PySpark experience Proficiency in Python for data processing and API integration Experience building Power BI models and dashboards for business reporting Strong understanding of ETL/ELT design and data modelling principles Experience integrating third-party data via REST APIs Knowledge of data quality, monitoring, and governance practices Experience using ...