1 to 25 of 77 ETL Jobs in the West Midlands

working with Microsoft Fabric and/or Azure Databricks. Expertise in Spark-based data engineering and cloud data platforms. Strong knowledge of ELT/ETL processes, orchestration, data modelling and Lakehouse architectures. Experience using Azure DevOps, Git repositories and CI/CD pipelines. Understanding of data governance, security, GDPR and ...

Python for automation.Hands-on experience with Microsoft Fabric and Azure Data Factory, including pipeline orchestration, linked services, environment management, and parameterisation.Experience with SSIS for ETL processes and legacy data integration tasks.Expertise in designing and implementing CI/CD pipelines using tools such as Azure DevOps.Experience with Infrastructure as Code (e.g. ...

pipelines and automated deployments Experience with Python for data engineering or analytics An understanding of data warehousing principles and methodologies is preferable Experience developing ETL/ELT processes Knowledge of Microsoft Fabric and modern data platform technologies is preferable Knowledge of Microsoft Purview and data governance frameworks Microsoft certifications including ...

data requirements across complex environments. Gather, profile, and analyse large-scale structured datasets to ensure data accuracy, quality, and completeness. Design and implement robust ETL/ELT frameworks for ingesting, transforming, validating, normalising, and cleansing data. Develop and maintain scalable data pipelines to support analytics and operational decision-making. Implement ...

user engagement, considering communication requirements and business readiness.Experience in data mining and manipulation for large datasets, experience of data profiling and experience of writing ETL code to present data for data quality rules and analysis.Experience in working within or product managing data development environment, acting as a stakeholder contact and ...

scalable data solutions. Technical Expertise Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow). Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent. Strong SQL and Python (or equivalent language) skills for data manipulation and automation. Hands ...

more of the following: Google AppSheet Google Apps Script BigQuery Looker Studio Microsoft Power Platform Power BI ServiceNow CMDB Remedy CMDB Python JavaScript ETL and Data Integration tools ITSM & CMDB Knowledge ITIL Foundation or equivalent understanding. Configuration Management processes. Asset Management. Service Mapping. Discovery tools. Data Governance. ServiceNow CMDB experience ...

engagement, considering communication requirements and business readiness. Experience in data mining and manipulation for large datasets, experience of data profiling and experience of writing ETL code to present data for data quality rules and analysis. Experience in working within or product managing data development environment, acting as a stakeholder contact ...

scale enterprise environments. Strong expertise in data architecture, modelling, governance, and data management. Experience designing: Data Lakes Data Warehouses Lakehouse Architectures Data Virtualisation Solutions ETL/ELT Frameworks Strong understanding of: Relational Databases NoSQL Databases Graph Databases Cloud Data Platforms Experience delivering cloud migration and transformation programmes. Knowledge of analytics ...

journey onto Snowflake, working across clearly defined data domains while contributing to shared platform components. Building and maintaining reliable data pipelines using Snowflake Developing ETL/ELT processes supporting Power BI Contributing to a scalable, high‐performance data warehouse Translating business and technical requirements into robust, well‐documented solutions Continuously ...

management skills.Desirable Skills· Experience supporting applications hosted within Microsoft Azure.· Azure DevOps and CI/CD pipeline exposure.· Power Platform.· Logic Apps.· SSIS and ETL processes.· Oracle databases.· Experience supporting integrations with third-party systems.· Experience working within public sector environments.· Microservices architecture.· ITIL Foundation certification.· Microsoft Azure certifications.· Security ...

Skills & Experience: Experience as a Data Engineer, Data Developer or similar . Strong Python and SQL skills. Commercial Databricks experience. Experience with data pipelines, ETL/ELT or data processing. Understanding of cloud data engineering. Active SC or DV Clearance Desirable: AWS, Google Cloud, Defence/Central Government, large-scale ...

operations, security and business stakeholders. Support governance, reporting, audit readiness and continuous improvement. Implement automation and operational best practices where applicable. Technical Skills: SQL, ETL, Power BI, Tableau, Data Modelling Preferred Skills: Enterprise-scale operations experience, stakeholder management, automation mindset, strong analytical and problem-solving capabilities. ...

stakeholders. • Support governance, reporting, audit readiness and continuous improvement. • Implement automation and operational best practices where applicable. Required Experience - 9+ years Technical Skills - SQL, ETL, Power BI, Tableau, Data Modelling Preferred Skills Enterprise-scale operations experience, stakeholder management, automation mindset, strong analytical and problem-solving capabilities Benefits A supportive, diverse ...

components for large-scale data processing solutions and deploying into a production environment Proficient in SQL and SQL extensions for analytical queriesSolid understanding of ETL/ELT data processing pipelines and design patternsAware of key features and pitfalls of distributed data processing frameworks, data stores and data serialisation formatsAble ...

technologies including Azure Data Lake Storage Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL and Event Hubs Designing and developing robust ETL/ELT frameworks, data pipelines, Lakehouse architectures and real-time data solutions, ensuring engineering excellence and reusability across the platform Establishing and governing enterprise data … Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL and Event Hubs Extensive experience designing and implementing enterprise-scale data architectures, including data modelling, ETL/ELT frameworks, Lakehouse solutions, batch and real-time data processing, and cloud-native data platforms Strong understanding of data governance, security, architecture best practices ...

Goldman Sachs seeks an Associate in Internal Audit - Data Engineering to design and implement robust data pipelines and analytics. You will work with Python, Pandas, Polars and PySpark to deliver scalable data products and AI ...

Home/Malvern (onsite 3 days a week) Rate: £550 - £600 per day (Inside IR35) Skills: SC Clearance, Python, SQL, Databricks, AWS, Data Engineering, ETL/ELT, Data Pipelines We are looking to recruit an SC Cleared Data Engineer for a leading technology consultancy to join a long-term Central ...

queries using execution plans, cardinality estimates, IO and wait stats Design optimized queries for CPU, IO and memory usage, reducing locking. Checking job schedules, ETL Pipelines and data freshness Build and Maintain ingestion pipelines Enforce constraints, referential integrity and validation rules Support compliance requirements Document data pipelines, schemas, stored procedures ...

Microsoft SQL Server database solutions. Expert knowledge of T-SQL, including stored procedures, functions, views and performance optimisation. Strong experience with relational database design, ETL processes (SSIS or equivalent) and high-volume transactional databases. Proven ability to troubleshoot and optimise SQL performance, including query tuning, execution plans, locking and deadlocks. ...

Microsoft SQL Server database solutions. Expert knowledge of T-SQL, including stored procedures, functions, views and performance optimisation. Strong experience with relational database design, ETL processes (SSIS or equivalent) and high-volume transactional databases. Proven ability to troubleshoot and optimise SQL performance, including query tuning, execution plans, locking and deadlocks. ...

Integration Engineer or in a similar role.Strong knowledge of master data management and data governance principles and approaches.Proficiency in data integration tools and ETL (Extract, Transform, Load) processes.Ability to capture structured business requirements in a structured user story format.Ability to translate business requirements into technical requirements to inform a solution ...

business needs into actionable insights What we're looking for: Strong experience with Power BI, Azure, and SQL Solid understanding of data modelling and ETL processes Ability to communicate insights clearly to non-technical audiences A proactive, solutions-focused mindset BI Developer - apply asap if interesed. GleeIT At Gleeson Recruitment ...

procedures and performance tuning. Working knowledge of GCP services such as Cloud Storage, Cloud Functions, Pub/Sub or Cloud Composer. Experience of building ETL or ELT data pipelines. Exposure to orchestration tooling for scheduled and dependency-driven workloads. Familiarity with SQL Server in support of legacy systems. Experience with ...

application landscapes and modern architecture principles. Data & Analytics Platforms Experience with one or more of the following: Snowflake Data Lakes Data Fabric Architectures Databricks ETL/ELT Frameworks Modern data integration and transformation solutions I ntegration Architecture Strong understanding of enterprise integration patterns. Experience designing integrations between cloud services, SaaS ...