1 to 25 of 66 ETL Jobs in the West Midlands

warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations.* Design and build high-performance data pipelines: to extract, transform, and load data into Cloud Data Lake Storage and other Cloud services.* Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality … more of the following technologies**Azure Databricks*** Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.* Experience of Databricks ML and Azure ML to develop predictive models and drive business insights.* Proven ...

pipelines and automated deployments Experience with Python for data engineering or analytics An understanding of data warehousing principles and methodologies is preferable Experience developing ETL/ELT processes Knowledge of Microsoft Fabric and modern data platform technologies is preferable Knowledge of Microsoft Purview and data governance frameworks Microsoft certifications including ...

data requirements across complex environments. Gather, profile, and analyse large-scale structured datasets to ensure data accuracy, quality, and completeness. Design and implement robust ETL/ELT frameworks for ingesting, transforming, validating, normalising, and cleansing data. Develop and maintain scalable data pipelines to support analytics and operational decision-making. Implement ...

scalable data solutions. Technical Expertise Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow). Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent. Strong SQL and Python (or equivalent language) skills for data manipulation and automation. Hands ...

engagement, considering communication requirements and business readiness. Experience in data mining and manipulation for large datasets, experience of data profiling and experience of writing ETL code to present data for data quality rules and analysis. Experience in working within or product managing data development environment, acting as a stakeholder contact ...

scale enterprise environments. Strong expertise in data architecture, modelling, governance, and data management. Experience designing: Data Lakes Data Warehouses Lakehouse Architectures Data Virtualisation Solutions ETL/ELT Frameworks Strong understanding of: Relational Databases NoSQL Databases Graph Databases Cloud Data Platforms Experience delivering cloud migration and transformation programmes. Knowledge of analytics ...

operations, security and business stakeholders. Support governance, reporting, audit readiness and continuous improvement. Implement automation and operational best practices where applicable. Technical Skills: SQL, ETL, Power BI, Tableau, Data Modelling Preferred Skills: Enterprise-scale operations experience, stakeholder management, automation mindset, strong analytical and problem-solving capabilities. ...

verbal communication skills Great attention to detail Excellent organisational skills. Strong analytical and problem-solving abilities Experience using Microsoft packages, including Excel Knowledge of ETL tools and data pipelines, SQL, Java and GitHub is required Applicants should be educated to degree level or possess solid work experience in related field. ...

Goldman Sachs seeks an Associate in Internal Audit - Data Engineering to design and implement robust data pipelines and analytics. You will work with Python, Pandas, Polars and PySpark to deliver scalable data products and AI ...

Home/Malvern (onsite 3 days a week) Rate: £550 - £600 per day (Inside IR35) Skills: SC Clearance, Python, SQL, Databricks, AWS, Data Engineering, ETL/ELT, Data Pipelines We are looking to recruit an SC Cleared Data Engineer for a leading technology consultancy to join a long-term Central ...

queries using execution plans, cardinality estimates, IO and wait stats Design optimized queries for CPU, IO and memory usage, reducing locking. Checking job schedules, ETL Pipelines and data freshness Build and Maintain ingestion pipelines Enforce constraints, referential integrity and validation rules Support compliance requirements Document data pipelines, schemas, stored procedures ...

and release management. Cloud architecture (Azure/AWS/GCP), Kubernetes/Docker, serverless, IAM and network security. Data engineering depth (Spark/Databricks; ETL/ELT); cloud‐native data + AI architectures. Enterprise integration and SRE principles (SLIs/SLOs, runbooks, rollback). Consulting leadership: stakeholder, budget and risk ...

technologies including Azure Data Lake Storage Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL and Event Hubs Designing and developing robust ETL/ELT frameworks, data pipelines, Lakehouse architectures and real-time data solutions, ensuring engineering excellence and reusability across the platform Establishing and governing enterprise data … Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL and Event Hubs Extensive experience designing and implementing enterprise-scale data architectures, including data modelling, ETL/ELT frameworks, Lakehouse solutions, batch and real-time data processing, and cloud-native data platforms Strong understanding of data governance, security, architecture best practices ...

modern cloud-based platform. * Utilising Power BI to create insightful dashboards and reports that empower stakeholders with actionable information for decision-making. * Developing ETL processes to efficiently manage healthcare data across different systems. * Leading proof-of-concept initiatives for new data platforms, demonstrating their benefits and building out robust solutions ...

procedures and performance tuning. Working knowledge of GCP services such as Cloud Storage, Cloud Functions, Pub/Sub or Cloud Composer. Experience of building ETL or ELT data pipelines. Exposure to orchestration tooling for scheduled and dependency-driven workloads. Familiarity with SQL Server in support of legacy systems. Experience with ...

Microsoft SQL Server database solutions. Expert knowledge of T-SQL, including stored procedures, functions, views and performance optimisation. Strong experience with relational database design, ETL processes (SSIS or equivalent) and high-volume transactional databases. Proven ability to troubleshoot and optimise SQL performance, including query tuning, execution plans, locking and deadlocks. ...

procedures and performance tuning. Working knowledge of GCP services such as Cloud Storage, Cloud Functions, Pub/Sub or Cloud Composer. Experience of building ETL or ELT data pipelines. Exposure to orchestration tooling for scheduled and dependency‐driven workloads. Familiarity with SQL Server in support of legacy systems. Experience with ...

delivering regulatory and risk metrics across market risk using scalable workflows and robust data analytics. You will work with Python and SQL for ETL and data analysis, develop BI visualizations in Tableau/Power BI, and collaborate closely with risk teams to ensure accurate, timely insights for decision making ...

GIS Recruiter Ltd is seeking an experienced Data Engineer to support a data migration and integration programme within a relatively low maturity Azure environment. You will design, build and maintain data migration and ingestion pipelines ...

and Engineers to translate analytical insights into production systems, working closely on model evaluation and deployment. Establish automated processes for large‐scale data analysis, ETL pipelines, metric generation, and experimentation frameworks. Communicate results and insights to both technical and non‐technical audiences, including through presentations, written reports, and data visualizations. ...

Design and build production data solutions using Microsoft Fabric Develop and evolve Fabric Lakehouse, Warehouse and OneLake capabilities Build and optimise data pipelines and ETL/ELT processes Develop data models and analytics solutions, working extensively with Power BI Integrate internal and third-party systems through APIs Work with Azure … them in production, dealing with operational issues and improving them as requirements, volumes and the platform have evolved. Strong SQL and Data Engineering fundamentals ETL/ELT and data modelling Azure data platforms API integration Source control, CI/CD and deployment Experience building, operating and supporting production data solutions ...

Synapse. Youll work alongside experienced engineers across: Microsoft Fabric data pipelines Fabric Lakehouse, Warehouse and OneLake Power BI development Data models and analytics solutions ETL/ELT SQL and SQL Server Azure Data Lake Internal and third-party API integrations Azure DevOps and Git CI/CD and production deployments … happens afterwards too: monitoring it, supporting users and downstream processes, resolving production issues and improving the solution as the environment evolves. SQL Data modelling ETL/ELT development Azure data platforms and Azure Data Lake API integrations Git/source control Azure DevOps and CI/CD Developing, deploying and ...

focuses on building a modern data platform and reusable data services to support reporting, analytics and AI initiatives. You will design end-to-end ETL/ELT pipelines, develop scalable data models, and optimise pipelines for quality and performance while collaborating across teams in a hybrid work setup. #J ...

team to build reliable data pipelines and ensuring data quality for enterprise reporting. Candidates should have management experience, excellent communication skills, and knowledge of ETL tools. Valpak offers a hybrid work environment, competitive salary, and various benefits, including a bonus of up to 10% and enhanced pension schemes. #J ...

Strong knowledge of data migration, governance, cleansing and quality management. Experience working with ERP platforms and data migration tools. Understanding of ERP data structures, ETL processes, SQL and reporting tools such as Power BI. Strong stakeholder management and leadership skills, with the ability to influence at all levels. Benefits include ...