1 to 25 of 100 ETL Jobs in the West Midlands

warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations.* Design and build high-performance data pipelines: to extract, transform, and load data into Cloud Data Lake Storage and other Cloud services.* Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality … more of the following technologies**Azure Databricks*** Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.* Experience of Databricks ML and Azure ML to develop predictive models and drive business insights.* Proven ...

data engineering, property information and GIS. Key Requirements The ability to extract, transform and query data using SQL, Python or other ETL (Extract, Transform and Load) tools The technical capacity to design and build M and DAX queries within Microsoft Power BI Experience of managing complex datasets within a recognised ...

data architecture, reporting and governance foundations needed for longer-term transformation. What You'll Be Doing as a Data Engineer: Design, build and improve ETL and ELT pipelines that support data ingestion, profiling, reconciliation, cleansing and reporting across enterprise source systems. Building data catalogues, data flows, interface views and trusted ...

good-to-have skill. Key Responsibilities Data Engineering & Pipeline Development Design, build, and maintain scalable data pipelines using Azure Data Factory. Develop robust ETL/ELT processes to ingest, transform, and publish data across enterprise platforms. Work with structured and semi-structured data, applying appropriate data modelling, validation, and quality ...

/NoSQL databases* Familiarity with data visualisation tools (e.g. Power BI, Tableau)* Programming ability in Python, R, or Java* Understanding of data modelling, ETL processes, or data pipelines (desirable)* Exposure to cloud platforms (AWS, Azure, GCP)* Understanding of software development lifecycle (SDLC) and testing principles* Academic, personal, or internship projects ...

pipelines and automated deployments Experience with Python for data engineering or analytics An understanding of data warehousing principles and methodologies is preferable Experience developing ETL/ELT processes Knowledge of Microsoft Fabric and modern data platform technologies is preferable Knowledge of Microsoft Purview and data governance frameworks Microsoft certifications including ...

setting up large-scale processing systems or data infrastructure on a cloud platform. Experience of linking and transforming numerous large and complex datasets, using ETL (Extract, Transform, Load) processes to optimise analytical performance and data reliability. Experience in collection, curation, management and manipulation of NHS datasets. Experience of developing and … reporting systems, including provision of data internally or via other third-party stakeholders. Experience of monitoring, identifying and escalating data quality issues and designing ETL processes to incorporate data validation techniques. Experience managing deployments and transitions from DEV to PROD, supporting live service activation and environment coordination, with hand ...

language and simple analysis techniques to profile data. Technical experience and knowledge in On‐Premise and Public Cloud Data Services focused on database architecture, ETL, data mining, business intelligence, big data, data governance, data quality, and data cleansing. Experience with Microsoft Azure (a plus): Azure SQL Database, Analysis Services, Databricks ...

scalable data solutions. Technical Expertise Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow). Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent. Strong SQL and Python (or equivalent language) skills for data manipulation and automation. Hands ...

quality scalable data solutions.Technical Expertise• Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow).• Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent.• Strong SQL and Python (or equivalent language) skills for data manipulation and automation.• Hands ...

data quality and deliver reliable reporting and insights. What they're looking for: Strong experience with Python , SQL and Excel Experience building and maintaining ETL/data pipelines Knowledge of data modelling and database design Strong analytical and problem-solving skills Nice to have: Azure (Data Factory, Synapse, Databricks ...

hands‐on delivery with leadership and continuous improvement. What you will do? As our Data Engineering Lead, you will: Design, develop and maintain enterprise ETL/ELT pipelines, integrating data from case management, finance, CRM and third‐party systems into a central data platform. Lead the development and continuous improvement ...

data governance, data ethics, privacy and secure handling of data. Desirable skills and experience Experience with Python, R, dbt, cloud data platforms or ETL/ELT workflows. Experience leading small analytical workstreams or mentoring junior analysts. Experience working in Agile product, digital transformation or client delivery teams. What success looks ...

combining hands-on delivery with leadership and continuous improvement.What you will do As our Data Engineering Lead, you will:Design, develop and maintain enterprise ETL/ELT pipelines, integrating data from case management, finance, CRM and third-party systems into a central data platform.Lead the development and continuous improvement ...

scale enterprise environments. Strong expertise in data architecture, modelling, governance, and data management. Experience designing: Data Lakes Data Warehouses Lakehouse Architectures Data Virtualisation Solutions ETL/ELT Frameworks Strong understanding of: Relational Databases NoSQL Databases Graph Databases Cloud Data Platforms Experience delivering cloud migration and transformation programmes. Knowledge of analytics ...

clearly defined data domains while contributing to shared platform components. Key responsibilities include: Building and maintaining reliable data pipelines using Snowflake and Azure Developing ETL/ELT processes supporting Power BI Contributing to a scalable, high‐performance data warehouse Translating business and technical requirements into robust, well‐documented solutions Continuously ...

warehouses. Configure, manage, and monitor Microsoft Fabric tenant settings, capacity limits, and workspace architectures (Lakehouses, Warehouses, and Dataflows Gen2). Build and maintain scalable ETL/ELT data pipelines using Microsoft SQL to ingest and unify multi-source data into the data warehouse. Enforce enterprise data governance, tenant security, workspace ...

Understanding of healthcare, life sciences, or pharmaceutical industry data Experience with data visualization tools to create dashboards and reports Understanding of data engineering concepts (ETL, data pipelines) and automation tools such as Apache Airflow Familiarity with cloud based computing resources such as AWS Interviewing with Veeva We value your time ...

components for large-scale data processing solutions and deploying into a production environment Proficient in SQL and SQL extensions for analytical queriesSolid understanding of ETL/ELT data processing pipelines and design patternsAware of key features and pitfalls of distributed data processing frameworks, data stores and data serialisation formatsAble ...

verbal communication skills Great attention to detail Excellent organisational skills. Strong analytical and problem-solving abilities Experience using Microsoft packages, including Excel Knowledge of ETL tools and data pipelines, SQL, Java and GitHub is required Applicants should be educated to degree level or possess solid work experience in related field. ...

Oracle eBusiness Suite background with recent cloud experience (e.g, SQL/PLSQL/Java/OAF/BI/Forms/Reports.* Data Migration, ETL, knowledge. A strong candidate will have experience in data migration from Oracle eBusiness Suite to Oracle Fusion Cloud and experience using Oracle Data Integrator ...

queries using execution plans, cardinality estimates, IO and wait stats Design optimized queries for CPU, IO and memory usage, reducing locking. Checking job schedules, ETL Pipelines and data freshness Build and Maintain ingestion pipelines Enforce constraints, referential integrity and validation rules Support compliance requirements Document data pipelines, schemas, stored procedures ...

and release management. Cloud architecture (Azure/AWS/GCP), Kubernetes/Docker, serverless, IAM and network security. Data engineering depth (Spark/Databricks; ETL/ELT); cloud‐native data + AI architectures. Enterprise integration and SRE principles (SLIs/SLOs, runbooks, rollback). Consulting leadership: stakeholder, budget and risk ...

data pipeline, including the specification and transfer of data from data providers. Routine ad-hoc data curation activities requiring hands on development of bespoke ETL cleaning scripts using languages such as Python. Working with researchers to understand the data requirements and work with them to deliver the data needed ...

data pipeline, including the specification and transfer of data from data providers. Routine ad-hoc data curation activities requiring hands on development of bespoke ETL cleaning scripts using languages such as Python. Working with researchers to understand the data requirements and work with them to deliver the data needed ...