1 to 25 of 70 ETL Jobs in the West Midlands

warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations.* Design and build high-performance data pipelines: to extract, transform, and load data into Cloud Data Lake Storage and other Cloud services.* Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality … more of the following technologies**Azure Databricks*** Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.* Experience of Databricks ML and Azure ML to develop predictive models and drive business insights.* Proven ...

good-to-have skill. Key Responsibilities Data Engineering & Pipeline Development Design, build, and maintain scalable data pipelines using Azure Data Factory. Develop robust ETL/ELT processes to ingest, transform, and publish data across enterprise platforms. Work with structured and semi-structured data, applying appropriate data modelling, validation, and quality ...

language and simple analysis techniques to profile data. Technical experience and knowledge in On‐Premise and Public Cloud Data Services focused on database architecture, ETL, data mining, business intelligence, big data, data governance, data quality, and data cleansing. Experience with Microsoft Azure (a plus): Azure SQL Database, Analysis Services, Databricks ...

scalable data solutions. Technical Expertise Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow). Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent. Strong SQL and Python (or equivalent language) skills for data manipulation and automation. Hands ...

scalable data solutions. Technical Expertise Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow). Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent. Strong SQL and Python (or equivalent language) skills for data manipulation and automation. Hands ...

data quality and deliver reliable reporting and insights. What they're looking for: Strong experience with Python , SQL and Excel Experience building and maintaining ETL/data pipelines Knowledge of data modelling and database design Strong analytical and problem-solving skills Nice to have: Azure (Data Factory, Synapse, Databricks ...

hands‐on delivery with leadership and continuous improvement. What you will do? As our Data Engineering Lead, you will: Design, develop and maintain enterprise ETL/ELT pipelines, integrating data from case management, finance, CRM and third‐party systems into a central data platform. Lead the development and continuous improvement ...

data governance, data ethics, privacy and secure handling of data. Desirable skills and experience Experience with Python, R, dbt, cloud data platforms or ETL/ELT workflows. Experience leading small analytical workstreams or mentoring junior analysts. Experience working in Agile product, digital transformation or client delivery teams. What success looks ...

including pivot tables, charts, and complex formulas Experience with SQL for querying and manipulating large datasets Knowledge of data integration tools (e.g., Power Automate, ETL processes) Strong communication skills, with the ability to present complex data clearly to non-technical audiences A proactive, curious approach to problem-solving and ...

clearly defined data domains while contributing to shared platform components. Key responsibilities include: Building and maintaining reliable data pipelines using Snowflake and Azure Developing ETL/ELT processes supporting Power BI Contributing to a scalable, high‐performance data warehouse Translating business and technical requirements into robust, well‐documented solutions Continuously ...

warehouses. Configure, manage, and monitor Microsoft Fabric tenant settings, capacity limits, and workspace architectures (Lakehouses, Warehouses, and Dataflows Gen2). Build and maintain scalable ETL/ELT data pipelines using Microsoft SQL to ingest and unify multi-source data into the data warehouse. Enforce enterprise data governance, tenant security, workspace ...

verbal communication skills Great attention to detail Excellent organisational skills. Strong analytical and problem-solving abilities Experience using Microsoft packages, including Excel Knowledge of ETL tools and data pipelines, SQL, Java and GitHub is required Applicants should be educated to degree level or possess solid work experience in related field. ...

data fabric, lake and warehousing principles and full project involvement in one or more major technology platforms, e.g. Snowflake, Azure etc. Development of the Extract Transform Load (ETL) for the relevant data insights platform Working in partnership with ET teams, across the relevant areas of ET data to undertake advanced … unit tests, schema checks, monitoring) and work with stakeholders to remediate upstream issues. Continue existing accountabilities around data fabric/lake/warehouse design, ETL/ELT development, stakeholder engagement, documentation and promoting single-source-of-truth usage across the business. Provide day-to-day operational support for AI agents ...

Oracle eBusiness Suite background with recent cloud experience (e.g, SQL/PLSQL/Java/OAF/BI/Forms/Reports.* Data Migration, ETL, knowledge. A strong candidate will have experience in data migration from Oracle eBusiness Suite to Oracle Fusion Cloud and experience using Oracle Data Integrator ...

queries using execution plans, cardinality estimates, IO and wait stats Design optimized queries for CPU, IO and memory usage, reducing locking. Checking job schedules, ETL Pipelines and data freshness Build and Maintain ingestion pipelines Enforce constraints, referential integrity and validation rules Support compliance requirements Document data pipelines, schemas, stored procedures ...

and release management. Cloud architecture (Azure/AWS/GCP), Kubernetes/Docker, serverless, IAM and network security. Data engineering depth (Spark/Databricks; ETL/ELT); cloud‐native data + AI architectures. Enterprise integration and SRE principles (SLIs/SLOs, runbooks, rollback). Consulting leadership: stakeholder, budget and risk ...

technologies including Azure Data Lake Storage Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL and Event Hubs Designing and developing robust ETL/ELT frameworks, data pipelines, Lakehouse architectures and real-time data solutions, ensuring engineering excellence and reusability across the platform Establishing and governing enterprise data … Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL and Event Hubs Extensive experience designing and implementing enterprise-scale data architectures, including data modelling, ETL/ELT frameworks, Lakehouse solutions, batch and real-time data processing, and cloud-native data platforms Strong understanding of data governance, security, architecture best practices ...

procedures and performance tuning. Working knowledge of GCP services such as Cloud Storage, Cloud Functions, Pub/Sub or Cloud Composer. Experience of building ETL or ELT data pipelines. Exposure to orchestration tooling for scheduled and dependency-driven workloads. Familiarity with SQL Server in support of legacy systems. Experience with ...

procedures and performance tuning. Working knowledge of GCP services such as Cloud Storage, Cloud Functions, Pub/Sub or Cloud Composer. Experience of building ETL or ELT data pipelines. Exposure to orchestration tooling for scheduled and dependency-driven workloads. Familiarity with SQL Server in support of legacy systems. Experience with ...

delivering metrics and insights across market risk, building scalable data workflows and ensuring high data quality. The candidate will use Python and SQL for ETL and data analysis, with exposure to tools like Tableau, Alteryx and Power BI. #J-18808-Ljbffr ...

delivering regulatory and risk metrics across market risk using scalable workflows and robust data analytics. You will work with Python and SQL for ETL and data analysis, develop BI visualizations in Tableau/Power BI, and collaborate closely with risk teams to ensure accurate, timely insights for decision making ...

such as Postman. Strong SQL skills and experience working with Oracle or other relational databases. Experience testing Data Warehouses, Data Marts, Data Migration or ETL solutions. Experience working within Agile delivery teams. Knowledge of AWS environments. Experience using Jira, Zephyr Scale (or similar Test Management tools) and Git. Excellent communication ...

cloud based servers. Skills and Experience: Enterprise level Data Architecture Databricks Modelling Technical authority/Leadership Experience with Canonical Model design patterns Cleansing and ETL Creation and design of data systems including best practice standards principles Responsibility for the Data Roadmap Databricks, Data Lakes, Data Visualisation, Enterprise Service ...

GIS Recruiter Ltd is seeking an experienced Data Engineer to support a data migration and integration programme within a relatively low maturity Azure environment. You will design, build and maintain data migration and ingestion pipelines ...

Engineer or in a similar role. Strong knowledge of master data management and data governance principles and approaches. Proficiency in data integration tools and ETL (Extract, Transform, Load) processes. Ability to capture structured business requirements in a structured user story format. Ability to translate business requirements into technical requirements ...