1 to 25 of 97 ETL Jobs in the Midlands

warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations.* Design and build high-performance data pipelines: to extract, transform, and load data into Cloud Data Lake Storage and other Cloud services.* Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality … more of the following technologies**Azure Databricks*** Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.* Experience of Databricks ML and Azure ML to develop predictive models and drive business insights.* Proven ...

successfully built, enhanced or operated cloud-based data platforms, ideally within Azure environments. Data Architecture Knowledge - You understand data modelling, ELT/ETL design, Delta Lake principles, data quality frameworks and modern engineering best practices. Cloud & DevOps Capability - You have experience with Azure services, automation, CI/CD pipelines and ...

transition from legacy platforms where applicable Data Engineering & Integration Providing technical leadership across data engineering practices, including: Batch and streaming data pipelines ELT/ETL frameworks CI/CD for data platforms Architecting robust integrations from internal and third-party systems Defining data quality, validation, and monitoring standards Governance, Security ...

pipelines and automated deployments Experience with Python for data engineering or analytics An understanding of data warehousing principles and methodologies is preferable Experience developing ETL/ELT processes Knowledge of Microsoft Fabric and modern data platform technologies is preferable Knowledge of Microsoft Purview and data governance frameworks Microsoft certifications including ...

data requirements across complex environments. Gather, profile, and analyse large-scale structured datasets to ensure data accuracy, quality, and completeness. Design and implement robust ETL/ELT frameworks for ingesting, transforming, validating, normalising, and cleansing data. Develop and maintain scalable data pipelines to support analytics and operational decision-making. Implement ...

scalable data solutions. Technical Expertise Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow). Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent. Strong SQL and Python (or equivalent language) skills for data manipulation and automation. Hands ...

data infrastructure. Technical Expertise Languages: Strong proficiency in SQL and Python. Data Platform: Hands-on experience with Azure Data Lake and Databricks. Data Integration (ETL): Proven capability in building efficient data pipelines using Azure Data Factory (ADF), SSIS, and API integrations. Reporting & Analytics Reporting Tools: Proficiency in PowerBI (or similar ...

engagement, considering communication requirements and business readiness. Experience in data mining and manipulation for large datasets, experience of data profiling and experience of writing ETL code to present data for data quality rules and analysis. Experience in working within or product managing data development environment, acting as a stakeholder contact ...

just overseeing others doing it Strong Azure data engineering background: Data Factory, Synapse and/or Fabric, with solid SQL and pipeline/ETL-ELT fundamentals Direct experience implementing medallion or equivalent layered lakehouse architecture Comfortable being the most senior technical person in the room while still writing pipelines and ...

just overseeing others doing it Strong Azure data engineering background: Data Factory, Synapse and/or Fabric, with solid SQL and pipeline/ETL-ELT fundamentals Direct experience implementing medallion or equivalent layered lakehouse architecture Comfortable being the most senior technical person in the room while still writing pipelines and ...

Tata Consultancy Services in the United Kingdom is seeking a Data Engineer to design, develop and maintain Azure-based data pipelines, leveraging Azure Data Factory, Databricks, Synapse and Data Lake to support data integration, migration ...

scale enterprise environments. Strong expertise in data architecture, modelling, governance, and data management. Experience designing: Data Lakes Data Warehouses Lakehouse Architectures Data Virtualisation Solutions ETL/ELT Frameworks Strong understanding of: Relational Databases NoSQL Databases Graph Databases Cloud Data Platforms Experience delivering cloud migration and transformation programmes. Knowledge of analytics ...

operations, security and business stakeholders. Support governance, reporting, audit readiness and continuous improvement. Implement automation and operational best practices where applicable. Technical Skills: SQL, ETL, Power BI, Tableau, Data Modelling Preferred Skills: Enterprise-scale operations experience, stakeholder management, automation mindset, strong analytical and problem-solving capabilities. ...

skills. Desirable Skills· Experience supporting applications hosted within Microsoft Azure.· Azure DevOps and CI/CD pipeline exposure.· Power Platform.· Logic Apps.· SSIS and ETL processes.· Oracle databases.· Experience supporting integrations with third-party systems.· Experience working within public sector environments.· Microservices architecture.· ITIL Foundation certification.· Microsoft Azure certifications.· Security ...

flows, and anticipate the downstream consequences of design decisions. You translate business problems into elegant technical solutions. Key Responsibilities Design and develop data pipelines, ETL processes, and backend services using Python Build and maintain APIs and microservices that serve data products to internal and external consumers Work with large-scale ...

meet deadlines. Excellent stakeholder management and communication skills, with the confidence to work across different business functions. Experience with SQL, VBA, data warehousing or ETL concepts would be advantageous. A continuous improvement mindset and a genuine interest in using data to create business value. What's in it for youYou ...

components for large-scale data processing solutions and deploying into a production environment Proficient in SQL and SQL extensions for analytical queriesSolid understanding of ETL/ELT data processing pipelines and design patternsAware of key features and pitfalls of distributed data processing frameworks, data stores and data serialisation formatsAble ...

verbal communication skills Great attention to detail Excellent organisational skills. Strong analytical and problem-solving abilities Experience using Microsoft packages, including Excel Knowledge of ETL tools and data pipelines, SQL, Java and GitHub is required Applicants should be educated to degree level or possess solid work experience in related field. ...

trivial requirements, identify root causes efficiently, and consider performance, scalability, and maintainability in your approach. Key Responsibilities Design and develop data pipelines, ETL processes, and backend services using Python Build interactive dashboards, data visualization tools, and web applications using React Develop RESTful APIs that connect data services to frontend applications ...

impact that matters, through challenging projects which demand ambitious innovation and thought leadership. The Role Design, develop, and maintain Azure-based data pipelines and ETL solutions. Work with Azure Data Factory, Databricks, Synapse, and Data Lake to support data integration, migration, and analytics requirements. Collaborate with stakeholders to understand business … needs, troubleshoot data issues, and ensure secure, scalable, and reliable data solutions. Your responsibilities Design, develop and implement data pipelines to perform (ETL) from multiple sources into Azure Services. Proficiency in programming languages (e.g., Python, SQL, PySpark etc.) and data manipulation tools. Knowledge of DevOps tools Manage and monitor ...

Home/Malvern (onsite 3 days a week) Rate: £550 - £600 per day (Inside IR35) Skills: SC Clearance, Python, SQL, Databricks, AWS, Data Engineering, ETL/ELT, Data Pipelines We are looking to recruit an SC Cleared Data Engineer for a leading technology consultancy to join a long-term Central ...

queries using execution plans, cardinality estimates, IO and wait stats Design optimized queries for CPU, IO and memory usage, reducing locking. Checking job schedules, ETL Pipelines and data freshness Build and Maintain ingestion pipelines Enforce constraints, referential integrity and validation rules Support compliance requirements Document data pipelines, schemas, stored procedures ...

holiday entitlement, Health and wellbeing programme, health cash plans + dozens more. Potential bonus Experience: Microsoft Power Platform (Power Automate and PowerApps) Data Modelling ETL processes Experience with Reporting tools like Power BI, SSRS etc SQL Server Desirable tech Azure, .NET, GIT, Azure DevOps Effectively, this role is responsible ...

holiday entitlement, Health and wellbeing programme, health cash plans + dozens more. Potential bonus Experience: Microsoft Power Platform (Power Automate and PowerApps) Data Modelling ETL processes Experience with Reporting tools like Power BI, SSRS etc SQL Server Desirable tech Azure, .NET, GIT, Azure DevOps Effectively, this role is responsible ...

and release management. Cloud architecture (Azure/AWS/GCP), Kubernetes/Docker, serverless, IAM and network security. Data engineering depth (Spark/Databricks; ETL/ELT); cloud‐native data + AI architectures. Enterprise integration and SRE principles (SLIs/SLOs, runbooks, rollback). Consulting leadership: stakeholder, budget and risk ...