1 to 25 of 49 ETL Jobs in the West Midlands

/ML models that fuel our data-driven operations. What You Will Bring Design and build high-performance data pipelines: to extract, transform, and load data into Cloud Data Lake Storage and other Cloud services. Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality checks … more of the following technologies Azure Databricks Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Experience of Databricks ML and Azure ML to develop predictive models and drive business insights. Proven ...

skills/knowledge/experience Strong Azure Data Platform experience. Hands-on Azure Databricks expertise. Advanced SQL and Python development skills. Strong experience with ETL/ELT and data pipeline development. Experience supporting production data platforms and operational services. Data modelling and data architecture knowledge. Incident management, root cause analysis ...

ready data capabilities. We're looking for experience with: Enterprise data architecture and data modelling Data warehouses, data lakes and modern cloud data platforms ETL/ELT, data integration and data virtualisation Relational, NoSQL and cloud-based databases Power BI, Pentaho, Denodo or similar analytics technologies Agile, DevOps and ...

data sources, ensuring quality, integrity, and availability of data. Contribute to the development of data models and data architecture best practices. Implement and optimise ETL processes using Python and modern frameworks. Maintain clear and reusable codebases across Python and TypeScript environments. Support data governance, security, and compliance processes across ...

work with modern Azure technologies in a business that values innovation and continuous improvement. Key responsibilities: Design and develop scalable Azure data pipelines and ETL solutions Build and optimise Azure-based data warehouses and data lakes Improve platform performance, reliability and scalability Collaborate with business and technical stakeholders to deliver ...

tools to help operational efficiency such as Power Automate, Power Pivot, MS Teams/SharePoint/One Drive Understanding of database management systems and ETL (Extract, transform, load) framework Understanding of MS Azure data lake design (e.g. dimensional modelling) and data mining Business Skills Proven abilities to take initiative and ...

governance, and security standards are upheld across all solutions; and troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: Strong expertise in ETL tools (Pentaho, Talend); experience with data virtualization using Denodo; proficiency in SAS for data analytics and reporting; solid understanding of Agile and Scrum frameworks; hands ...

bottlenecks. Key skill and experience SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in SAS for data analytics and reporting. Oracle (good to have). Solid understanding ...

Abilities: Performance Competencies Highly numerate with previous experience in delivering BI reporting solutions. Expert T-SQL skills are essential. Strong understanding of data warehousing, ETL and database concepts. Strong experience of Microsoft BI technologies. Experience in delivering complex reporting solutions. Technologies Essentials: Microsoft stack SQL Server 2008/12/ ...

pipeline and dataset is discoverable, addressable, and secure by design. Data capabilities: You understand the full lifecycle of data from data discovery, storage, pipelines, ETL, streaming through to how data is managed including data quality, metadata management and how data is used for applications and core decision making through advanced ...

similar role Strong skills in Azure , Fabric , Data Factory , Synapse , or similar Proficiency in SQL , Python , or other scripting languages Understanding of data modelling , ETL/ELT , and pipeline orchestration Experience working with large datasets and cloud‐based architectures A proactive mindset and ability to work in a fast‐moving ...

Source and Target systems Analysis of Data Quality and advise on how to improve areas of concern Develop, set up or improve the ETL frameworks and process Understand the requirements from a programme perspective Work closely with the client for crafting the functional and technical solution Work with functional and ...

data model. Translate business requirements into technical data integration and transformation solutions. Design, develop and maintain scalable data pipelines across multiple enterprise systems. Develop ETL/ELT processes and reusable transformation logic. Design and implement enterprise data models that support reporting, analytics and future system onboarding. Integrate data into Snowflake … with business stakeholders to gather and validate requirements. Strong understanding of enterprise data architecture and data modelling principles. Advanced SQL. Strong Python development experience. ETL/ELT development. Experience with Snowflake or an equivalent cloud data platform. Experience using Azure Data Factory, Precog or similar integration technologies. API development and ...

where appropriate. Prepare datasets for inclusion in PBI reports. What we are looking for Strong understanding of the principles of database systems, data warehouses, ETL processes, APIs and data analytics. The resilience to deal with and work around the limitations of legacy systems, and to adapt as systems change. Excellent ...

Microsoft SQL Server database solutions. Expert knowledge of T-SQL, including stored procedures, functions, views and performance optimisation. Strong experience with relational database design, ETL processes (SSIS or equivalent) and high-volume transactional databases. Proven ability to troubleshoot and optimise SQL performance, including query tuning, execution plans, locking and deadlocks. ...

agent based capabilities within data and analytics platforms Producing architectures and designs for complex end-to-end data solutions, including data storage and management, ETL/ELT, reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling … such as: o Relational DBMS o NoSQL o Graph databases o Cloud object storage o DB as a service Architecture and design concepts for ETL/ELT solutions, using a range of tooling Designing and applying data virtualisation technologies, particularly at enterprise scale Architecture and design concepts for data exploitation ...

agent based capabilities within data and analytics platforms * Producing architectures and designs for complex end-to-end data solutions, including data storage and management, ETL/ELT, reporting and analytics * Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling … such as: o Relational DBMS o NoSQL o Graph databases o Cloud object storage o DB as a service * Architecture and design concepts for ETL/ELT solutions, using a range of tooling * Designing and applying data virtualisation technologies, particularly at enterprise scale * Architecture and design concepts for data exploitation ...

agent-based capabilities within data and analytics platforms Producing architectures and designs for complex end-to-end data solutions, including data storage and management, ETL/ELT, reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling … warehouse and data lake solutions, such as: Relational DBMS NoSQL Graph databases Cloud object storage DB as a service Architecture and design concepts for ETL/ELT solutions, using a range of tooling Designing and applying data virtualisation technologies, particularly at enterprise scale Architecture and design concepts for data exploitation ...

agent-based capabilities within data and analytics platforms* Producing architectures and designs for complex end-to-end data solutions, including data storage and management, ETL/ELT, reporting and analytics* Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling … and data lake solutions, such as:o Relational DBMSo NoSQLo Graph databaseso Cloud object storageo DB as a service* Architecture and design concepts for ETL/ELT solutions, using a range of tooling* Designing and applying data virtualisation technologies, particularly at enterprise scale* Architecture and design concepts for data exploitation ...

Experience Ability to define and document Test Approaches and Test Completion reports Proficiency with JIRA, Test Management Tools (eg, Jira Zephyr Scale), GIT ETL experience Excellent written and verbal communication skills Experience in Integration Testing ...

with C#, JavaScript or other languages advantageous) * Experience building software applications, automation workflows, and data-processing tools * Proficiency in designing and operating data pipelines, ETL workflows, and data-validation systems * Experience with cloud platforms such as AWS, Google Cloud or Azure * Data analysis skills including statistical evaluation, uncertainty analysis and ...

and developing enterprise-scale data solutions using Microsoft Fabric Building modern Lakehouse and Warehouse solutions within Fabric Developing Azure Synapse Analytics solutions Creating scalable ETL and ELT pipelines Developing Power BI semantic models and supporting reporting solutions Engineering robust Azure Data Factory integrations Building secure Azure Data Lake solutions Working … also bring strong experience across: Microsoft Fabric (essential) Azure Synapse Analytics (essential) Power BI Azure Data Factory Azure Data Lake SQL Server ETL/ELT development Azure DevOps Git Enterprise cloud data engineering AI Experience We're looking for engineers who have already begun applying AI capabilities within enterprise data ...

modern SAS platform. This is an opportunity to work on a complex, large-scale data transformation programme, integrating multiple data sources and building robust ETL solutions that enable advanced analytics and risk modelling. The Role As a Data Engineer, you'll be responsible for designing, building and deploying scalable data … drive DevOps best practices while ensuring data quality, governance and security remain at the forefront. Key Responsibilities Design, develop and deploy data integration and ETL solutions. Build scalable data pipelines supporting analytics and business intelligence platforms. Develop solutions using Pentaho, Talend, Denodo and SAS technologies. Collaborate with cross-functional teams ...

enterprise data architectures, including data modelling, governance, metadata, lineage and quality - Defining modern data platforms including data lakes, data warehouses and lakehouse architectures - Designing ETL/ELT pipelines and data integration solutions - Advising on cloud-based data platforms, virtualisation and modern analytics architectures - Providing technical leadership throughout the project lifecycle … deliver robust, scalable solutions across Agile environments Skills & Experience: - Enterprise Data Architecture - Data Warehousing, Data Lakes and Lakehouse solutions - Data Modelling and Data Governance - ETL/ELT Architecture - Cloud platforms (Azure, AWS or GCP) - Relational and NoSQL databases - Data Virtualisation - Analytics and BI platforms (Power BI, SAS, R or similar ...

delivery of data migration and integration initiatives. Key Responsibilities Design and deliver enterprise-scale data migration solutions and payload architectures. Build and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF). Develop Change Data Capture (CDC) solutions to support incremental and delta data loads. Create data transformation … Azure Data Factory (ADF). Advanced Python and PySpark development skills. Strong SQL and T-SQL scripting experience. Experience designing and implementing large-scale ETL/ELT pipelines. Experience with Change Data Capture (CDC) and data migration frameworks. Knowledge of Azure Data Lake Storage (ADLS) and Azure SQL Database. Experience ...