1 to 25 of 69 ETL Jobs in the West Midlands

ensuring compliance with data quality standards, security policies, and regulatory requirements Data Management: Oversee the management of data sources, including extraction, transformation, and loading (ETL) processes into BI Tools to ensure data integrity and availability for reporting Documentation: Maintain detailed documentation of data sources, processes, and governance procedures to promote ...

standardisation: Experience in resolving data quality issues and ensuring data accuracy through cleansing and standardisation techniques. Use of data integration tools: Skilled in using ETL tools for data integration and storage. Ensures data interoperability with other datasets. Collaboration with data professionals: Experience collaborating with other data professionals to improve modelling ...

standardisation: Experience in resolving data quality issues and ensuring data accuracy through cleansing and standardisation techniques. Use of data integration tools: Skilled in using ETL tools for data integration and storage. Ensures data interoperability with other datasets. Collaboration with data professionals: Experience collaborating with other data professionals to improve modelling ...

standardisation: Experience in resolving data quality issues and ensuring data accuracy through cleansing and standardisation techniques. Use of data integration tools: Skilled in using ETL tools for data integration and storage. Ensures data interoperability with other datasets. Collaboration with data professionals: Experience collaborating with other data professionals to improve modelling ...

and/or data warehouses Good understanding of DevOps pipelines, CI/CD, and version control (Git). Proven experience supporting data pipelines and ETL processes in production. Working knowledge of Agile methodologies (Scrum, Kanban). Strong analytical and troubleshooting skills. Reasonable Adjustments: Respect and equality are core values ...

this position. Key Skills & Responsibilities: Build and manage pipelines using Azure Data Factory, Databricks, CI/CD, and Terraform. Optimisation of ETL processes for performance and cost-efficiency. Design scalable data models aligned with business needs. Azure data solutions for efficient data storage and retrieval. Ensure compliance with data protection ...

translate business requirements into robust technical architectures, ensuring best practices in data governance, security, and performance. Key Responsibilities Design and optimise data pipelines and ETL processes using Azure Data Factory and Databricks. Develop and maintain data models, transformations, and integrations across multiple systems. Collaborate with client teams to deliver high ...

translate business requirements into robust technical architectures, ensuring best practices in data governance, security, and performance. Key Responsibilities Design and optimise data pipelines and ETL processes using Azure Data Factory and Databricks. Develop and maintain data models, transformations, and integrations across multiple systems. Collaborate with client teams to deliver high ...

and creating data models that suit different organisational need Desirable Skills IBM DB2/QREP BMC Control-M Experience of Talend Data Integration (e.g. ETL build and deployment using Talend Cloud. Experience of leadership Experience of metadata management Experience of testing Location Expectation is to be working from ...

Ontology & Application Design: Create and manage Ontology Objects, Links, and Actions to support downstream applications and workflows. Pipeline Development & Automation: Build scalable, fault-tolerant ETL/ELT pipelines using PySpark, SQL, and Foundry's proprietary tools like Pipeline Builder and Code Workbook. Productization & Scaling: Create Prototypes and Convert them into ...

. Solid Power BI capability - DAX, modelling, performance. Practical exposure to Dynamics 365 F&O/Supply Chain data structures and processes. Understanding of ETL/integration best practise. Ability to work independently in a fast-moving environment and communicate clearly with stakeholders. Nice to Have Familiarity with wider data ...

Build and optimise data pipelines , databases and cloud data platforms. Develop AZure Data Factory/Fabric Data Factory pipelines and robust ETL/ELT processes. Work with SQL, APIs, event streams and diverse data formats. Contribute to solutions across data warehouses, lakes, lakehouses and semantic models . Ensure best practice ...

data models that effectively represent business entities and relationships and support efficient querying and analysis from relational data warehouses. Experience building and maintaining reliable ETL pipelines to integrate data from diverse sources. Strong Python expertise, including development of clean, reusable functions and object-oriented code for production-quality solutions. Solid ...

complex business problems and designing workable technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company ...

Troubleshooting and resolving data-related issues to keep things running smoothly. What we're looking for: Strong understanding of data engineering principles, Lakehouse architecture, ETL/ELT, warehousing, and stream processing. Hands-on experience with Azure Databricks, Python/PySpark, SQL Server, and Azure Blob Storage. A track record ...

and CSV formats. Perform testing on graph database management systems (GDBMS). Implement testing strategies for Policy as Code and GitOps repositories. Conduct Batch ETL testing, Pub/Sub and message queue testing, and SaaS testing. Mentor junior engineers and supported knowledge-sharing across the team. Integrate automation testing into ...

products that are actionable and scalable.• Expertise of using Spark, Dremio, Teradata or other SQL technologies.• Strong knowledge and experience of using business intelligence, ETL frameworks and visualisation tools such as Tableau.• Experience with Python, GitHub, data orchestration tools (Oozie, Airflow) for data wrangling, building data pipelines and building analytical ...

products that are actionable and scalable.• Expertise of using Spark, Dremio, Teradata or other SQL technologies.• Strong knowledge and experience of using business intelligence, ETL frameworks and visualisation tools such as Tableau.• Experience with Python, GitHub, data orchestration tools (Oozie, Airflow) for data wrangling, building data pipelines and building analytical ...

reliability and operation of the data warehouse Profile Essential criteria: Proven experience in managing data warehouses and data integration projects. Extensive experience designing ETL/ELT data pipelines Strong understanding of cloud-based data architectures. Experience with agile project management and system integration. Excellent leadership and team management skills - including ...

reliability and operation of the data warehouse Profile Essential criteria: Proven experience in managing data warehouses and data integration projects. Extensive experience designing ETL/ELT data pipelines Strong understanding of cloud-based data architectures. Experience with agile project management and system integration. Excellent leadership and team management skills - including ...

that connect operational systems and provide data for analytics and BI. Help re-engineer manual processes into scalable, repeatable data pipelines and write optimised ETL code. Contribute to building data streaming capabilities and creating accessible data products for analysis. Improve data quality, document data mappings, and identify opportunities to optimise ...

practice (e.g., source-to-target mappings, coding standards, data quality, etc.), working closely with the external party who setup the environment Create and maintain ETL processes, data mappings & transformations to orchestrate data integrations. Ensure data integrity, quality, privacy, and security across systems, in line with client and regulatory requirements Optimise … data engineering role, ideally as a senior or lead engineer. Strong, hands-on experience of Azure Data Factory for managing and orchestrating ETL processes Experience with Microsoft Fabric Products Strong SQL experience, including SQL queries and stored procedures, and formal database design methodologies Experience in setting up monitoring and data ...

more Cloud platforms such as Microsoft Azure, AWS, Google Cloud is a plus Familiarity with the application of automation and data technologies (e.g. RPA, ETL tools, visual analytics) Formal project management training certification (e.g. PMP, PRINCE2, MSP) or process improvement certification (e.g. Six Sigma 'belt') is preferred What We Offer ...

would work as a member of a highly focused team. This team specialises in Java-based data engineering, designing and delivering large-scale ETL workflows on a lake house platform. You'll be working with modern big data technologies to move, transform, and optimise data for high-performance analytics and ...

data engineering and AI/ML tooling, workflows, and trends in enterprise setting Proficiency in Python, Spark, and/or SQL with experience developing ETL applications Excellent communication and presentation skills, with comfort in objection handling Hands-on experience with AWS, and other cloud providers Databricks and/or Snowflake ...