126 to 150 of 402 ETL Jobs in the UK

and automation. Define Data Mesh principles, domain ownership models, governance, metadata management, and interoperability standards. Establish integration architecture across Snowflake, Kafka, cloud platforms, APIs, ETL/ELT, and downstream systems. Collaborate with business and engineering teams to enable scalable data products. Required Multiple years in Platform Engineering, Cloud, Integration ...

core of advanced AI systems. Key Responsibilities Design, build and optimise scalable cloud-based data platforms and pipelines within AWS. Develop robust ETL and ELT processes capable of handling high-volume and complex datasets. Design and manage data models, schema structures and data reconciliation processes across multiple source systems. Build ...

large-scale data processing solutions and deploying into a production environment. Proficient in SQL and SQL extensions for analytical queries. Solid understanding of ETL/ELT data processing pipelines and design patterns. Aware of key features and pitfalls of distributed data processing frameworks, data stores, and data serialisation formats. Able ...

Server Management Studio - Strong hands-on experience in core SQL Server database development, with a background focused on database development and not primarily on ETL, SSIS, or similar data integration tooling - Experience using Azure DevOps to support database version control, deployment, and release processes - Strong analytical and problem-solving skills ...

integration, data platforms and AI-enabled products and services within a complex enterprise environment. Strong understanding of modern data engineering practices, including data pipelines, ETL/ELT, data modelling, data governance, security, privacy and access management. Experience working with data platforms and technologies such as Snowflake, SQL-based data environments ...

solutions that drive decision-making across the organisation. You'll be involved in migrating and modernising existing data workloads into Microsoft Fabric, developing robust ETL/ELT processes, integrating Dynamics 365 and Dataverse data, and ensuring the quality, accuracy, and reliability of data throughout the transformation journey. The role offers … data architecture. Key Responsibilities Design, develop, and maintain data pipelines within Microsoft Fabric Build and manage Lakehouses, Notebooks, and data integration workflows Develop efficient ETL/ELT processes to ingest, transform, and deliver data across the business Support the migration of legacy data platforms into Microsoft Fabric Work closely with ...

excellent opportunity to join a forward-thinking organisation investing heavily in its Microsoft data ecosystem and cloud technologies. Responsibilities: Design, build and maintain scalable ETL/ELT data pipelines Develop and optimise cloud-based data solutions Build and maintain Azure Data Factory pipelines Work with Azure SQL, Synapse Analytics and … development skills Commercial Python experience Hands-on experience with Azure Data Factory (ADF) Experience working with Microsoft Azure data services Strong understanding of ETL/ELT processes Experience designing and maintaining data pipelines Knowledge of data warehousing concepts and data modelling Experience using Git/version control Strong communication skills ...

Microsoft technology stack, including: Microsoft Fabric (Lakehouse, Warehouse & OneLake) Azure Data Factory Azure Data Lake Azure Synapse Analytics SQL Server & advanced SQL development Enterprise ETL/ELT pipelines Power BI semantic models and reporting API integrations across internal and third-party platforms Azure DevOps and CI/CD Modern cloud … across modern Azure data technologies. You'll ideally bring experience in: Microsoft Fabric Azure Data Factory Azure Synapse Analytics Azure Data Lake SQL Server ETL/ELT design API integration Azure DevOps Git Power BI data modelling Cloud-native data engineering AI Experience One of the key areas of growth ...

data processing solutions using PySpark, Python and SQL with a focus on performance, resilience, testing and observability. Lead the migration and modernisation of legacy ETL and reporting workloads into cloud-native architectures. Develop reusable data engineering components and shared frameworks. Build and optimise data transformations and models supporting Management Information … large-scale data processing. Experience building and maintaining enterprise-scale batch data pipelines. Strong understanding of cloud-native data engineering architectures. Experience modernising legacy ETL platforms and migrating workloads to AWS. Experience implementing CI/CD pipelines, Infrastructure as Code (Terraform) and automated testing. Strong knowledge of Git/GitLab ...

data scientists and consultants on projects tackling real-world challenges. From a technical perspective, we're looking for someone comfortable with: Building and maintaining ETL pipelines and integrations Working with SQL and Python ( R is a bonus) Experience working with AWS or Azure Supporting analytical workflows and collaborating with data ...

Reporting tools: Aqua scan, Checkmarks, SonarQube, Datadog, Soda, SSRS, etc. Cloud: Azure, AWS (S3) basic Others: REST APIs, ElasticSearch, New Relic, CI/CD, ETL, Swagger, Postman, Rancher, Data Analytics, ML Models, GitHub Copilot, Jira and Confluence. Need Hands on AI skills. Key Responsibilities Full Stack Development: Build and maintain ...

data validation and investigation Experience with data profiling, reconciliation, and quality assessments Proven track record of root cause analysis and remediation Understanding of ETL processes and Data Warehouse environments Experience defining data quality metrics, KPIs, and dashboards Knowledge of Data Governance and Data Stewardship practices Exposure to Azure Purview, Collibra ...

supporting SaaS applications. Knowledge of SQL Server performance tuning and indexing. Experience with Power BI or other reporting platforms. Experience with APIs, integrations or ETL processes. Familiarity with source control and change management processes. Knowledge of workforce management, compliance or operational software. This is a great time to join ...

where appropriate. Prepare datasets for inclusion in PBI reports. What we are looking for Strong understanding of the principles of database systems, data warehouses, ETL processes, APIs and data analytics. The resilience to deal with and work around the limitations of Legacy systems, and to adapt as systems change. Excellent ...

where appropriate. Prepare datasets for inclusion in PBI reports. What we are looking for Strong understanding of the principles of database systems, data warehouses, ETL processes, APIs and data analytics. The resilience to deal with and work around the limitations of legacy systems, and to adapt as systems change. Excellent ...

Large Language Models (LLMs). Familiarity with MCP frameworks and AI orchestration concepts. Experience testing and evaluating AI systems. Data & SQL Understanding of ETL concepts. Understanding of Data Warehouse architectures. Basic to intermediate SQL capability. Experience working with data integration patterns. DevOps & Release Management Experience implementing CI/CD pipelines. ...

complex environments Expertise in data architecture frameworks and best practices Experience with Azure/AWS/GCP data platforms Solid background in data warehousing, ETL/ELT, and big data technologies Strong knowledge of data governance, security, and compliance Excellent communication and stakeholder management skills Mandatory Criteria Active SC clearance ...

Data Engineer Hands-on experience with Microsoft Fabric Experience with Azure Strong SQL skills Experience using Python, ideally PySpark Experience building and maintaining ETL or ELT pipelines Experience working directly with stakeholders Ability to gather requirements and translate them into technical solutions Experience with KQL, Synapse or Databricks would ...

data management tools (e.g., Collibra, Alation, Informatica). Strong analytical skills (SQL, Excel; Python is a plus). Understanding of data architecture, lineage, and ETL processes. Soft Skills Excellent stakeholder and communication skills. Ability to drive change across global, matrixed organizations. Strong problem-solving and structured thinking. ...

architecture frameworks and methodologies (e.g. TOGAF, Zachman) Broad knowledge of enterprise data technologies, including lakehouse and medallion architectures, legacy data platforms and data engineering (ETL, ELT, CDC) Experience working within large, complex or highly regulated organisations In return, you can expect a flexible working culture, including: Non-contributory career-average ...

architecture frameworks and methodologies (e.g. TOGAF, Zachman) Broad knowledge of enterprise data technologies, including lakehouse and medallion architectures, legacy data platforms and data engineering (ETL, ELT, CDC) Experience working within large, complex or highly regulated organisations In return, you can expect a flexible working culture, including: Non-contributory career-average ...

best solutions for the future state architecture Knowledge of some Data Management technologies such as Relational and Columnar Databases, and/or Data Integration (ETL) or API development. Knowledge of some Data Formats such as JSON, XML, and binary formats such as Avro or Google Protocol Buffers. Experience collaborating with ...

supporting large‐scale transformation programmes with multiple parallel workstreams Technical Skills Experience working with modern data platforms such as Snowflake Experience of ELT/ETL Strong understanding of analytics and reporting tooling (e.g. Power BI) Solid grounding in data integration patterns and data pipeline design Desirable Exposure to data governance ...

modern data engineering technologies Practical experience developing Production‐scale Cloud‐native data engineering solutions in commercial environments Familiarity with Cloud Data engineering services (e.g., ETL, Glue, S3, Athena) and MLOps stack Demonstrated experience leading effective use of enterprise‐authorized AI‐assisted software development tools within the work environment (e.g. ...

perspective will lie with the Technical Product Owner. Data Platform Ownership Coordinate the delivery and maintenance of:Data Warehouse Management (Snowflake), Batch & Real-Time ETL Pipelines Ensure all data pipelines are reliable, performant, and aligned with defined SLAs. Advocate for data quality, consistency, and documentation across the DE ecosystem. Collaboration ...