76 to 100 of 344 ETL Jobs in the UK

data ecosystems, including lakehouse, data warehouse and hybrid architectures Provide technical leadership across data engineering, analytics and AI transformation programmes Design scalable data pipelines, ETL/ELT frameworks and integration patterns Shape architecture decisions across technologies including Microsoft Fabric, Azure Databricks, Azure Synapse Analytics and Azure Data Factory Define data … Microsoft Fabric Azure Databricks Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Strong understanding of modern data engineering concepts including: Data pipelines ETL/ELT frameworks Data ingestion patterns Data processing architectures Lakehouse approaches Experience designing enterprise data models and warehousing solutions Strong understanding of cloud data architecture ...

Data Technologies: Azure Data Factory (ADF), Azure Databricks, Azure Data Lake (ADLS), Azure SQL, Azure Synapse Analytics and Azure PaaS. Data Engineering: data ingestion, ETL/ELT, transformation, integration, SQL, Python and/or PySpark. Platform Engineering: Azure DevOps, CI/CD, monitoring, performance optimisation, security, governance and cost optimisation. … Architecture, Data Engineering, Microsoft Azure, Azure Data Factory, ADF, Azure Databricks, Databricks, Azure Data Lake, ADLS, Azure SQL, Azure Synapse, Synapse Analytics, Azure PaaS, ETL, ELT, Data Pipelines, Data Integration, SQL, Python, PySpark, Azure DevOps, CI/CD, Data Governance, Data Quality, Cloud Security, Microsoft Fabric, Power BI, Power Platform. ...

meet deadlines. Excellent stakeholder management and communication skills, with the confidence to work across different business functions. Experience with SQL, VBA, data warehousing or ETL concepts would be advantageous. A continuous improvement mindset and a genuine interest in using data to create business value. What ...

Skills & Experience: Experience as a Data Engineer, Data Developer or similar . Strong Python and SQL skills. Commercial Databricks experience. Experience with data pipelines, ETL/ELT or data processing. Understanding of cloud data engineering. Active SC or DV Clearance Desirable: AWS, Google Cloud, Defence/Central Government, large-scale ...

networking concepts. Exceptional communication and stakeholder management skills, with the ability to challenge and influence senior stakeholders. Desirable: Experience designing and implementing data pipelines, ETL/ELT processes, and real-time streaming solutions. Experience integrating AI into products and/or platforms is advantageous. ...

Star Schema Data Modelling Market Data integration and management Time-Series Data engineering and modelling Dbt (Data Build Tool) Claude Code Data warehousing and ETL/ELT development SQL and performance optimisation Cloud-based data engineering experience Highly Desirable Experience Wealth Management or Private Banking experience Investment Management platforms and ...

Lead Data Engineer. Deep expertise in Databricks, Spark, Delta Lake, Python and SQL. Experience designing and scaling cloud-based data platforms. Strong knowledge of ETL/ELT, data modelling and distributed processing. Experience with Azure, AWS or GCP environments. Previous team leadership or mentoring experience. Strong stakeholder management and communication ...

Experience migrating relational SQL databases into a document-oriented NoSQL platform such as Cosmos DB, MongoDB, DynamoDB or Couchbase. Strong understanding of data modelling, ETL/ELT and transformation methodologies. Familiarity with Microsoft Azure or comparable cloud data services. Strong communication and stakeholder-engagement skills. Previous experience as a Database ...

Databricks experience (DLT, Delta Lake, Unity Catalog governance) Solid grasp of streaming technologies (Spark Structured Streaming, Autoloader) Python, SQL, or Scala proficiency Experience with ETL/ELT, data modelling, and data architecture Azure cloud experience With a focus within Energy Trading, Oil & Gas, Financial Markets and Commodities, we offer ...

Looking For Strong Databricks and cloud data platform experience Expertise in SQL and working knowledge of Python. Knowledge of data modelling and ETL/ELT best practices. Experience migrating Oracle or legacy platforms. Understanding of CI/CD, Git and orchestration tools. Why Join Us? Be part of a major ...

Lambda for serverless processing. Familiarity with Kafka concepts (producers, consumers, topics) and ability to integrate with streaming data pipelines. Solid understanding of data modelling , ETL/ELT processes, and performance optimization. Programming & Engineering Skills Proficiency in Python for data engineering tasks and automation. Ability to design and implement scalable, maintainable ...

Data ecosystem including Microsoft Fabric, Azure Data Factory, Synapse Analytics, Azure SQL and Power BI Experience designing modern data architecture including Lakehouse, Data Mesh, ETL and Master Data Management approaches Understanding of AI technologies including Machine Learning, Generative AI and Responsible AI practices Experience delivering solutions within Agile environments Excellent ...

pipelines, process billions of market data records, and deliver reliable, production-quality datasets for research, analytics and real-time applications. Key Responsibilities Build scalable ETL/ELT pipelines for batch and streaming market data. Develop production-grade Python and SQL solutions. Ingest, normalise and validate market data, including trades, ticks ...

pipelines, process billions of market data records, and deliver reliable, production-quality datasets for research, analytics and real-time applications. Key Responsibilities Build scalable ETL/ELT pipelines for batch and streaming market data. Develop production-grade Python and SQL solutions. Ingest, normalise and validate market data, including trades, ticks ...

ambitious growth strategy, a people-first culture, and a genuine commitment to professional development and innovation. You Will Work With Designing and building scalable ETL/ELT data pipelines. Microsoft Fabric, including Data Factory, Dataflow Gen2 and Fabric Notebooks. Databricks Workflows and Lakehouse technologies. PySpark, SQL and Delta Lake environments. ...

target operating platform - working closely with the Data Workstream Lead, business SMEs, and application teams. What you'll be doing: Designing and building ETL/ingestion pipelines using Microsoft Fabric (Data Factory, Pipelines, Lakehouse, Notebooks) or equivalent Azure tooling Implementing source-to-target mappings and transformation logic for the migration ...

Kafka, Flink, Spark Solid understanding of stream processing concepts Understanding of software engineering best practices: testing, design patterns, CI/CD, Git. Experience building ETL/ELT or streaming data pipelines. Exposure to microservices and distributed system concepts. Experience working with cloud platforms Understanding of distributed compute, large-scale data ...

well as platforms such as Databricks and Snowflake; exposure to Azure or GCP is beneficial A good understanding of modern data engineering patterns including ETL/ELT, data lakes, lakehouse, and warehousing architectures Expopsure to data governance frameworks, metadata management, and regulatory complianc It would be a bonus ...

Data Engineer within production environments. Strong hands-on experience with Databricks, Apache Spark, Delta Lake, Python, and SQL. Experience building and supporting scalable ETL/ELT pipelines. Strong understanding of distributed data processing and data modelling. Cloud platform experience across Azure, AWS, or GCP. Experience implementing data quality frameworks and ...

analytics Proven experience defining and executing data strategies in complex organisations Strong expertise in cloud-based data platforms (AWS preferred) Experience with modern ETL/ELT tools and data pipeline frameworks Solid understanding of data modelling, warehousing, and transformation best practices Experience across the data science/ML life cycle ...

years' experience working with Looker or a similar modern BI platform. Strong knowledge of version control and collaborative development practices. Experience with SQL-based ETL/ELT frameworks and workflow orchestration tools. Python development skills for automation, integrations, or data engineering tasks. Experience consuming or integrating with APIs, ideally ...

support Pragmatic approach to balancing technical delivery with business needs Desirable Python experience for infrastructure automation and tooling Familiarity with data pipeline infrastructure (supporting ETL workloads, data warehousing) and experience with Snowflake or a comparable cloud data warehouse Experience with data governance and compliance requirements Cloud cost and resource utilisation ...

Code (IaC) and CI/CD practices. Good understanding of Test-Driven Development (TDD) and software testing best practices. Experience designing and implementing ETL processes, both within and outside AWS. Desirable Experience Experience working within Agile teams using Jira. Knowledge of Java and/or C++. Experience with Microsoft Azure ...

and a BI tool (e.g. Data Studio, Tableau, Power BI) in a data, analytics, or marketing operations role Experience with a data integration/ETL tool (Adverity experience ideal, but Supermetrics, Funnel, or Fivetran experience is transferable) Experience building and maintaining dashboards in Data Studio (or a similar BI tool ...

foster user engagement through training , workshops, and user-friendly documentation. AI/ML Program Exposure: Experience delivery-managing data pipeline readiness, ELT/ETL architectures, and data preparation specifically geared toward AI model integration Technical Fluency: A strong conceptual understanding of modern data ecosystems, data warehousing, pipeline orchestration tools (e.g. ...