22 of 22 ETL Jobs in the East of England

patterns Data processing: Apache Spark, SQL and distributed processing technologies Data storage: Delta Lake, Apache Iceberg and open table formats Data pipelines: Enterprise-scale ETL/ELT, batch and streaming patterns Transformation and quality: dbt, Great Expectations and equivalent tooling Orchestration: Apache Airflow and cloud-native orchestration services Event streaming ...

semantic model design.Strong analytical, problem-solving and data-validation skills.Ability to manage competing priorities and work independently.DesirableMicrosoft Fabric.Databricks/Azure Data Services.SQL.Data warehousing and ETL/ELT.Row-Level Security.Power Automate or wider Microsoft Power Platform experience.About The Company:OCS UK & Ireland is a leading facilities management company with 50,000+ ...

certifications in Azure, Power BI, data, or AI architecture. Core Technology Stack Data platform : Azure Data Factory, Databricks, Azure data lake, SQL, dimensional modeling, ETL/ELT, orchestration. AI platform : Azure OpenAI, Azure AI Foundry, Azure AI Search, Copilot Studio, Semantic Kernel, Prompt Flow. Analytics : Power BI, semantic models ...

information from multiple systems into trusted, business-critical insights. Key Responsibilities Design and deliver end-to-end data engineering solutions Build and maintain scalable ETL/ELT and streaming data pipelines Develop and optimise data platforms, warehouses, lakehouses, and reporting solutions Create Power BI dashboards and analytics to support business ...

role and we'll be in touch. This role may suit candidates who have held roles including: Azure Data Engineer, BI Developer, Analytics Engineer, ETL Developer, Data Platform Engineer, SQL Developer, Python Developer Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every ...

then turning them into a governed, value-generating asset.Key ResponsibilitiesCapture needs and deliver end-to-end data solutions across technical and business domains.Build scalable ETL/ELT and streaming pipelines from simulators, HIL/SIL benches, MES/SCADA, ERP, and PLM.Architect data lakes, warehouses, lakehouses, and time-series stores.Develop ...

experience, would be effective, although practical experience is equally valuable.“Nice to Have”Azure, Databricks, Apache Spark or comparable cloud and data platforms.Data pipelines, ETL and workflow-orchestration technologies.Machine-learning methods such as forecasting, prediction or classification.Experience with enterprise platforms such as Salesforce, SAP, ServiceNow or Celonis.Experience developing scalable, user ...

backend or data engineering foundationHands-on experience with containerisation and orchestration (Docker, Kubernetes), and working with a major cloud providerExperience building data pipelines and ETL/ELT processes at scale, including web scraping or automated data collectionA solid understanding of the ML lifecycle, from data through to model training, evaluation ...

teams to influence data strategy and architecture. Required Experience Strong hands-on experience building and operating production-grade data platforms. Expertise in data architecture, ETL/ELT pipelines, data modelling and orchestration. Experience working with large-scale or complex datasets. Background delivering analytics and business intelligence solutions. Experience designing secure ...

design and maintenance of our scientific ontology, ensuring efficient data storage, retrieval, domain coverage, and integration with our software platformPipeline Development: Implement ETL pipelines for ingesting, cleaning, and transforming scientific datasets from multiple sourcesData Analysis and Modeling: Apply statistical and machine learning techniques to analyse scientific data, identify trends, and ...

that provide actionable insight to senior leaders across the business. Act as the senior technical authority, providing hands-on expertise across data modelling, DAX, ETL pipelines, SQL and analytics architecture. Collaborate with stakeholders at all levels to understand business challenges and deliver data solutions that create measurable value. Drive innovation … experience leading Data & Analytics functions and developing high-performing teams. Expert-level knowledge of Power BI, DAX, Power Query, Microsoft Fabric, Databricks, SQL and ETL/data pipeline technologies. Strong experience in data governance, data quality and Master Data Management (MDM). A track record of delivering enterprise-scale data ...

deliver reliable data migration, transformation and integration solutions. Role Overview: Develop and deliver data migration and integration solutions across multiple systems. Extract, transform and load data from legacy applications into a modern cloud-based platform. Develop and optimise complex SQL queries, scripts and transformation processes. Build and maintain reliable data … Python and T-SQL expertise , including data transformation and performance optimisation. Hands-on experience with Microsoft Azure and Azure SQL . Strong understanding of ETL processes, data mapping, validation and reconciliation. Experience integrating data across multiple applications and data sources Knowledge of Azure DevOps, repositories and CI/CD pipelines. ...

and/or ArcGIS Online. Experience in GIS data management, modelling, validation, transformation and quality assurance. Practical experience using FME (Safe Software) or equivalent ETL tools. Good knowledge of spatial data formats, GIS databases, coordinate systems and data conversion. Experience managing large volumes of geospatial data and maintaining data quality ...

learn into practice and build confidence along the way. What you’ll learn: Technical Skills Coding fundamentals (Python, SQL) Data modelling and data warehousing Extract-Transform-Load (ETL) Creating data pipelines Ethics in data and AI Cloud and big data technologies (AWS, Snowflake, PySpark) Working with unstructured data Working with … multinational insurance company, based in Norwich. In your role, you will be working in a multi-cloud environment, building data pipelines, handling ETL development and ensuring data quality for predictive analytics, pricing and operations. You’ll work alongside experienced data scientists, analysts and business stakeholders to ensure high-quality, well ...

that link project outputs to the organisation's strategic objectives. Role specific skills Full-Stack Analytics Engineering: Mastery of the lifecycle from data ingestion (ETL/ELT) to front-end visualization. Business Systems Analysis: Ability to map technical project metadata to financial value metrics. Stakeholder Communication: Experience in translating technical … and delivery of data engineering solutions. Experience in supporting large change projects/programmes covering digital transformation and multiple technology architecture domais. Experience with ETL tools, scripts, and data storage methods (Data Warehousing/Data Lakes) used for performance analytics. Experience with cloud technologies such as SaaS, IaaS, PaaS etc. ...

them into a governed, value-generating asset. Key ResponsibilitiesCapture needs and deliver end-to-end data solutions across technical and business domains. Build scalable ETL/ELT and streaming pipelines from simulators, HIL/SIL benches, MES/SCADA, ERP, and PLM.Architect data lakes, warehouses, lakehouses, and time-series stores. … Container as a Service - integration model on hybrid/on-prem environments. Hard SkillsExperience in data engineering, ideally aerospace/defence or industrial sectors. ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka).Strong Python and SQL; C++, C#, or MATLAB a plus. Databases: PostgreSQL, SQL Server, Oracle ...

asset. Location: Stevenage or Bolton Typical responsibilities include: * Capturing needs and delivering end-to-end data solutions across technical and business domains. * Building scalable ETL/ELT and streaming pipelines from simulators, HIL/SIL benches, MES/SCADA, ERP, and PLM. * Developing Power BI analytics for self-service … integration model on hybrid/on-prem environments. The ideal candidate will have: * Experience in data engineering, ideally aerospace/defence or industrial sectors. * ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka). * Strong Python and SQL; C++, C#, or MATLAB a plus. * Databases: PostgreSQL, SQL Server ...

consume the data, but building dashboards and reports is not the focus of this position. Key Responsibilities Design, build and maintain robust ELT/ETL pipelines that load data into Snowflake from REST APIs, databases, flat files (CSV/JSON) and third-party platforms. Develop Python-based ingestion, automation and … ETL scripts, including API integrations and scheduled jobs. Configure and manage managed or open-source connectors using Fivetran and/or Meltano/Singer (or comparable tooling). Write and optimise advanced SQL in Snowflake, including transformations, performance tuning and data modelling. Implement pipeline monitoring, logging, alerting and error handling ...

sources, load it reliably into Snowflake, and make sure it is fresh, monitored and trustworthy. Key Responsibilities Design, build and maintain robust ELT/ETL pipelines that load data into Snowflake from REST APIs, databases, flat files (CSV/JSON) and third-party platforms. Develop Python-based ingestion, automation and … ETL scripts, including API integrations and scheduled jobs. Configure and manage managed or open-source connectors using Fivetran and/or Meltano/Singer (or comparable tooling). Write and optimise advanced SQL in Snowflake, including transformations, performance tuning and data modelling. Implement pipeline monitoring, logging, alerting and error handling ...

This is not a paper-architect role. The successful candidate will pick up an in-flight, multi-year programme to decouple and replatform the ETL processes that sit behind every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake …/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. · Hands-on T-SQL, stored procedure, ETL framework and PowerShell development at expert level — partition design and partition-aligned indexing, clustered/nonclustered index strategy, deduplication, parallel-run cutovers, schema migration, performance ...

with solid experience with programming languages like PythonExperience working with cloud platforms (e.g., Azure, GCP) and big data technologies like SparkWorking knowledge of ETL and ELT frameworks and tools like dbtExperience using AI/GenAI capabilities to support analytics, data exploration or insight generation. Familiarity with AI platforms and tools … with solid experience with programming languages like PythonExperience working with cloud platforms (e.g., Azure, GCP) and big data technologies like SparkWorking knowledge of ETL and ELT frameworks and tools like dbtExperience using AI/GenAI capabilities to support analytics, data exploration or insight generation. Familiarity with AI platforms and tools ...

well as with local Data Stewards to ensure alignment and readiness for data migration activities. - Lead the execution of Data Extraction, Transformation, and Loading (ETL) processes, ensuring data is accurately extracted, transformed, and loaded into the SAP system. - Continuously monitor migration activities to ensure they are proceeding according to plan … data to confirm accuracy and completeness in the new system environment. - Ensure adequate documentation of the data migration process, including extraction, transformation, and loading (ETL) according to compliance and audit standards Responsibilities - Responsible for the successful execution of data migration within respective cluster - Accountable for setting data object scope, ownership ...