1 to 25 of 31 ETL Jobs in the East of England

patterns Data processing: Apache Spark, SQL and distributed processing technologies Data storage: Delta Lake, Apache Iceberg and open table formats Data pipelines: Enterprise-scale ETL/ELT, batch and streaming patterns Transformation and quality: dbt, Great Expectations and equivalent tooling Orchestration: Apache Airflow and cloud-native orchestration services Event streaming ...

data governance, quality, security and operational best practice within production environments. Experience with DevOps, CI/CD practices, Fabric capacity management, or decommissioning legacy ETL tooling such as SSIS or KingswaySoft would be advantageous. If you're looking for a role where you can combine deep technical expertise with genuine ...

foundations, architecting and implementing scalable, reliable end-to-end data solutions using Azure/Microsoft Fabric services, covering data lakes, data warehouses, and ETL/ELT pipelines. Leadership and line management of data/AI architecture and platform team driving a high performance, accountability, innovation and the latest technology ...

dashboard development KPI design and analytics Preferred: Google AppSheet Google Apps Script BigQuery Looker Studio Remedy CMDB Microsoft Power Platform Power BI Python JavaScript ETL/Data Integration tools CMDB/ITSM Knowledge ITIL Foundation or equivalent knowledge Configuration Management processes Asset Management Service Mapping Discovery tools Data Governance ServiceNow ...

data policies. Technical & Business Skills: Data Architect: Expert proficiency in cloud data platforms (e.g. Snowflake, AWS, Azure). Deep expertise in data integration patterns (ETL/ELT, API‐led connectivity). Strong capability to design distributed, highly available, and secure data pipelines. Information Architect: Deep expertise in metadata management, master ...

solution architecture. Strong hands-onexperience with Databricks Platform . Expert knowledge of: Apache Spark PySpark/Scala Delta Lake SQL Data Lakehouse architecture ETL/ELT development Experience designing anddelivering enterprise Databrickssolutions. Strong experience withcloud platforms: Azure Databricks (preferred) AWS Databricks Google Cloud Databricks Experience with: Databricks Workflows Jobs orchestration ...

APIs, integrations and data pipelines Good understanding of data architecture, data warehousing and cloud data platforms Hands-on experience with Azure technologies Experience developing ETL/ELT solutions Experience with Python, PySpark, Microsoft Fabric, streaming technologies or large-scale enterprise environments would be advantageous. In return they are offering ...

would be effective, although practical experience is equally valuable."Nice to Have"Azure, Databricks, Apache Spark or comparable cloud and data platforms. Data pipelines, ETL and workflow-orchestration technologies. Machine-learning methods such as forecasting, prediction or classification. Experience with enterprise platforms such as Salesforce, SAP, ServiceNow or Celonis. Experience ...

Improve data reliability, coverage, traceability and timeliness. Essential Criteria Data engineering and analytics expertise. Experience with Power BI and Databricks. Strong data modelling and ETL skills. Understanding of cyber security technologies and security data sources. This role has been deemed Inside IR35 by the client. Applicants must hold ...

Proven experience in Power BI development and data visualization- Strong skills in DAX, SQL, and data modeling techniques- Understanding of data warehousing concepts and ETL processes- Ability to communicate complex data insights effectively to diverse audiences- Experience in project management and a collaborative mindsetThis role presents an exciting opportunity ...

data engineering foundation Hands-on experience with containerisation and orchestration (Docker, Kubernetes), and working with a major cloud provider Experience building data pipelines and ETL/ELT processes at scale, including web scraping or automated data collection A solid understanding of the ML lifecycle, from data through to model training ...

better use of modern Microsoft-based data and integration technologies. Design, develop and maintain automated data integrations between business applications. Build, support and optimise ETL/ELT processes and automated data pipelines. Develop automation solutions using APIs, scheduled processes and event-driven workflows. Monitor, troubleshoot and optimise data automation processes … years’ experience in Data Engineering, Integration Engineering, Automation Engineering or a similar role. Strong SQL Server and T-SQL skills. Experience developing ETL/ELT processes and data pipelines. Experience with APIs, integrations and data exchange technologies. Experience using Microsoft Azure services. Experience with Microsoft Fabric or similar cloud data ...

better use of modern Microsoft-based data and integration technologies. Design, develop and maintain automated data integrations between business applications. Build, support and optimise ETL/ELT processes and automated data pipelines. Develop automation solutions using APIs, scheduled processes and event-driven workflows. Monitor, troubleshoot and optimise data automation processes … years' experience in Data Engineering, Integration Engineering, Automation Engineering or a similar role. Strong SQL Server and T-SQL skills. Experience developing ETL/ELT processes and data pipelines. Experience with APIs, integrations and data exchange technologies. Experience using Microsoft Azure services. Experience with Microsoft Fabric or similar cloud data ...

reporting, and insight generation using DOMO and modern data science tools. Design and develop DOMO dashboards (live and scheduled) to deliver meaningful business insights. Extract and integrate data from Pega applications, Adobe platforms, SaaS systems, APIs, and public data domains. Translate complex datasets into clear visualisations and actionable insights that … and governance across all reporting and analytics activities. Responsibilities Design, develop, and maintain DOMO dashboards (live and scheduled) that deliver real-time business insights. Extract, transform, and integrate data from SaaS applications, APIs, and public data sources. Build and optimise data pipelines and ETL workflows for efficient and accurate data ...

reliable data pipelines, support real‐time data processing, and enable high‐quality analytics and business insights. Responsibilities Build and maintain scalable data pipelines and ETL processes using Python, SQL, Airflow, AWS Glue and Redshift. Develop batch and near real‐time data solutions to support operational and analytical needs. Optimise data … Qualifications Strong experience with AWS data services (Redshift, S3, Glue, Lambda). Advanced SQL and Python skills. Experience designing and supporting data pipelines and ETL frameworks. Knowledge of Airflow, Spark and modern data engineering practices. Strong understanding of data modelling, warehousing and performance optimisation. Experience with GitHub, CI/ ...

Experience: Proven track record delivering solution architecture across large, complex, and highly regulated IT environments Broad Architectural Styles: Expertise across cloud, distributed systems, monoliths, ETL, and cross-platform/organisational integrations Pragmatic and Adaptable: Ability to rapidly pick up existing work, evaluate previous outputs, and drive designs to completion Stakeholder ...

Experience: Proven track record delivering solution architecture across large, complex, and highly regulated IT environments Broad Architectural Styles: Expertise across cloud, distributed systems, monoliths, ETL, and cross-platform/organisational integrations Pragmatic and Adaptable: Ability to rapidly pick up existing work, evaluate previous outputs, and drive designs to completion Stakeholder ...

Experience: Proven track record delivering solution architecture across large, complex, and highly regulated IT environments Broad Architectural Styles: Expertise across cloud, distributed systems, monoliths, ETL, and cross-platform/organisational integrations Pragmatic and Adaptable: Ability to rapidly pick up existing work, evaluate previous outputs, and drive designs to completion Stakeholder ...

Experience: Proven track record delivering solution architecture across large, complex, and highly regulated IT environments Broad Architectural Styles: Expertise across cloud, distributed systems, monoliths, ETL, and cross-platform/organisational integrations Pragmatic and Adaptable: Ability to rapidly pick up existing work, evaluate previous outputs, and drive designs to completion Stakeholder ...

optimising scalable data pipelines, data warehouse solutions, and cloud-based analytics platforms using Snowflake, DBT, and AWS . Key Responsibilities Design, build, and maintain ETL/ELT pipelines for enterprise-scale data integration. Develop and enhance DBT models following engineering best practices. Implement data ingestion and transformation solutions within Snowflake. … solutions. Required Skills & Experience Strong hands-on experience with Snowflake and DBT . Extensive SQL development and performance tuning expertise. Experience building and supporting ETL/ELT frameworks. Strong understanding of data warehousing concepts and dimensional modelling. AWS experience, including services such as S3, Glue, EMR, or PySpark . Knowledge ...

modelling. Ability to analyse and interpret data to produce meaningful insights and actionable recommendations. Basic knowledge of SQL and Familiarity with querying databases to extract and manipulate data. Strong attention to detail to ensure data accuracy and report quality. Comfortable working with team members and IT colleagues to deliver shared … such as custom visuals and row-level security is desirable Familiarity with Microsoft Fabric or similar data platform technologies. Knowledge of data preparation and Extract, Transform, Load processes. Relevant certifications in Power BI or data analysis tools would be desirable Hybrid Working Birketts is a flexible business which has embraced ...

modelling. Ability to analyse and interpret data to produce meaningful insights and actionable recommendations. Basic knowledge of SQL and Familiarity with querying databases to extract and manipulate data. Strong attention to detail to ensure data accuracy and report quality. Comfortable working with team members and IT colleagues to deliver shared … features, such as custom visuals and row-level security is desirableFamiliarity with Microsoft Fabric or similar data platform technologies. Knowledge of data preparation and Extract, Transform, Load processes. Relevant certifications in Power BI or data analysis tools would be desirableHybrid WorkingBirketts is a flexible business which has embraced a hybrid ...

and maintain enterprise data architecture standards and best practices. Design conceptual, logical, and physical data models across staging, integration, and reporting layers. Architect scalable ETL/ELT solutions for complex enterprise data environments. Lead data mapping activities from source systems into Snowflake data platforms. Drive data governance, lineage, quality, and … data platforms. Advanced knowledge of data warehousing methodologies including Kimball, Inmon, and Data Vault . Extensive SQL and data modelling experience. Strong understanding of ETL/ELT architecture and data integration frameworks. AWS experience including services such as S3, Glue, EMR, and PySpark . Experience defining data standards, governance frameworks ...

actionable view of customers and prospects. Key responsibilities will include: Designing and developing the organisation’s Single Customer View/Customer 360 Building scalable ETL/ELT pipelines and automated data processes Integrating data from CRM, websites, marketing platforms, events and other business systems Developing data models and supporting … support future AI and machine-learning initiatives You will have strong experience across several of the following: Data Engineering SQL and database technologies ETL/ELT development Cloud-based data platforms Data warehousing/lakehouse architecture APIs and third-party integrations Data modelling and normalisation Data quality and validation Customer ...

Responsibilities Design, build and support SAP BW data warehouse solutions. Gather, analyse and translate business requirements into technical solutions. Develop and maintain data models, ETL processes, queries and reporting structures. Ensure data quality, integrity and governance standards are met. Troubleshoot and resolve data warehouse and reporting issues. Collaborate with business … Experience Proven experience working with SAP Business Warehouse (SAP BW) . Strong understanding of data warehousing concepts and best practices. Experience with data modelling, ETL development and reporting solutions. Ability to gather and document business requirements. Strong analytical and problem-solving skills. Excellent communication and stakeholder engagement abilities. Experience working ...