21 of 21 ETL Jobs in East Anglia

regression, classification, NLP, forecasting, clustering) 2. Data & Analytics Engineering Alignment Work closely with data engineers to define: Data models and schemas Data quality rules ETL/ELT pipelines Define feature stores, training datasets, and inference pipelines 3. Model Development & Deployment Strategy Guide data scientists on: Model selection and evaluation strategies ...

with programme standards. Skills & Experience Essential: Proven experience delivering IT or ERP-related projects using Agile, Waterfall or hybrid methodologies. Hands-on experience with ETL processes within major ERP implementations (e.g., Oracle, SAP, Fusion). Strong analytical and problem-solving capability with excellent attention to detail. Expertise in relational and ...

with dead letter queues AWS Lambda event-based integrations Experience designing event-driven and microservices architectures. Strong knowledge of: API integration patterns (REST, GraphQL) ETL/ELT and data pipelines Distributed system design High throughput and low-latency data streaming Good understanding of Java/Python/Node.js for integration ...

Design scalable data pipelines (batch and streaming) to support operational and analytical workloads. Develop logical and physical data models aligned to enterprise standards. Oversee ETL/ELT processes, data integration and transformation patterns. Design and optimise data storage solutions (data lakes, warehouses, distributed systems). Ensure solutions are secure ...

and incident response. Strong security mindset: application security best practices and experience mitigating vulnerabilities, secure coding techniques. Experience designing and building Data Pipelines/ETL systems. Desirable Working knowledge of JavaScript/TypeScript frontends and interactions with them. Experience of working in ISO27001 Information Security Accredited environment. Working knowledge ...

APIs, Reltio Connect/Hub, real-time sync, eventing) for CRM, ERP, Digital, MarTech, and Analytics platforms Collaborate on data pipelines (e.g., via Kafka, ETL tools) and define error handling, retries, DLQ, and monitoring Stakeholder Management & Delivery Facilitate workshops with Senior Customer MDM Architects and Reltio SMEs; present options, trade ...

Good understanding of Data Lake and Big Data technologies. Understanding of AWS Services will be required. AWS native data services (S3, Lambda, Kinesis) etc. ETL/ELT solutions such as AWS glue, DBT, Data solutions such as Snowflake. Good understanding of Insurance Domain. Desirable skills/knowledge/experience ...

Good understanding of Data Lake and Big Data technologies. Understanding of AWS Services will be required AWS native data services(S3, Lambda, Kinesis) etc ETL/ELT solutions such as AWS glue, DBT, Data solutions such as Snowflake Good understanding of Insurance Domain Desirable skills/knowledge/experience ...

thinking environment. Responsibilities You will design, build, and optimise data pipelines and integration solutions that support reporting, analytics, and business operations. This includes developing ETL/ELT workflows using both low-code tools and code-based approaches (SQL, Python, PySpark), ensuring performance, scalability, and reliability across the data platform. … Strong experience with Microsoft Fabric, Databricks, or similar platforms Solid understanding of data modelling (star schema, dimensional modelling, lakehouse design) Experience building and optimising ETL/ELT pipelines using SQL, Python, and/or PySpark Knowledge of data governance, quality, and security best practices Experience implementing CI/CD pipelines ...

/CD & DevOps: Familiarity with CI/CD workflows and automation tools (e.g., GitLab, Jenkins) for streamlined deployments. Data Engineering Fundamentals: Knowledge of ETL (Extract, Transform, Load) processes, data warehousing, and streaming architectures. System Architecture: Experience designing and implementing scalable, cloud-native pipelines and systems. Due to nature of this ...

and data architecture What My Client Is Looking For: Strong data modelling capability Power BI expertise SQL and data transformation experience Understanding of ETL/ELT and data platforms Package & Benefits - £50,000-£55,000 (up to £60,000 depending on experience) - Hybrid: max 2 days/week in Peterborough ...

analytics, reporting, and business applications. Your Responsibilities 1. Data Pipeline Development & Maintenance Design, build, and maintain automated, scalable data pipelines (batch & real time) Optimize ETL/ELT jobs for performance, reliability, and cost efficiency Ensure data pipelines meet SLAs, quality standards, and security guidelines 2. Data Platform Operations Manage and … analysts, and product teams Translate business requirements into scalable data solutions Your Profile Essential Skills/Knowledge/Experience Technical Skills Strong experience with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF) Proficiency in SQL, data modeling, and performance tuning Hands on with cloud platforms (Azure/ ...

Data Engineer to join their expanding data and analytics team. This role is ideal for someone who enjoys building scalable data pipelines, designing ETL processes, and ensuring high-quality, reliable data for analytics and reporting . You'll work with product, engineering, and analytics teams to deliver data solutions that … business decisions. The company offers a hybrid working model, competitive benefits, and strong professional development opportunities . Key Responsibilities Design, build, and maintain robust ETL pipelines and data workflows . Develop and optimise data models to support analytics and reporting. Ensure data accuracy, quality, and governance across systems. Collaborate with ...

survivorship, stewardship, integrations. Data integration: APIs/events, batch/streaming ingestion, CDC, lineage. Data engineering: data lake/lakehouse, orchestration (Airflow/MWAA), ETL/ELT (e.g., Glue), DQ frameworks. Discovery services: BI/analytics (Power BI/Tableau), ML feature pipelines, self-service data products. Oversee architecture conformance … data providers - ensuring SLA and contractual compliance. Solid technical delivery background across MDM/Customer 360, data integration (APIs, streaming, CDC), data engineering (lakehouse, ETL/ELT, orchestration), and BI/analytics platforms. Strong understanding of architecture alignment, data privacy/security (PII/PHI, GDPR), observability, operational SLOs, and ...

and can lead teams through ambiguity to predictable, high-quality outcomes. Your Responsibilities: Lead the design and implementation of scalable, secure, and cost-efficient ETL/ELT pipelines using AWS Glue, Python (PySpark), and MWAA (Airflow). Define solution architectures, data models, orchestration patterns, and CI/CD for data … risk, pricing, regulatory reporting, underwriting, fraud, payments, or actuarial data). Experience with event-driven and near-real-time pipelines (Kafka/Kinesis, streaming ETL). Knowledge of data quality frameworks (Great Expectations, Deequ) and data lineage/catalog (Atlas, Alation, Collibra). Exposure to Databricks or EMR for advanced ...

high-quality data solutions that support both operational and analytical needs across the enterprise. Key Responsibilities Design and implement scalable Guidewire data pipelines and ETL workflows leveraging Guidewire DataHub , GDA, and InsuranceSuite data structures. Architect enterprise-grade Guidewire Lakehouse or downstream data solutions , ensuring performance optimisation, data governance, lineage, and … enterprise cloud infrastructure (Azure/AWS) and downstream BI/reporting environments. Required Experience Strong hands-on expertise with Guidewire DataHub (data model extensions, ETL, mappings, staging patterns). Deep understanding of Guidewire Data Access (GDA) for high-performance data extraction and reporting integration. Experience across the Guidewire InsuranceSuite (PolicyCenter ...

Title: Data Engineer Work Location: Norwich-3 Days (Flexible) Duration of Assignment: 6 Months The Role Hands on experience to Design & Develop a ETL pipelines in aws Glue for ingesting data from sql server or other sources Hands on experience on PySpark & Python Experience of implementing change data capture pipelines … sprint planning, code reviews, and deployment pipelines (CI/CD) Your Responsibilities Solution & Data Model Design Hands on experience to Design & Develop a ETL pipelines in aws Glue for ingesting data from sql server or other sources Hands on experience on PySpark & Python Experience of implementing change data capture pipelines ...

and issue management workflows Ensure alignment with enterprise data governance frameworks and compliance requirements. Integration & Metadata Lineage Implement automated metadata ingestion from: Data lakes ETL tools ( Glue, Informatica, Talend, IICS ) Data warehouses ( Redshift, Snowflake, BigQuery ) BI tools ( Power BI, Tableau ) Streaming sources ( Kafka ) Build lineage diagrams across ETL pipelines, APIs … layers. Ensure metadata completeness, accuracy, and operational SLAs. Essential Skills & Experience: Expertise with Collibra platform (configuration, integration, and workflow implementation) Experience with: Data lakes ETL tools ( Glue, Informatica, Talend, IICS ) Data warehouses ( Redshift, Snowflake, BigQuery ) BI tools ( Power BI, Tableau ) Streaming sources ( Kafka ) Ability to build lineage diagrams across ETL ...

policies Security must be baked into delivery not an afterthought. Power Platform, Fabric & Data Modelling Power BI (data modelling, DAX fundamentals) Power Query/ETL thinking Familiarity with Microsoft Fabric or modern data platforms Can design a single source of truth , not just reports Someone who moves from spreadsheets models … experience useful: BAQs, REST/API, upgrades SQL literacy (views, joins, performance awareness) Understanding of manufacturing concepts: BOMs, routings, work centres Ability to extract ERP data cleanly for reporting & forecasting Process, Documentation & Knowledge Capture Comfortable documenting systems and processes Can create repeatable runbooks, not Word documents nobody reads Thinks ...

data issue management workflows Ensure alignment with enterprise data governance frameworks and compliance requirements. Integration & Metadata Lineage Implement automated metadata ingestion from: Data lakes ETL tools (Glue, Informatica, Talend, IICS) Warehouses (Redshift, Snowflake, BigQuery) BI tools (Power BI, Tableau) Streaming sources (Kafka) Build lineage diagrams across ETL pipelines, APIs, datasets … and downstream consumption layers. Ensure metadata completeness, accuracy, and operational SLAs. Your Profile Essential skills/knowledge/experience: Data lakes ETL tools (Glue, Informatica, Talend, IICS) Warehouses (Redshift, Snowflake, BigQuery) BI tools (Power BI, Tableau) Streaming sources (Kafka) Build lineage diagrams across ETL pipelines, APIs, datasets, and downstream consumption ...

system. The Data Migration Lead will be accountable for migration strategy, migration design, data quality, define data mapping and ETL pipeline build. This will need to be someone from a technical background, experience with SQL programming and ETL work. Data Migration Lead, key skills: Proven experience working on large-scale … data migrations Expertise in logical data modelling Extensive ETL experience SQL programming Data mapping - legacy to target systems Strong understanding of data quality Excellent communication skills to work alongside the PM and Architects Data Migration Lead, D365 Reasonable Adjustments: Respect and equality are core values to us. We are proud ...