1 to 25 of 31 ETL Jobs in the East of England

Programming/Query Strong expertise in SQL for data transformation and performance optimization Python (preferred) for automation and data engineering tasks. Data Engineering Enterprise ETL/ELT pipeline architecture Data warehousing and enterprise data modelling Dimensional modelling (Star Schema, Snowflake Schema) Data pipeline scalability and reliability design. AI/Data ...

regression, classification, NLP, forecasting, clustering) 2. Data & Analytics Engineering Alignment Work closely with data engineers to define: Data models and schemas Data quality rules ETL/ELT pipelines Define feature stores, training datasets, and inference pipelines 3. Model Development & Deployment Strategy Guide data scientists on: Model selection and evaluation strategies ...

performance tuning and model management. Proven ability to manage and optimize very large datasets in Power BI and Azure. Solid understanding of SQL, ETL processes, and data warehousing. Familiarity with Azure Synapse, Data Lake, and Analysis Services (AAS/SSAS). Strong performance tuning: aggregations, incremental refresh, Hybrid tables, Direct ...

with programme standards. Skills & Experience Essential: Proven experience delivering IT or ERP-related projects using Agile, Waterfall or hybrid methodologies. Hands-on experience with ETL processes within major ERP implementations (e.g., Oracle, SAP, Fusion). Strong analytical and problem-solving capability with excellent attention to detail. Expertise in relational and ...

and datasets Build and govern advanced data models (star schema, dimensional modelling, enterprise structures) Optimise datasets, composite models, and DAX performance for scalability Lead ETL/ELT design within Microsoft Fabric Lakehouse architecture Develop and orchestrate data pipelines across ingestion, transformation, and modelling layers Optimise and monitor data workflows using ...

intelligence or data platform roles Strong knowledge of Power BI and BI reporting environments Solid SQL and data modelling experience Understanding of data pipelines, ETL/ELT processes or data integration concepts The ability to translate business requirements into structured reporting solutions Strong communication skills and experience working with both ...

insight. Tech Stack seeking: Full Stack Developer; Design and Build with C#, JavaScript Library (React.js bonus), API Development, SQL Server/Backend Development including ETL/Integration Azure DevOps (Repos, Pipelines, Boards, Artifacts, Test Plans), CI/CD automation, gated releases, and environment governance Infrastructure-as-Code (Bicep, ARM, Terraform ...

similar cloud-based data platform is highly desirable for this role as it involves significant migration projects.* Solid understanding of building, maintaining, and optimising ETL/ELT pipelines using modern tools and technologies is essential for success.* Familiarity with managing dual environments involving both legacy systems (such as on-premise ...

with dead letter queues AWS Lambda event-based integrations Experience designing event-driven and microservices architectures. Strong knowledge of: API integration patterns (REST, GraphQL) ETL/ELT and data pipelines Distributed system design High throughput and low-latency data streaming Good understanding of Java/Python/Node.js for integration ...

Design scalable data pipelines (batch and streaming) to support operational and analytical workloads. Develop logical and physical data models aligned to enterprise standards. Oversee ETL/ELT processes, data integration and transformation patterns. Design and optimise data storage solutions (data lakes, warehouses, distributed systems). Ensure solutions are secure ...

and incident response. Strong security mindset: application security best practices and experience mitigating vulnerabilities, secure coding techniques. Experience designing and building Data Pipelines/ETL systems. Desirable Working knowledge of JavaScript/TypeScript frontends and interactions with them. Experience of working in ISO27001 Information Security Accredited environment. Working knowledge ...

APIs, Reltio Connect/Hub, real-time sync, eventing) for CRM, ERP, Digital, MarTech, and Analytics platforms Collaborate on data pipelines (e.g., via Kafka, ETL tools) and define error handling, retries, DLQ, and monitoring Stakeholder Management & Delivery Facilitate workshops with Senior Customer MDM Architects and Reltio SMEs; present options, trade ...

Good understanding of Data Lake and Big Data technologies. Understanding of AWS Services will be required. AWS native data services (S3, Lambda, Kinesis) etc. ETL/ELT solutions such as AWS glue, DBT, Data solutions such as Snowflake. Good understanding of Insurance Domain. Desirable skills/knowledge/experience ...

understand business requirements for data migration. Design and implement robust data migration strategies. Develop scripts and processes to automate data extraction, transformation, and loading (ETL) processes. Work closely with stakeholders, including business users and IT teams, to ensure data requirements are met, and migrations proceed without disruption to business operations. … Responsibilities: Plan, coordinate, and execute data migration projects within set timelines. Design and build ETL solutions, ensuring data quality and integrity throughout the migration process. Troubleshoot and resolve data-related issues promptly to minimise disruption. Collaborate with various teams to align migration processes with organisational goals and regulatory standards. Proficiency ...

/CD & DevOps: Familiarity with CI/CD workflows and automation tools (e.g., GitLab, Jenkins) for streamlined deployments. Data Engineering Fundamentals: Knowledge of ETL (Extract, Transform, Load) processes, data warehousing, and streaming architectures. System Architecture: Experience designing and implementing scalable, cloud-native pipelines and systems. Due to nature of this ...

and data architecture What My Client Is Looking For: Strong data modelling capability Power BI expertise SQL and data transformation experience Understanding of ETL/ELT and data platforms Package & Benefits - £50,000-£55,000 (up to £60,000 depending on experience) - Hybrid: max 2 days/week in Peterborough ...

Experience working on B2B or B2B2C platform or portal projects - A general software engineering background (python, JavaScript, C# etc) - Solid understanding of data engineering - ETL pipelines, data lacks etc - Experience working in a high growth, product focussed business - Solid cloud provisioning & infrastructure understanding - Azure, AWS - Understanding of serverless, microservices, event ...

analytics, reporting, and business applications. Your Responsibilities 1. Data Pipeline Development & Maintenance Design, build, and maintain automated, scalable data pipelines (batch & real time) Optimize ETL/ELT jobs for performance, reliability, and cost efficiency Ensure data pipelines meet SLAs, quality standards, and security guidelines 2. Data Platform Operations Manage and … analysts, and product teams Translate business requirements into scalable data solutions Your Profile Essential Skills/Knowledge/Experience Technical Skills Strong experience with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF) Proficiency in SQL, data modeling, and performance tuning Hands on with cloud platforms (Azure/ ...

least 2 year as a Qlik developer Knowledge of Oracle/SQL would be highly desirable and beneficial Understanding of data warehousing and ETL Tenacity to see multiple tasks through to successful completion at any given time Ability to work to tight deadlines and demanding targets Strong attention to detail ...

Title: Data Engineer Work Location: Norwich-3 Days (Flexible) Duration of Assignment: 6 Months The Role Hands on experience to Design & Develop a ETL pipelines in aws Glue for ingesting data from sql server or other sources Hands on experience on PySpark & Python Experience of implementing change data capture pipelines ...

standards, mentoring developers and ensuring that data solutions are scalable, reliable and aligned with enterprise data governance practices. Responsibilities Design, build and maintain scalable ETL/ELT data pipelines within Microsoft Fabric Lakehouse environments Develop and optimise data ingestion/transformation workflows Develop Python and PySpark processes for data transformation … Hands-on expertise with Microsoft Fabric, Lakehouse architecture and Data Pipelines Experience developing Python or PySpark solutions for large-scale data processing Understanding of ETL/ELT design patterns, data modelling and modern data platform architecture Experience developing Power BI datasets, semantic models and reports Experience working with Infor ...

Data Engineer to join their expanding data and analytics team. This role is ideal for someone who enjoys building scalable data pipelines, designing ETL processes, and ensuring high-quality, reliable data for analytics and reporting . You'll work with product, engineering, and analytics teams to deliver data solutions that … business decisions. The company offers a hybrid working model, competitive benefits, and strong professional development opportunities . Key Responsibilities Design, build, and maintain robust ETL pipelines and data workflows . Develop and optimise data models to support analytics and reporting. Ensure data accuracy, quality, and governance across systems. Collaborate with ...

their enterprise data warehouse. Develop and refine advanced T-SQL queries, stored procedures, and database logic. Design, build, and maintain scalable data pipelines and ETL processes that feed into the data warehouse and wider analytics platforms. Play an active role in the growth, enhancement, and optimisation of the company … Python for automation, scripting, and data processing. Practical experience with SQL Server Database Administration tasks. Knowledge of data warehouse architecture, dimensional modelling, and ETL frameworks. Experience with SSIS or similar tools for ETL and data movement. Familiarity with reporting tools such as SSRS or Power BI. Knowledge of fabric ...

systems (Infor M3, SAP, Netsuite, Sage etc.) Proficient working with PowerBI. MS Fabric, Azure and SQL Good experience with python, Azure DevOps and ETL/ELT pipelines A degree in Computer Science or similar Experience delivering BI solutions on a global scale is hugely beneficial This is a remote working … contact for all PowerBI, MS Fabric, SQL and other BI Development issues Mentor and train junior BI Developers in best practices and methodologies Lead ETL/ELT development within a modern cloud-based data platform Build and optimise data pipelines across ingestion, transformation, and modelling layers Ensure data quality, governance ...

survivorship, stewardship, integrations. Data integration: APIs/events, batch/streaming ingestion, CDC, lineage. Data engineering: data lake/lakehouse, orchestration (Airflow/MWAA), ETL/ELT (e.g., Glue), DQ frameworks. Discovery services: BI/analytics (Power BI/Tableau), ML feature pipelines, self-service data products. Oversee architecture conformance … data providers - ensuring SLA and contractual compliance. Solid technical delivery background across MDM/Customer 360, data integration (APIs, streaming, CDC), data engineering (lakehouse, ETL/ELT, orchestration), and BI/analytics platforms. Strong understanding of architecture alignment, data privacy/security (PII/PHI, GDPR), observability, operational SLOs, and ...