1 to 25 of 40 ETL Jobs in the East of England

Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform ...

Programming/Query Strong expertise in SQL for data transformation and performance optimization Python (preferred) for automation and data engineering tasks. Data Engineering Enterprise ETL/ELT pipeline architecture Data warehousing and enterprise data modelling Dimensional modelling (Star Schema, Snowflake Schema) Data pipeline scalability and reliability design. AI/Data ...

regression, classification, NLP, forecasting, clustering) 2. Data & Analytics Engineering Alignment Work closely with data engineers to define: Data models and schemas Data quality rules ETL/ELT pipelines Define feature stores, training datasets, and inference pipelines 3. Model Development & Deployment Strategy Guide data scientists on: Model selection and evaluation strategies ...

performance tuning and model management. Proven ability to manage and optimize very large datasets in Power BI and Azure. Solid understanding of SQL, ETL processes, and data warehousing. Familiarity with Azure Synapse, Data Lake, and Analysis Services (AAS/SSAS). Strong performance tuning: aggregations, incremental refresh, Hybrid tables, Direct ...

with programme standards. Skills & Experience Essential: Proven experience delivering IT or ERP-related projects using Agile, Waterfall or hybrid methodologies. Hands-on experience with ETL processes within major ERP implementations (e.g., Oracle, SAP, Fusion). Strong analytical and problem-solving capability with excellent attention to detail. Expertise in relational and ...

and datasets Build and govern advanced data models (star schema, dimensional modelling, enterprise structures) Optimise datasets, composite models, and DAX performance for scalability Lead ETL/ELT design within Microsoft Fabric Lakehouse architecture Develop and orchestrate data pipelines across ingestion, transformation, and modelling layers Optimise and monitor data workflows using ...

intelligence or data platform roles Strong knowledge of Power BI and BI reporting environments Solid SQL and data modelling experience Understanding of data pipelines, ETL/ELT processes or data integration concepts The ability to translate business requirements into structured reporting solutions Strong communication skills and experience working with both ...

insight. Tech Stack seeking: Full Stack Developer; Design and Build with C#, JavaScript Library (React.js bonus), API Development, SQL Server/Backend Development including ETL/Integration Azure DevOps (Repos, Pipelines, Boards, Artifacts, Test Plans), CI/CD automation, gated releases, and environment governance Infrastructure-as-Code (Bicep, ARM, Terraform ...

similar cloud-based data platform is highly desirable for this role as it involves significant migration projects.* Solid understanding of building, maintaining, and optimising ETL/ELT pipelines using modern tools and technologies is essential for success.* Familiarity with managing dual environments involving both legacy systems (such as on-premise ...

with dead letter queues AWS Lambda event-based integrations Experience designing event-driven and microservices architectures. Strong knowledge of: API integration patterns (REST, GraphQL) ETL/ELT and data pipelines Distributed system design High throughput and low-latency data streaming Good understanding of Java/Python/Node.js for integration ...

APIs, Reltio Connect/Hub, real-time sync, eventing) for CRM, ERP, Digital, MarTech, and Analytics platforms Collaborate on data pipelines (e.g., via Kafka, ETL tools) and define error handling, retries, DLQ, and monitoring Stakeholder Management & Delivery Facilitate workshops with Senior Customer MDM Architects and Reltio SMEs; present options, trade ...

Data Warehousing, Data Migrations, Business Intelligence, Analytics, Big Data, Cloud (AWS/Azure) transformations. Key Responsibilities : Own the technical delivery roadmap across data ingestion, ETL/ELT pipelines, data lake/warehouse models, streaming workloads, and analytics products. Own and Supervise Quality, Testing & Release Governance Required Expertise:- Overall experience ...

Design scalable data pipelines (batch and streaming) to support operational and analytical workloads. Develop logical and physical data models aligned to enterprise standards. Oversee ETL/ELT processes, data integration and transformation patterns. Design and optimise data storage solutions (data lakes, warehouses, distributed systems). Ensure solutions are secure ...

Good understanding of Data Lake and Big Data technologies. Understanding of AWS Services will be required. AWS native data services (S3, Lambda, Kinesis) etc. ETL/ELT solutions such as AWS glue, DBT, Data solutions such as Snowflake. Good understanding of Insurance Domain. Desirable skills/knowledge/experience ...

understand business requirements for data migration. Design and implement robust data migration strategies. Develop scripts and processes to automate data extraction, transformation, and loading (ETL) processes. Work closely with stakeholders, including business users and IT teams, to ensure data requirements are met, and migrations proceed without disruption to business operations. … Responsibilities: Plan, coordinate, and execute data migration projects within set timelines. Design and build ETL solutions, ensuring data quality and integrity throughout the migration process. Troubleshoot and resolve data-related issues promptly to minimise disruption. Collaborate with various teams to align migration processes with organisational goals and regulatory standards. Proficiency ...

/CD & DevOps: Familiarity with CI/CD workflows and automation tools (e.g., GitLab, Jenkins) for streamlined deployments. Data Engineering Fundamentals: Knowledge of ETL (Extract, Transform, Load) processes, data warehousing, and streaming architectures. System Architecture: Experience designing and implementing scalable, cloud-native pipelines and systems. Due to nature of this ...

and data architecture What My Client Is Looking For: Strong data modelling capability Power BI expertise SQL and data transformation experience Understanding of ETL/ELT and data platforms Package & Benefits - £50,000-£55,000 (up to £60,000 depending on experience) - Hybrid: max 2 days/week in Peterborough ...

Experience working on B2B or B2B2C platform or portal projects - A general software engineering background (python, JavaScript, C# etc) - Solid understanding of data engineering - ETL pipelines, data lacks etc - Experience working in a high growth, product focussed business - Solid cloud provisioning & infrastructure understanding - Azure, AWS - Understanding of serverless, microservices, event ...

analytics, reporting, and business applications. Your Responsibilities 1. Data Pipeline Development & Maintenance Design, build, and maintain automated, scalable data pipelines (batch & real time) Optimize ETL/ELT jobs for performance, reliability, and cost efficiency Ensure data pipelines meet SLAs, quality standards, and security guidelines 2. Data Platform Operations Manage and … analysts, and product teams Translate business requirements into scalable data solutions Your Profile Essential Skills/Knowledge/Experience Technical Skills Strong experience with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF) Proficiency in SQL, data modeling, and performance tuning Hands on with cloud platforms (Azure/ ...

least 2 year as a Qlik developer Knowledge of Oracle/SQL would be highly desirable and beneficial Understanding of data warehousing and ETL Tenacity to see multiple tasks through to successful completion at any given time Ability to work to tight deadlines and demanding targets Strong attention to detail ...

standards, mentoring developers and ensuring that data solutions are scalable, reliable and aligned with enterprise data governance practices. Responsibilities Design, build and maintain scalable ETL/ELT data pipelines within Microsoft Fabric Lakehouse environments Develop and optimise data ingestion/transformation workflows Develop Python and PySpark processes for data transformation … Hands-on expertise with Microsoft Fabric, Lakehouse architecture and Data Pipelines Experience developing Python or PySpark solutions for large-scale data processing Understanding of ETL/ELT design patterns, data modelling and modern data platform architecture Experience developing Power BI datasets, semantic models and reports Experience working with Infor ...

Title: Data Engineer Work Location: Norwich-3 Days (Flexible) Duration of Assignment: 6 Months The Role Hands on experience to Design & Develop a ETL pipelines in aws Glue for ingesting data from sql server or other sources Hands on experience on PySpark & Python Experience of implementing change data capture pipelines ...

Data Engineer to join their expanding data and analytics team. This role is ideal for someone who enjoys building scalable data pipelines, designing ETL processes, and ensuring high-quality, reliable data for analytics and reporting . You'll work with product, engineering, and analytics teams to deliver data solutions that … business decisions. The company offers a hybrid working model, competitive benefits, and strong professional development opportunities . Key Responsibilities Design, build, and maintain robust ETL pipelines and data workflows . Develop and optimise data models to support analytics and reporting. Ensure data accuracy, quality, and governance across systems. Collaborate with ...

system. The Data Migration Lead will be accountable for migration strategy, migration design, data quality, define data mapping and ETL pipeline build click apply for full job details ...

their enterprise data warehouse. Develop and refine advanced T-SQL queries, stored procedures, and database logic. Design, build, and maintain scalable data pipelines and ETL processes that feed into the data warehouse and wider analytics platforms. Play an active role in the growth, enhancement, and optimisation of the company … Python for automation, scripting, and data processing. Practical experience with SQL Server Database Administration tasks. Knowledge of data warehouse architecture, dimensional modelling, and ETL frameworks. Experience with SSIS or similar tools for ETL and data movement. Familiarity with reporting tools such as SSRS or Power BI. Knowledge of fabric ...