1 to 25 of 27 ETL Jobs in the East of England

using a business partnering approach to ensure you meet requirements. Partnering with the Technology team on the development of the data warehouse, developing efficient ETL (extract, transform, load) processes to ensure data accuracy, consistency, and timeliness. Work with stakeholders to embed best practice in data entry, validation, and reporting. Present ...

regression, classification, NLP, forecasting, clustering) 2. Data & Analytics Engineering Alignment Work closely with data engineers to define: Data models and schemas Data quality rules ETL/ELT pipelines Define feature stores, training datasets, and inference pipelines 3. Model Development & Deployment Strategy Guide data scientists on: Model selection and evaluation strategies ...

performance tuning and model management. Proven ability to manage and optimize very large datasets in Power BI and Azure. Solid understanding of SQL, ETL processes, and data warehousing. Familiarity with Azure Synapse, Data Lake, and Analysis Services (AAS/SSAS). Strong performance tuning: aggregations, incremental refresh, Hybrid tables, Direct ...

and datasets Build and govern advanced data models (star schema, dimensional modelling, enterprise structures) Optimise datasets, composite models, and DAX performance for scalability Lead ETL/ELT design within Microsoft Fabric Lakehouse architecture Develop and orchestrate data pipelines across ingestion, transformation, and modelling layers Optimise and monitor data workflows using ...

similar cloud-based data platform is highly desirable for this role as it involves significant migration projects.* Solid understanding of building, maintaining, and optimising ETL/ELT pipelines using modern tools and technologies is essential for success.* Familiarity with managing dual environments involving both legacy systems (such as on-premise ...

with dead letter queues AWS Lambda event-based integrations Experience designing event-driven and microservices architectures. Strong knowledge of: API integration patterns (REST, GraphQL) ETL/ELT and data pipelines Distributed system design High throughput and low-latency data streaming Good understanding of Java/Python/Node.js for integration ...

bring the following: Advanced expertise in Microsoft Power BI, including DAX, Power Query (M), data modelling, and report development and publishing. Strong knowledge of ETL processes, data transformation techniques, and database structures, including tables, schemas, and relational models. Excellent analytical and numerical skills, with the ability to interpret complex datasets ...

Angular, or Blazor) Experience with Entity Framework, LINQ, microservices architectures Extensive experience with SQL Server Integration Services (SSIS), including designing, optimizing , and supporting complex ETL processes, data workflows, and integration of pipelines. Experience with tools such as Git, Azure DevOps, SonarQube, or similar development and DevSecOps to ols. Experience with ...

knowledge of data analysis, data governance, and data quality principles. Experience with SQL and data visualisation tools (e.g. QlikSense). Understanding of data warehousing, ETL processes, and data flows. Excellent stakeholder management and communication skills, with the ability to explain complex data clearly. Naturally curious with strong problem-solving and ...

Good understanding of Data Lake and Big Data technologies. Understanding of AWS Services will be required. AWS native data services (S3, Lambda, Kinesis) etc. ETL/ELT solutions such as AWS glue, DBT, Data solutions such as Snowflake. Good understanding of Insurance Domain. Desirable skills/knowledge/experience ...

core systems and future enterprise-scale data needs. Evaluate, recommend, and drive the adoption of modern data technologies, tools, and patterns (e.g., data lakehouse, ETL/ELT, event streaming, metadata management). Data Practice: Help establish the foundational processes for data modelling, data quality, metadata, lineage, security, and governance. Build ...

understand business requirements for data migration. Design and implement robust data migration strategies. Develop scripts and processes to automate data extraction, transformation, and loading (ETL) processes. Work closely with stakeholders, including business users and IT teams, to ensure data requirements are met, and migrations proceed without disruption to business operations. … Responsibilities: Plan, coordinate, and execute data migration projects within set timelines. Design and build ETL solutions, ensuring data quality and integrity throughout the migration process. Troubleshoot and resolve data-related issues promptly to minimise disruption. Collaborate with various teams to align migration processes with organisational goals and regulatory standards. Proficiency ...

and data architecture What My Client Is Looking For: Strong data modelling capability Power BI expertise SQL and data transformation experience Understanding of ETL/ELT and data platforms Package & Benefits - £50,000-£55,000 (up to £60,000 depending on experience) - Hybrid: max 2 days/week in Peterborough ...

Experience working on B2B or B2B2C platform or portal projects - A general software engineering background (python, JavaScript, C# etc) - Solid understanding of data engineering - ETL pipelines, data lacks etc - Experience working in a high growth, product focussed business - Solid cloud provisioning & infrastructure understanding - Azure, AWS - Understanding of serverless, microservices, event ...

range of Data and MI/BI platforms. Experience supporting applications in regulated industries (e.g., government, aerospace, and defence). Knowledge of integration concepts (ETL, Event, APIs, message-based interfaces). Exposure to deployment automation or DevOps practices. Personal Attributes: Strong analytical and problem-solving mindset. Clear communicator able ...

analytics, reporting, and business applications. Your Responsibilities 1. Data Pipeline Development & Maintenance Design, build, and maintain automated, scalable data pipelines (batch & real time) Optimize ETL/ELT jobs for performance, reliability, and cost efficiency Ensure data pipelines meet SLAs, quality standards, and security guidelines 2. Data Platform Operations Manage and … analysts, and product teams Translate business requirements into scalable data solutions Your Profile Essential Skills/Knowledge/Experience Technical Skills Strong experience with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF) Proficiency in SQL, data modeling, and performance tuning Hands on with cloud platforms (Azure/ ...

Python, REST/SOAP web services, HTML and CSS Proven use of data technologies including MySQL and SQL Server databases, database schemas, SQL syntax, ETL techniques and best practice, as well as an understanding of and solutions for issues arising with data integration across multiple systems Knowledgeable of network architecture ...

independently and drive outcomes in ambiguous or fast-moving environments Strong understanding of data modeling (conceptual, logical, and physical) Experience with data integration patterns (ETL/ELT, APIs, streaming) Solid stakeholder engagement skills, with the ability to influence across business and technical teams Desirable: Experience working with Salesforce data models ...

week:36.25 hours, Monday Friday (9am 5.15pm) Location:Hybrid, with weekly presence in Milton Keynes or Boston Snapshot of your role Youlldesign,buildand maintain ETL/ELT pipelinesin the Microsoft cloud, primarily using Azure Data Factory, Databricks and related Azure services. Your focus will be on producing data pipelines that … Director of Insight & Innovation Whatwerelooking for Youllbe a motivated data engineer with strong technical foundations and a practical mindset. Youllbring: Hands-on experience building ETL/ELT pipelines in a cloud environment Strong SQL skills and experience with data modelling Experience working with Databricks (PySpark/SQL) and Azure data ...

Data Engineer to join their expanding data and analytics team. This role is ideal for someone who enjoys building scalable data pipelines, designing ETL processes, and ensuring high-quality, reliable data for analytics and reporting . You'll work with product, engineering, and analytics teams to deliver data solutions that … business decisions. The company offers a hybrid working model, competitive benefits, and strong professional development opportunities . Key Responsibilities Design, build, and maintain robust ETL pipelines and data workflows . Develop and optimise data models to support analytics and reporting. Ensure data accuracy, quality, and governance across systems. Collaborate with ...

systems (Infor M3, SAP, Netsuite, Sage etc.) Proficient working with PowerBI. MS Fabric, Azure and SQL Good experience with python, Azure DevOps and ETL/ELT pipelines A degree in Computer Science or similar Experience delivering BI solutions on a global scale is hugely beneficial This is a remote working … contact for all PowerBI, MS Fabric, SQL and other BI Development issues Mentor and train junior BI Developers in best practices and methodologies Lead ETL/ELT development within a modern cloud-based data platform Build and optimise data pipelines across ingestion, transformation, and modelling layers Ensure data quality, governance ...

and can lead teams through ambiguity to predictable, high-quality outcomes. Your Responsibilities: Lead the design and implementation of scalable, secure, and cost-efficient ETL/ELT pipelines using AWS Glue, Python (PySpark), and MWAA (Airflow). Define solution architectures, data models, orchestration patterns, and CI/CD for data … risk, pricing, regulatory reporting, underwriting, fraud, payments, or actuarial data). Experience with event-driven and near-real-time pipelines (Kafka/Kinesis, streaming ETL). Knowledge of data quality frameworks (Great Expectations, Deequ) and data lineage/catalog (Atlas, Alation, Collibra). Exposure to Databricks or EMR for advanced ...

survivorship, stewardship, integrations. Data integration: APIs/events, batch/streaming ingestion, CDC, lineage. Data engineering: data lake/lakehouse, orchestration (Airflow/MWAA), ETL/ELT (e.g., Glue), DQ frameworks. Discovery services: BI/analytics (Power BI/Tableau), ML feature pipelines, self-service data products. Oversee architecture conformance … data providers - ensuring SLA and contractual compliance. Solid technical delivery background across MDM/Customer 360, data integration (APIs, streaming, CDC), data engineering (lakehouse, ETL/ELT, orchestration), and BI/analytics platforms. Strong understanding of architecture alignment, data privacy/security (PII/PHI, GDPR), observability, operational SLOs, and ...

direction. Key Responsibilities Improve and optimise existing data infrastructure (performance, cost, best practice) Build and maintain data pipelines and visualisations using AWS services Develop ETL processes and automation using Python Write and optimise SQL queries Collaborate with stakeholders to deliver data-driven solutions Key Requirements Strong AWS experience (S3, Glue … Lambda, Athena, Redshift, DynamoDB) Python and SQL expertise Knowledge of ETL and data pipeline design Familiarity with GitLab and Infrastructure as Code (Terraform/CloudFormation) What’s on Offer 💰 Salary: £65,000-£80,000 📍 Location: Ipswich (Once a month onsite) 🌴 25 days holiday (rising with service) ❤️ 🩹 Private medical, dental & optical ...

policies “Security must be baked into delivery — not an afterthought.” Power Platform, Fabric & Data Modelling Power BI (data modelling, DAX fundamentals) Power Query/ETL thinking Familiarity with Microsoft Fabric or modern data platforms Can design a single source of truth , not just reports “Someone who moves from spreadsheets → models … experience useful: BAQs, REST/API, upgrades SQL literacy (views, joins, performance awareness) Understanding of manufacturing concepts: BOMs, routings, work centres Ability to extract ERP data cleanly for reporting & forecasting Process, Documentation & Knowledge Capture Comfortable documenting systems and processes Can create repeatable runbooks, not Word documents nobody reads Thinks ...