1 to 25 of 49 ETL Jobs in the East of England

Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform ...

Design, implement, and maintain AWS-based data infrastructure leveraging Redshift, S3, EMR, and other cloud services. Develop and oversee CI/CD pipelines for ETL processes and Power BI deployments, ensuring rapid, error-free code releases. Automate environment provisioning and data workflows using Terraform, Docker, Kubernetes, Python, and other automation ...

Programming/Query Strong expertise in SQL for data transformation and performance optimization Python (preferred) for automation and data engineering tasks. Data Engineering Enterprise ETL/ELT pipeline architecture Data warehousing and enterprise data modelling Dimensional modelling (Star Schema, Snowflake Schema) Data pipeline scalability and reliability design. AI/Data ...

regression, classification, NLP, forecasting, clustering) 2. Data & Analytics Engineering Alignment Work closely with data engineers to define: Data models and schemas Data quality rules ETL/ELT pipelines Define feature stores, training datasets, and inference pipelines 3. Model Development & Deployment Strategy Guide data scientists on: Model selection and evaluation strategies ...

performance tuning and model management. Proven ability to manage and optimize very large datasets in Power BI and Azure. Solid understanding of SQL, ETL processes, and data warehousing. Familiarity with Azure Synapse, Data Lake, and Analysis Services (AAS/SSAS). Strong performance tuning: aggregations, incremental refresh, Hybrid tables, Direct ...

with programme standards. Skills & Experience Essential: Proven experience delivering IT or ERP-related projects using Agile, Waterfall or hybrid methodologies. Hands-on experience with ETL processes within major ERP implementations (e.g., Oracle, SAP, Fusion). Strong analytical and problem-solving capability with excellent attention to detail. Expertise in relational and ...

intelligence or data platform roles Strong knowledge of Power BI and BI reporting environments Solid SQL and data modelling experience Understanding of data pipelines, ETL/ELT processes or data integration concepts The ability to translate business requirements into structured reporting solutions Strong communication skills and experience working with both ...

similar cloud-based data platform is highly desirable for this role as it involves significant migration projects.* Solid understanding of building, maintaining, and optimising ETL/ELT pipelines using modern tools and technologies is essential for success.* Familiarity with managing dual environments involving both legacy systems (such as on-premise ...

with dead letter queues AWS Lambda event-based integrations Experience designing event-driven and microservices architectures. Strong knowledge of: API integration patterns (REST, GraphQL) ETL/ELT and data pipelines Distributed system design High throughput and low-latency data streaming Good understanding of Java/Python/Node.js for integration ...

bring the following: Advanced expertise in Microsoft Power BI, including DAX, Power Query (M), data modelling, and report development and publishing. Strong knowledge of ETL processes, data transformation techniques, and database structures, including tables, schemas, and relational models. Excellent analytical and numerical skills, with the ability to interpret complex datasets ...

Data Warehousing, Data Migrations, Business Intelligence, Analytics, Big Data, Cloud (AWS/Azure) transformations. Key Responsibilities : Own the technical delivery roadmap across data ingestion, ETL/ELT pipelines, data lake/warehouse models, streaming workloads, and analytics products. Own and Supervise Quality, Testing & Release Governance Required Expertise:- Overall experience ...

Design scalable data pipelines (batch and streaming) to support operational and analytical workloads. Develop logical and physical data models aligned to enterprise standards. Oversee ETL/ELT processes, data integration and transformation patterns. Design and optimise data storage solutions (data lakes, warehouses, distributed systems). Ensure solutions are secure ...

and incident response. Strong security mindset: application security best practices and experience mitigating vulnerabilities, secure coding techniques. Experience designing and building Data Pipelines/ETL systems. Desirable Working knowledge of JavaScript/TypeScript frontends and interactions with them. Experience of working in ISO27001 Information Security Accredited environment. Working knowledge ...

APIs, Reltio Connect/Hub, real-time sync, eventing) for CRM, ERP, Digital, MarTech, and Analytics platforms Collaborate on data pipelines (e.g., via Kafka, ETL tools) and define error handling, retries, DLQ, and monitoring Stakeholder Management & Delivery Facilitate workshops with Senior Customer MDM Architects and Reltio SMEs; present options, trade ...

APIs, Reltio Connect/Hub, Real Time sync, eventing) for CRM, ERP, Digital, MarTech, and Analytics platforms. Collaborate on data pipelines (eg, via Kafka, ETL tools) and define error handling, retries, DLQ, and monitoring . Stakeholder Management & Delivery Facilitate workshops with Senior Customer MDM Architects and Reltio SMEs ; present options ...

analytics. Key Responsibilities Design and implement scalable data solutions using Snowflake on AWS. Build and maintain data transformation pipelines using DBT. Develop ELT/ETL pipelines to ingest and transform data from multiple sources. Design and implement data models (star schema, dimensional models) for analytics and reporting. Optimize Snowflake performance … modelling, testing, and transformation frameworks. Programming/Query Strong SQL for data transformation and analysis Python (preferred) for data processing and automation. Data Engineering ETL/ELT pipeline development Data warehousing and dimensional modelling Data modelling techniques (Star schema, Snowflake schema) AI/Data Science Exposure Basic understanding ...

Good understanding of Data Lake and Big Data technologies. Understanding of AWS Services will be required. AWS native data services (S3, Lambda, Kinesis) etc. ETL/ELT solutions such as AWS glue, DBT, Data solutions such as Snowflake. Good understanding of Insurance Domain. Desirable skills/knowledge/experience ...

Good understanding of Data Lake and Big Data technologies. Understanding of AWS Services will be required AWS native data services(S3, Lambda, Kinesis) etc ETL/ELT solutions such as AWS glue, DBT, Data solutions such as Snowflake Good understanding of Insurance Domain Desirable skills/knowledge/experience ...

thinking environment. Responsibilities You will design, build, and optimise data pipelines and integration solutions that support reporting, analytics, and business operations. This includes developing ETL/ELT workflows using both low-code tools and code-based approaches (SQL, Python, PySpark), ensuring performance, scalability, and reliability across the data platform. … Strong experience with Microsoft Fabric, Databricks, or similar platforms Solid understanding of data modelling (star schema, dimensional modelling, lakehouse design) Experience building and optimising ETL/ELT pipelines using SQL, Python, and/or PySpark Knowledge of data governance, quality, and security best practices Experience implementing CI/CD pipelines ...

understand business requirements for data migration. Design and implement robust data migration strategies. Develop scripts and processes to automate data extraction, transformation, and loading (ETL) processes. Work closely with stakeholders, including business users and IT teams, to ensure data requirements are met, and migrations proceed without disruption to business operations. … Responsibilities: Plan, coordinate, and execute data migration projects within set timelines. Design and build ETL solutions, ensuring data quality and integrity throughout the migration process. Troubleshoot and resolve data-related issues promptly to minimise disruption. Collaborate with various teams to align migration processes with organisational goals and regulatory standards. Proficiency ...

/CD & DevOps: Familiarity with CI/CD workflows and automation tools (e.g., GitLab, Jenkins) for streamlined deployments. Data Engineering Fundamentals: Knowledge of ETL (Extract, Transform, Load) processes, data warehousing, and streaming architectures. System Architecture: Experience designing and implementing scalable, cloud-native pipelines and systems. Due to nature of this ...

comapny core and non-core IT systems, working with business owners and suppliers for system upgrades, patching, releases, and fault resolution. * Lead the Extract, Transform, Load element of the company data warehouse and ensure databases are optimised. * Provide platform support for all applications and operating systems, including system builds and ...

and data architecture What My Client Is Looking For: Strong data modelling capability Power BI expertise SQL and data transformation experience Understanding of ETL/ELT and data platforms Package & Benefits - £50,000-£55,000 (up to £60,000 depending on experience) - Hybrid: max 2 days/week in Peterborough ...

APIs, Reltio Connect/Hub, Real Time sync, eventing) for CRM, ERP, Digital, MarTech, and Analytics platforms. * Collaborate on data pipelines (eg, via Kafka, ETL tools) and define error handling, retries, DLQ, and monitoring. Stakeholder Management & Delivery * Facilitate workshops with Senior Customer MDM Architects and Reltio SMEs; present options, trade ...

analytics, reporting, and business applications. Your Responsibilities 1. Data Pipeline Development & Maintenance Design, build, and maintain automated, scalable data pipelines (batch & real time) Optimize ETL/ELT jobs for performance, reliability, and cost efficiency Ensure data pipelines meet SLAs, quality standards, and security guidelines 2. Data Platform Operations Manage and … analysts, and product teams Translate business requirements into scalable data solutions Your Profile Essential Skills/Knowledge/Experience Technical Skills Strong experience with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF) Proficiency in SQL, data modeling, and performance tuning Hands on with cloud platforms (Azure/ ...