1 to 25 of 36 ETL Jobs in the East of England

Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform ...

using a business partnering approach to ensure you meet requirements. Partnering with the Technology team on the development of the data warehouse, developing efficient ETL (extract, transform, load) processes to ensure data accuracy, consistency, and timeliness. Work with stakeholders to embed best practice in data entry, validation, and reporting. Present ...

regression, classification, NLP, forecasting, clustering) 2. Data & Analytics Engineering Alignment Work closely with data engineers to define: Data models and schemas Data quality rules ETL/ELT pipelines Define feature stores, training datasets, and inference pipelines 3. Model Development & Deployment Strategy Guide data scientists on: Model selection and evaluation strategies ...

performance tuning and model management. Proven ability to manage and optimize very large datasets in Power BI and Azure. Solid understanding of SQL, ETL processes, and data warehousing. Familiarity with Azure Synapse, Data Lake, and Analysis Services (AAS/SSAS). Strong performance tuning: aggregations, incremental refresh, Hybrid tables, Direct ...

with dead letter queues AWS Lambda event-based integrations Experience designing event-driven and microservices architectures. Strong knowledge of: API integration patterns (REST, GraphQL) ETL/ELT and data pipelines Distributed system design High throughput and low-latency data streaming Good understanding of Java/Python/Node.js for integration ...

bring the following: Advanced expertise in Microsoft Power BI, including DAX, Power Query (M), data modelling, and report development and publishing. Strong knowledge of ETL processes, data transformation techniques, and database structures, including tables, schemas, and relational models. Excellent analytical and numerical skills, with the ability to interpret complex datasets ...

based on team stack). Services: REST/gRPC APIs, microservices and/or modular monoliths, asynchronous job orchestration. Data: SQL, data pipelines/ETL/ELT, caching strategies, data quality checks, reproducible inputs/outputs. DevOps: CI/CD, infrastructure as code, containerisation (e.g., Docker), monitoring/alerting, incident ...

Teradata and other legacy systems into Databricks on Azure Designing and building high-performance PySpark pipelines , Delta Lake tables, and medallion architectures Developing scalable ETL/ELT workflows and optimising existing pipelines Implementing Unity Catalog , governance frameworks, and platform standards Leading or contributing to cloud-native data platform builds Performance ...

Teradata and other legacy systems into Databricks on Azure Designing and building high-performance PySpark pipelines , Delta Lake tables, and medallion architectures Developing scalable ETL/ELT workflows and optimising existing pipelines Implementing Unity Catalog , governance frameworks, and platform standards Leading or contributing to cloud-native data platform builds Performance ...

Teradata and other legacy systems into Databricks on Azure Designing and building high-performance PySpark pipelines , Delta Lake tables, and medallion architectures Developing scalable ETL/ELT workflows and optimising existing pipelines Implementing Unity Catalog , governance frameworks, and platform standards Leading or contributing to cloud-native data platform builds Performance ...

Teradata and other legacy systems into Databricks on Azure Designing and building high-performance PySpark pipelines , Delta Lake tables, and medallion architectures Developing scalable ETL/ELT workflows and optimising existing pipelines Implementing Unity Catalog , governance frameworks, and platform standards Leading or contributing to cloud-native data platform builds Performance ...

Teradata and other legacy systems into Databricks on Azure Designing and building high-performance PySpark pipelines , Delta Lake tables, and medallion architectures Developing scalable ETL/ELT workflows and optimising existing pipelines Implementing Unity Catalog , governance frameworks, and platform standards Leading or contributing to cloud-native data platform builds Performance ...

Teradata and other legacy systems into Databricks on Azure Designing and building high-performance PySpark pipelines , Delta Lake tables, and medallion architectures Developing scalable ETL/ELT workflows and optimising existing pipelines Implementing Unity Catalog , governance frameworks, and platform standards Leading or contributing to cloud-native data platform builds Performance ...

Teradata and other legacy systems into Databricks on Azure Designing and building high-performance PySpark pipelines , Delta Lake tables, and medallion architectures Developing scalable ETL/ELT workflows and optimising existing pipelines Implementing Unity Catalog , governance frameworks, and platform standards Leading or contributing to cloud-native data platform builds Performance ...

core systems and future enterprise-scale data needs. Evaluate, recommend, and drive the adoption of modern data technologies, tools, and patterns (e.g., data lakehouse, ETL/ELT, event streaming, metadata management). Data Practice: Help establish the foundational processes for data modelling, data quality, metadata, lineage, security, and governance. Build ...

understand business requirements for data migration. Design and implement robust data migration strategies. Develop scripts and processes to automate data extraction, transformation, and loading (ETL) processes. Work closely with stakeholders, including business users and IT teams, to ensure data requirements are met, and migrations proceed without disruption to business operations. … Responsibilities: Plan, coordinate, and execute data migration projects within set timelines. Design and build ETL solutions, ensuring data quality and integrity throughout the migration process. Troubleshoot and resolve data-related issues promptly to minimise disruption. Collaborate with various teams to align migration processes with organisational goals and regulatory standards. Proficiency ...

/Azure Familiarity with API design and management , REST/SOAP , and event-driven architectures Hands-on experience with Python, JavaScript, or ETL/data transformati on tools Knowledge of SaaS platforms such as Salesforce, ServiceNow, SAP, or Pega Awareness of DevOps, CI/CD, and version control (Git, Azure ...

and data architecture What My Client Is Looking For: Strong data modelling capability Power BI expertise SQL and data transformation experience Understanding of ETL/ELT and data platforms Package & Benefits - £50,000-£55,000 (up to £60,000 depending on experience) - Hybrid: max 2 days/week in Peterborough ...

Experience working on B2B or B2B2C platform or portal projects - A general software engineering background (python, JavaScript, C# etc) - Solid understanding of data engineering - ETL pipelines, data lacks etc - Experience working in a high growth, product focussed business - Solid cloud provisioning & infrastructure understanding - Azure, AWS - Understanding of serverless, microservices, event ...

range of Data and MI/BI platforms. Experience supporting applications in regulated industries (e.g., government, aerospace, and defence). Knowledge of integration concepts (ETL, Event, APIs, message-based interfaces). Exposure to deployment automation or DevOps practices. Personal Attributes: Strong analytical and problem-solving mindset. Clear communicator able ...

analytics, reporting, and business applications. Your Responsibilities 1. Data Pipeline Development & Maintenance Design, build, and maintain automated, scalable data pipelines (batch & real time) Optimize ETL/ELT jobs for performance, reliability, and cost efficiency Ensure data pipelines meet SLAs, quality standards, and security guidelines 2. Data Platform Operations Manage and … analysts, and product teams Translate business requirements into scalable data solutions Your Profile Essential Skills/Knowledge/Experience Technical Skills Strong experience with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF) Proficiency in SQL, data modeling, and performance tuning Hands on with cloud platforms (Azure/ ...

independently and drive outcomes in ambiguous or fast-moving environments Strong understanding of data modeling (conceptual, logical, and physical) Experience with data integration patterns (ETL/ELT, APIs, streaming) Solid stakeholder engagement skills, with the ability to influence across business and technical teams Desirable: Experience working with Salesforce data models ...

Python, REST/SOAP web services, HTML and CSS Proven use of data technologies including MySQL and SQL Server databases, database schemas, SQL syntax, ETL techniques and best practice, as well as an understanding of and solutions for issues arising with data integration across multiple systems Knowledgeable of network architecture ...

Description: Design and develop data models and ETL processes to support business intelligence and analytics initiatives. Ensure data accuracy, consistency, and integrity within the BI environment. £65000 - £85000/year Talent International UK and it's subsidiaries, Digital Gurus, Infinite Talent and Rethink act as an employment agency for permanent ...

Description: Design and develop data models and ETL processes to support business intelligence and analytics initiatives. Ensure data accuracy, consistency, and integrity within the BI environment. £65000 - £85000/year Talent International UK and it's subsidiaries, Digital Gurus, Infinite Talent and Rethink act as an employment agency for permanent ...