1 to 25 of 26 ETL Jobs in the East of England

Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform ...

Design, implement, and maintain AWS-based data infrastructure leveraging Redshift, S3, EMR, and other cloud services. Develop and oversee CI/CD pipelines for ETL processes and Power BI deployments, ensuring rapid, error-free code releases. Automate environment provisioning and data workflows using Terraform, Docker, Kubernetes, Python, and other automation ...

performance tuning and model management. Proven ability to manage and optimize very large datasets in Power BI and Azure. Solid understanding of SQL, ETL processes, and data warehousing. Familiarity with Azure Synapse, Data Lake, and Analysis Services (AAS/SSAS). Strong performance tuning: aggregations, incremental refresh, Hybrid tables, Direct ...

intelligence or data platform roles Strong knowledge of Power BI and BI reporting environments Solid SQL and data modelling experience Understanding of data pipelines, ETL/ELT processes or data integration concepts The ability to translate business requirements into structured reporting solutions Strong communication skills and experience working with both ...

similar cloud-based data platform is highly desirable for this role as it involves significant migration projects.* Solid understanding of building, maintaining, and optimising ETL/ELT pipelines using modern tools and technologies is essential for success.* Familiarity with managing dual environments involving both legacy systems (such as on-premise ...

Data Warehousing, Data Migrations, Business Intelligence, Analytics, Big Data, Cloud (AWS/Azure) transformations. Key Responsibilities : Own the technical delivery roadmap across data ingestion, ETL/ELT pipelines, data lake/warehouse models, streaming workloads, and analytics products. Own and Supervise Quality, Testing & Release Governance Required Expertise:- Overall experience ...

and incident response. Strong security mindset: application security best practices and experience mitigating vulnerabilities, secure coding techniques. Experience designing and building Data Pipelines/ETL systems. Desirable Working knowledge of JavaScript/TypeScript frontends and interactions with them. Experience of working in ISO27001 Information Security Accredited environment. Working knowledge ...

Good understanding of Data Lake and Big Data technologies. Understanding of AWS Services will be required AWS native data services(S3, Lambda, Kinesis) etc ETL/ELT solutions such as AWS glue, DBT, Data solutions such as Snowflake Good understanding of Insurance Domain Desirable skills/knowledge/experience ...

understand business requirements for data migration. Design and implement robust data migration strategies. Develop scripts and processes to automate data extraction, transformation, and loading (ETL) processes. Work closely with stakeholders, including business users and IT teams, to ensure data requirements are met, and migrations proceed without disruption to business operations. … Responsibilities: Plan, coordinate, and execute data migration projects within set timelines. Design and build ETL solutions, ensuring data quality and integrity throughout the migration process. Troubleshoot and resolve data-related issues promptly to minimise disruption. Collaborate with various teams to align migration processes with organisational goals and regulatory standards. Proficiency ...

and optimising data pipelines that form the foundation of our reporting and analytics ecosystem. Using your technical expertise, you will design and maintain efficient ETL processes to integrate data from systems such as ServiceNow, JIRA, and Dynatrace, ensuring accuracy, performance, and scalability. You will thrive in a fast-paced, collaborative … ideal role for you! Contract - 6 months Location - Cambridge (2 days onsite) Rate - Flexible (inside IR35) Responsibilities: Design, build, and maintain scalable ETL pipelines in Databricks to integrate data from multiple business systems such as ServiceNow, JIRA, and ADO. Optimise data workflows for performance, scalability, and reliability. Implement data validation ...

/CD & DevOps: Familiarity with CI/CD workflows and automation tools (e.g., GitLab, Jenkins) for streamlined deployments. Data Engineering Fundamentals: Knowledge of ETL (Extract, Transform, Load) processes, data warehousing, and streaming architectures. System Architecture: Experience designing and implementing scalable, cloud-native pipelines and systems. Due to nature of this ...

/CD & DevOps: Familiarity with CI/CD workflows and automation tools (e.g., GitLab, Jenkins) for streamlined deployments. Data Engineering Fundamentals: Knowledge of ETL (Extract, Transform, Load) processes, data warehousing, and streaming architectures. System Architecture: Experience designing and implementing scalable, cloud-native pipelines and systems. Due to nature of this ...

comapny core and non-core IT systems, working with business owners and suppliers for system upgrades, patching, releases, and fault resolution. * Lead the Extract, Transform, Load element of the company data warehouse and ensure databases are optimised. * Provide platform support for all applications and operating systems, including system builds and ...

experience with both relational (e.g. PostgreSQL) and non-relational databases (e.g. Elasticsearch, Redis) Extensive experience in data warehousing architecture, big data processing and ETL Demonstrable expertise in Unix/Linux environments Experience with GIT and working in collaborative software environments Willingness to learn new skills as required by the project ...

least 2 year as a Qlik developer Knowledge of Oracle/SQL would be highly desirable and beneficial Understanding of data warehousing and ETL Tenacity to see multiple tasks through to successful completion at any given time Ability to work to tight deadlines and demanding targets Strong attention to detail ...

Python, REST/SOAP web services, HTML and CSS Proven use of data technologies including MySQL and SQL Server databases, database schemas, SQL syntax, ETL techniques and best practice, as well as an understanding of and solutions for issues arising with data integration across multiple systems Proven use of data ...

standards, mentoring developers and ensuring that data solutions are scalable, reliable and aligned with enterprise data governance practices. Responsibilities Design, build and maintain scalable ETL/ELT data pipelines within Microsoft Fabric Lakehouse environments Develop and optimise data ingestion/transformation workflows Develop Python and PySpark processes for data transformation … Hands-on expertise with Microsoft Fabric, Lakehouse architecture and Data Pipelines Experience developing Python or PySpark solutions for large-scale data processing Understanding of ETL/ELT design patterns, data modelling and modern data platform architecture Experience developing Power BI datasets, semantic models and reports Experience working with Infor ...

Data Engineer to join their expanding data and analytics team. This role is ideal for someone who enjoys building scalable data pipelines, designing ETL processes, and ensuring high-quality, reliable data for analytics and reporting . You'll work with product, engineering, and analytics teams to deliver data solutions that … business decisions. The company offers a hybrid working model, competitive benefits, and strong professional development opportunities . Key Responsibilities Design, build, and maintain robust ETL pipelines and data workflows . Develop and optimise data models to support analytics and reporting. Ensure data accuracy, quality, and governance across systems. Collaborate with ...

Data source understanding (JSON, CSV etc) Strong SQL ETL/ELT Testing Background Strong Domain understanding Test Planning Resource prioritization Test Approach Automation strategy Azure Experience API (Postman Experience) Strong communication Responsibilities Manage Releases Review user stories (Test Scope) Define Test types Create approach for any new patterns Test evidence ...

their enterprise data warehouse. Develop and refine advanced T-SQL queries, stored procedures, and database logic. Design, build, and maintain scalable data pipelines and ETL processes that feed into the data warehouse and wider analytics platforms. Play an active role in the growth, enhancement, and optimisation of the company … Python for automation, scripting, and data processing. Practical experience with SQL Server Database Administration tasks. Knowledge of data warehouse architecture, dimensional modelling, and ETL frameworks. Experience with SSIS or similar tools for ETL and data movement. Familiarity with reporting tools such as SSRS or Power BI. Knowledge of fabric ...

tools Translate business and client requirements into technical designs and specifications Develop and maintain SQL-based datasets, views and stored procedures Build and support ETL processes and data flows for reporting and analytics Develop reports and dashboards to meet business and client needs Present BI solutions and proposals to stakeholders … skills Experience delivering BI or reporting solutions using the Microsoft BI stack Solid understanding of data warehousing and reporting concepts Experience working with ETL tools Comfortable gathering requirements and working directly with stakeholders or clients Experience handling large or complex datasets Exposure to source control and structured development practices (Azure ...

premise infrastructure , ensuring our Generative AI capabilities are powerful, private, and resilient. Key Responsibilities Architect & Build: Design, develop, and optimize scalable data pipelines (ETL/ELT) within air-gapped or on-premise data centers. AI Integration: Engineer data structures specifically for Natural Language Processing (NLP) and Large Language Models (LLMs … transition GenAI prototypes into production-ready, locally-hosted solutions. Technical Requirements Languages Expert-level Python and advanced SQL . Data Engineering Experience with ETL/ELT and orchestration tools like Apache Airflow or NiFi . On-Prem Tech Proficiency with Hadoop/HDFS , Spark , and containerization via Docker/Kubernetes ...

policies Security must be baked into delivery not an afterthought. Power Platform, Fabric & Data Modelling Power BI (data modelling, DAX fundamentals) Power Query/ETL thinking Familiarity with Microsoft Fabric or modern data platforms Can design a single source of truth , not just reports Someone who moves from spreadsheets models … experience useful: BAQs, REST/API, upgrades SQL literacy (views, joins, performance awareness) Understanding of manufacturing concepts: BOMs, routings, work centres Ability to extract ERP data cleanly for reporting & forecasting Process, Documentation & Knowledge Capture Comfortable documenting systems and processes Can create repeatable runbooks, not Word documents nobody reads Thinks ...

and optimise data usage Ensure data quality, governance and compliance standards are met across all data assets Support data exchange and processing solutions including ETL, APIs and integration layers Contribute to the ongoing improvement of data platforms and architectures Stay up to date with emerging technologies and provide input into … technologies such as MS SQL or Oracle Experience with noSQL technologies such as MongoDB, InfluxDB or Neo4J Strong data exchange and processing experience including ETL, ESB and API-based integrations Development experience, ideally using Python Knowledge of big data technologies such as the Hadoop stack Exposure to NLP and ...

data issue management workflows Ensure alignment with enterprise data governance frameworks and compliance requirements. Integration & Metadata Lineage Implement automated metadata ingestion from: Data lakes ETL tools (Glue, Informatica, Talend, IICS) Warehouses (Redshift, Snowflake, BigQuery) BI tools (Power BI, Tableau) Streaming sources (Kafka) Build lineage diagrams across ETL pipelines, APIs, datasets … and downstream consumption layers. Ensure metadata completeness, accuracy, and operational SLAs. Your Profile Essential skills/knowledge/experience: Data lakes ETL tools (Glue, Informatica, Talend, IICS) Warehouses (Redshift, Snowflake, BigQuery) BI tools (Power BI, Tableau) Streaming sources (Kafka) Build lineage diagrams across ETL pipelines, APIs, datasets, and downstream consumption ...