1 to 25 of 80 ETL Jobs in the North of England

DevOps best practices, contribute to architectural decisions, and help mentor junior engineers as the team scales. Responsibilities Architect and write production-grade ELT/ETL data pipelines using PySpark and Python within Azure ecosystem. Build custom, reusable data processing frameworks and libraries in Python/Scala to streamline ingestion and ...

based data platforms (AWS, Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data ...

Lakehouse architectures to tools such as Power BI and Tableau. Hands-on experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. ...

practices Proficiency with cloud platforms (AWS, Azure, GCP) and data technologies such as Snowflake, Databricks, or equivalent Experience with programming/scripting, data integration, ETL pipelines, and orchestration Knowledge of ML/AI frameworks, BI/analytics platforms, and semantic data modelling Strong client-facing skills with the ability ...

Engineering, Mathematics, or related discipline or equivalent experience. * Professional certifications (e.g., Snowflake SnowPro, Microsoft Power BI Data Analyst) beneficial. Key Responsibilities: Data Management & Processing: * Extract, transform, and load (ETL) data from multiple sources, primarily using Snowflake, SQL, and associated pipelines. * Ensure high data quality, integrity, consistency, and availability. * Develop repeatable … Snowflake preferred). * Proficiency building Power BI dashboards, DAX formulas, and data models. * Experience working with cloud-based data warehousing platforms. * Understanding of ETL/ELT concepts, data modelling, and data architecture. * Proficient in Excel and general data manipulation tools. Analytical Skills: * Ability to interpret large datasets into actionable insights. ...

helping to design, build, and maintain scalable data pipelines and cloud-based data solutions. Key Responsibilities • Design, build, and maintain scalable data pipelines and ETL processes. • Develop and optimise data models for analytics and reporting. • Work closely with software engineers, analysts, and stakeholders. • Ensure data quality, reliability, and performance. • Implement ...

similar role. Strong Azure background, ideally including Data Factory, Data Lake, Databricks, Synapse (or similar). Solid understanding of SQL, Python, ETL/ELT, data warehousing, and data modelling. Experience integrating multiple systems into a centralised platform. Familiarity with ERP, CRM, and e-commerce environments. Power BI, DAX, and Dynamics ...

skills (joins, CTEs, window functions) and experience with SQL Server. Strong understanding of dimensional modelling and data warehouse principles. Experience building and maintaining ETL pipelines. Excellent analytical, problem solving, and troubleshooting skills. Strong communication skills, able to translate complex data concepts for non technical audiences. Desirable Skills Experience with Atlassian ...

focused on building a trusted, well‐governed, and scalable data environment. The Role • Own the design, build, and optimisation of cloud‐based ELT and ETL pipelines. • Shape the data warehouse architecture and ensure data is prepared for analytics, reporting, and operational use. • Improve existing processes and contribute to a modernised ...

expect to be involved in the following: Designing scalable data architecture that supports analytics, reporting, and ML workloads. Building and maintaining secure, repeatable ETL and ELT pipelines using Azure, Python, and SQL. Driving best practice, including CI/CD, observability, documentation, and automation. Creating datasets and reusable data models ...

expect to be involved in the following: Designing scalable data architecture that supports analytics, reporting, and ML workloads. Building and maintaining secure, repeatable ETL and ELT pipelines using Azure, Python, and SQL. Driving best practice, including CI/CD, observability, documentation, and automation. Creating datasets and reusable data models ...

focused on building a trusted, well-governed, and scalable data environment. The Role * Own the design, build, and optimisation of cloud-based ELT and ETL pipelines. * Shape the data warehouse architecture and ensure data is prepared for analytics, reporting, and operational use. * Improve existing processes and contribute to a modernised ...

while promoting best practices and operational excellence. Key Responsibilities Lead the design, development, and optimisation of enterprise data engineering platforms Build and maintain robust ETL/ELT pipelines integrating large, complex datasets Work with structured, semi-structured, and unstructured data across SQL and NoSQL technologies Develop solutions using Hadoop, Spark ...

shaping best practices and supporting the wider team. Specifically, you can expect to be involved in the following: Designing and building scalable ELT and ETL pipelines across a cloud environment. Developing curated data models to support analytics, reporting and operational use cases. Improving performance, cost efficiency and reliability ...

shaping best practices and supporting the wider team. Specifically, you can expect to be involved in the following: Designing and building scalable ELT and ETL pipelines across a cloud environment. Developing curated data models to support analytics, reporting and operational use cases. Improving performance, cost efficiency and reliability ...

structured, and unstructured data (SQL and NoSQL). Experience integrating large, disparate datasets using modern tools and frameworks. Strong background in building and optimizing ETL/ELT data pipelines. Familiarity with source control and implementing Continuous Integration, Delivery, and Deployment via CI/CD pipelines. Experience supporting and collaborating with ...

structured, and unstructured data (SQL and NoSQL). Experience integrating large, disparate datasets using modern tools and frameworks. Strong background in building and optimizing ETL/ELT data pipelines. Familiarity with source control and implementing Continuous Integration, Delivery, and Deployment via CI/CD pipelines. Experience supporting and collaborating with ...

Line management and team leadership Real-time and event-driven data platforms Cloud data engineering on AWS Strong SQL and T-SQL SQL Server ETL/ELT pipelines, SSIS, Matillion or similar Data visualisation, Tableau or similar Infrastructure as Code awareness, Terraform or similar Stakeholder managemenT Useful but not essential ...

modern data platform to seamlessly integrate and manage data from diverse sources. Maintain and enhance sophisticated financial models and reporting systems. Implement robust ETL processes to ensure data flows smoothly and accurately. Champion data accuracy, consistency, and integrity across all BI deliverables. Contribute to the establishment and enforcement of data ...

Responsibilities Data Engineering & Platform Development Design, develop, and maintain scalable data pipelines using Palantir Foundry (Code Repositories, Pipelines, Ontology, Workshop, etc.) Implement data transformations, ETL/ELT workflows, and orchestration within Foundry/FDP environments Develop modular, reusable data components following software engineering best practices Build and maintain data products ...

making sales learner outcomes efficiency Fast paced dynamic. Switch tasks balance projects requests multiple stakeholders. SKILLS Power BI report development dashboard creation Strong SQL ETL processes data pipelines Data modelling Power BI DAX Microsoft Power Platform Power Automate Power Apps End to end BI lifecycle requirements to insights Senior stakeholder ...

across multiple industries. Access professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing large-scale structured and unstructured datasets from ...

role designing and delivering scalable data pipelines, Lakehouse solutions, and analytics models within the Azure ecosystem . What You'll Do: Build and maintain ETL/ELT pipelines and data models in Fabric (Data Factory, Notebooks, Spark) Write high-performance Spark SQL, T-SQL, Python/PySpark Manage ingestion, transformation ...

terms of learning milestones and certification pass rates. 3. Required Technical Background Legacy SQL Mastery: Deep understanding of SQL Server, T-SQL, and traditional ETL processes. Epic Ecosystem Knowledge: Familiarity with the Epic 3nd-tier architecture (Caché/IRIS, Clarity, Caboodle). Azure Infrastructure: Understanding of Azure SQL Managed Instances ...

Good knowledge of cloud data platforms (AWS preferred: Redshift, Athena, S3, Glue, knowledge of Azure or GCP beneficial) and modern data engineering patterns including ETL/ELT Experience with data governance frameworks, data quality tools and ensuring compliance with security and regulatory requirements Strong business acumen with ability to translate ...