1 to 25 of 79 Permanent ETL Jobs in the North of England

DevOps best practices, contribute to architectural decisions, and help mentor junior engineers as the team scales. Responsibilities Architect and write production-grade ELT/ETL data pipelines using PySpark and Python within Azure ecosystem. Build custom, reusable data processing frameworks and libraries in Python/Scala to streamline ingestion and ...

Lakehouse architectures to tools such as Power BI and Tableau. Hands-on experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. ...

application to our client in conjunction with this vacancy only. KEY SKILLS Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data ...

practices Proficiency with cloud platforms (AWS, Azure, GCP) and data technologies such as Snowflake, Databricks, or equivalent Experience with programming/scripting, data integration, ETL pipelines, and orchestration Knowledge of ML/AI frameworks, BI/analytics platforms, and semantic data modelling Strong client-facing skills with the ability ...

level deployments and licensing strategy. Solid knowledge of Azure data stack : Azure Data Factory, Data Lake, Azure SQL, and data warehousing. Ability to design ETL/ELT pipelines using visual tooling to move and transform data efficiently. Strong SQL and data modelling skills , with experience turning document-based databases (like ...

helping to design, build, and maintain scalable data pipelines and cloud-based data solutions. Key Responsibilities • Design, build, and maintain scalable data pipelines and ETL processes. • Develop and optimise data models for analytics and reporting. • Work closely with software engineers, analysts, and stakeholders. • Ensure data quality, reliability, and performance. • Implement ...

similar role. Strong Azure background, ideally including Data Factory, Data Lake, Databricks, Synapse (or similar). Solid understanding of SQL, Python, ETL/ELT, data warehousing, and data modelling. Experience integrating multiple systems into a centralised platform. Familiarity with ERP, CRM, and e-commerce environments. Power BI, DAX, and Dynamics ...

expect to be involved in the following: Designing scalable data architecture that supports analytics, reporting, and ML workloads. Building and maintaining secure, repeatable ETL and ELT pipelines using Azure, Python, and SQL. Driving best practice, including CI/CD, observability, documentation, and automation. Creating datasets and reusable data models ...

expect to be involved in the following: Designing scalable data architecture that supports analytics, reporting, and ML workloads. Building and maintaining secure, repeatable ETL and ELT pipelines using Azure, Python, and SQL. Driving best practice, including CI/CD, observability, documentation, and automation. Creating datasets and reusable data models ...

shaping best practices and supporting the wider team. Specifically, you can expect to be involved in the following: Designing and building scalable ELT and ETL pipelines across a cloud environment. Developing curated data models to support analytics, reporting and operational use cases. Improving performance, cost efficiency and reliability ...

shaping best practices and supporting the wider team. Specifically, you can expect to be involved in the following: Designing and building scalable ELT and ETL pipelines across a cloud environment. Developing curated data models to support analytics, reporting and operational use cases. Improving performance, cost efficiency and reliability ...

Line management and team leadership Real-time and event-driven data platforms Cloud data engineering on AWS Strong SQL and T-SQL SQL Server ETL/ELT pipelines, SSIS, Matillion or similar Data visualisation, Tableau or similar Infrastructure as Code awareness, Terraform or similar Stakeholder managemenT Useful but not essential ...

excited by solving complex data challenges in a high-performance environment, we’d love to hear from you. Data Engineering, Data Pipelines, ETL, Python, SQL, Spark, Databricks, Airflow, AWS, Azure, GCP, Cloud Technologies, Data Processing, Data Transformation, Data Quality, Scalable Systems, Data Applications, Data-Intensive Systems, Data Engineer, Engineering Consultant ...

role with a small amount of hands on work possible. Key Responsibilities Lead and develop a team of data engineers Deliver largescale data pipelines (ETL/ELT) Design and optimise data architecture and workflows Partner with stakeholders to translate business needs Ensure data quality, governance and best practice Key Requirements ...

making sales learner outcomes efficiency Fast paced dynamic. Switch tasks balance projects requests multiple stakeholders. SKILLS Power BI report development dashboard creation Strong SQL ETL processes data pipelines Data modelling Power BI DAX Microsoft Power Platform Power Automate Power Apps End to end BI lifecycle requirements to insights Senior stakeholder ...

making sales learner outcomes efficiency Fast paced dynamic. Switch tasks balance projects requests multiple stakeholders. SKILLS Power BI report development dashboard creation Strong SQL ETL processes data pipelines Data modelling Power BI DAX Microsoft Power Platform Power Automate Power Apps End to end BI lifecycle requirements to insights Senior stakeholder ...

making sales learner outcomes efficiency Fast paced dynamic. Switch tasks balance projects requests multiple stakeholders. SKILLS Power BI report development dashboard creation Strong SQL ETL processes data pipelines Data modelling Power BI DAX Microsoft Power Platform Power Automate Power Apps End to end BI lifecycle requirements to insights Senior stakeholder ...

making sales learner outcomes efficiency Fast paced dynamic. Switch tasks balance projects requests multiple stakeholders. SKILLS Power BI report development dashboard creation Strong SQL ETL processes data pipelines Data modelling Power BI DAX Microsoft Power Platform Power Automate Power Apps End to end BI lifecycle requirements to insights Senior stakeholder ...

across multiple industries. Access professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing large-scale structured and unstructured datasets from ...

team Required Skills and Experience Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services ...

role designing and delivering scalable data pipelines, Lakehouse solutions, and analytics models within the Azure ecosystem . What You'll Do: Build and maintain ETL/ELT pipelines and data models in Fabric (Data Factory, Notebooks, Spark) Write high-performance Spark SQL, T-SQL, Python/PySpark Manage ingestion, transformation ...

governed, high-quality data products that teams across Sales, Network, Customer Experience, Finance and Operations can trust. Responsibilities Build, optimise and operate ELT/ETL pipelines into our data platform using SQL and Python (PySpark), with a focus on reliability, performance and maintainability. Develop and maintain core data models (curated ...

kickstart your professional career. You will have experience in Python and SQL , and a keen interest in cloud technologies, with a basic understanding of ETL processes . While direct experience is not mandatory, a strong willingness to learn and lead is essential. You'll also be excited by the opportunity ...

Good knowledge of cloud data platforms (AWS preferred: Redshift, Athena, S3, Glue, knowledge of Azure or GCP beneficial) and modern data engineering patterns including ETL/ELT Experience with data governance frameworks, data quality tools and ensuring compliance with security and regulatory requirements Strong business acumen with ability to translate ...

issues. Key Responsibilities: Develop and maintain enterprise-grade Power BI reports, datasets, and data models (including star schemas and dimensional models). Lead ETL/ELT design and optimisation within Microsoft Fabric Lakehouse, including Data Pipelines, Notebooks, and cloud-based ingestion/transformation layers. Deliver complex SQL, Python, and PySpark ...