1 to 25 of 95 ETL Jobs in the North of England

DevOps best practices, contribute to architectural decisions, and help mentor junior engineers as the team scales. Responsibilities Architect and write production-grade ELT/ETL data pipelines using PySpark and Python within Azure ecosystem. Build custom, reusable data processing frameworks and libraries in Python/Scala to streamline ingestion and ...

Lakehouse architectures to tools such as Power BI and Tableau. Hands-on experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. ...

application to our client in conjunction with this vacancy only. KEY SKILLS Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data ...

practices Proficiency with cloud platforms (AWS, Azure, GCP) and data technologies such as Snowflake, Databricks, or equivalent Experience with programming/scripting, data integration, ETL pipelines, and orchestration Knowledge of ML/AI frameworks, BI/analytics platforms, and semantic data modelling Strong client-facing skills with the ability ...

Engineering, Mathematics, or related discipline or equivalent experience. * Professional certifications (e.g., Snowflake SnowPro, Microsoft Power BI Data Analyst) beneficial. Key Responsibilities: Data Management & Processing: * Extract, transform, and load (ETL) data from multiple sources, primarily using Snowflake, SQL, and associated pipelines. * Ensure high data quality, integrity, consistency, and availability. * Develop repeatable … Snowflake preferred). * Proficiency building Power BI dashboards, DAX formulas, and data models. * Experience working with cloud-based data warehousing platforms. * Understanding of ETL/ELT concepts, data modelling, and data architecture. * Proficient in Excel and general data manipulation tools. Analytical Skills: * Ability to interpret large datasets into actionable insights. ...

level deployments and licensing strategy. Solid knowledge of Azure data stack : Azure Data Factory, Data Lake, Azure SQL, and data warehousing. Ability to design ETL/ELT pipelines using visual tooling to move and transform data efficiently. Strong SQL and data modelling skills , with experience turning document-based databases (like ...

experience with SQL Server, stored procedures, and complex query development. Solid understanding of data warehouse concepts, including Star Schema/Kimball methodologies. Experience with ETL processes, data migration, and data integration across multiple systems. Familiarity with Tableau, Power BI, or other BI/reporting tools. Exposure ...

helping to design, build, and maintain scalable data pipelines and cloud-based data solutions. Key Responsibilities • Design, build, and maintain scalable data pipelines and ETL processes. • Develop and optimise data models for analytics and reporting. • Work closely with software engineers, analysts, and stakeholders. • Ensure data quality, reliability, and performance. • Implement ...

similar role. Strong Azure background, ideally including Data Factory, Data Lake, Databricks, Synapse (or similar). Solid understanding of SQL, Python, ETL/ELT, data warehousing, and data modelling. Experience integrating multiple systems into a centralised platform. Familiarity with ERP, CRM, and e-commerce environments. Power BI, DAX, and Dynamics ...

skills (joins, CTEs, window functions) and experience with SQL Server. Strong understanding of dimensional modelling and data warehouse principles. Experience building and maintaining ETL pipelines. Excellent analytical, problem solving, and troubleshooting skills. Strong communication skills, able to translate complex data concepts for non technical audiences. Desirable Skills Experience with Atlassian ...

expect to be involved in the following: Designing scalable data architecture that supports analytics, reporting, and ML workloads. Building and maintaining secure, repeatable ETL and ELT pipelines using Azure, Python, and SQL. Driving best practice, including CI/CD, observability, documentation, and automation. Creating datasets and reusable data models ...

expect to be involved in the following: Designing scalable data architecture that supports analytics, reporting, and ML workloads. Building and maintaining secure, repeatable ETL and ELT pipelines using Azure, Python, and SQL. Driving best practice, including CI/CD, observability, documentation, and automation. Creating datasets and reusable data models ...

while promoting best practices and operational excellence. Key Responsibilities Lead the design, development, and optimisation of enterprise data engineering platforms Build and maintain robust ETL/ELT pipelines integrating large, complex datasets Work with structured, semi-structured, and unstructured data across SQL and NoSQL technologies Develop solutions using Hadoop, Spark ...

Lakehouse, Dataflows Gen2, Pipelines, semantic models, governance). Strong Azure engineering and integration capability across data services and cloud architecture. Expertise in data warehousing, ETL/ELT, data lakes, modelling and modern BI practices. Strong Power BI knowledge - modelling, governance, performance and best practice. Understanding of digital integration, automation tooling ...

shaping best practices and supporting the wider team. Specifically, you can expect to be involved in the following: Designing and building scalable ELT and ETL pipelines across a cloud environment. Developing curated data models to support analytics, reporting and operational use cases. Improving performance, cost efficiency and reliability ...

shaping best practices and supporting the wider team. Specifically, you can expect to be involved in the following: Designing and building scalable ELT and ETL pipelines across a cloud environment. Developing curated data models to support analytics, reporting and operational use cases. Improving performance, cost efficiency and reliability ...

Line management and team leadership Real-time and event-driven data platforms Cloud data engineering on AWS Strong SQL and T-SQL SQL Server ETL/ELT pipelines, SSIS, Matillion or similar Data visualisation, Tableau or similar Infrastructure as Code awareness, Terraform or similar Stakeholder managemenT Useful but not essential ...

excited by solving complex data challenges in a high-performance environment, we’d love to hear from you. Data Engineering, Data Pipelines, ETL, Python, SQL, Spark, Databricks, Airflow, AWS, Azure, GCP, Cloud Technologies, Data Processing, Data Transformation, Data Quality, Scalable Systems, Data Applications, Data-Intensive Systems, Data Engineer, Engineering Consultant ...

role with a small amount of hands on work possible. Key Responsibilities Lead and develop a team of data engineers Deliver largescale data pipelines (ETL/ELT) Design and optimise data architecture and workflows Partner with stakeholders to translate business needs Ensure data quality, governance and best practice Key Requirements ...

making sales learner outcomes efficiency Fast paced dynamic. Switch tasks balance projects requests multiple stakeholders. SKILLS Power BI report development dashboard creation Strong SQL ETL processes data pipelines Data modelling Power BI DAX Microsoft Power Platform Power Automate Power Apps End to end BI lifecycle requirements to insights Senior stakeholder ...

making sales learner outcomes efficiency Fast paced dynamic. Switch tasks balance projects requests multiple stakeholders. SKILLS Power BI report development dashboard creation Strong SQL ETL processes data pipelines Data modelling Power BI DAX Microsoft Power Platform Power Automate Power Apps End to end BI lifecycle requirements to insights Senior stakeholder ...

making sales learner outcomes efficiency Fast paced dynamic. Switch tasks balance projects requests multiple stakeholders. SKILLS Power BI report development dashboard creation Strong SQL ETL processes data pipelines Data modelling Power BI DAX Microsoft Power Platform Power Automate Power Apps End to end BI lifecycle requirements to insights Senior stakeholder ...

making sales learner outcomes efficiency Fast paced dynamic. Switch tasks balance projects requests multiple stakeholders. SKILLS Power BI report development dashboard creation Strong SQL ETL processes data pipelines Data modelling Power BI DAX Microsoft Power Platform Power Automate Power Apps End to end BI lifecycle requirements to insights Senior stakeholder ...

across multiple industries. Access professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing large-scale structured and unstructured datasets from ...

team Required Skills and Experience Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services ...