1 to 25 of 56 ETL Jobs in the North of England

based data platforms (AWS, Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data ...

maintainable, and efficient code and tests, ensuring adherence to best practices through code reviews. Big Data Engineering Design, develop, and maintain data pipelines and ETL workflows using Apache Spark and Apache Airflow. Optimize data storage, retrieval, and processing systems to ensure reliability, scalability, and performance. Develop and fine‐tune complex ...

Delivery Own It End-to-End: Manage and deliver BI infrastructure from initial brief and requirement gathering through to data pipeline development (APIs/ETL/ELT/SQL). Enable the Analysts: Work alongside your Data Analyst colleagues to help them generate impactful business insights and analysis. Data Platform ...

and clients. At mid‐level, we expect you to have a good grasp of core concepts of Data Engineering (data structures, databases, data manipulation, ETL, data quality), enabling you to write pipelines of moderate complexity in a consistent style. The technology we use varies between clients, so although we value ...

guide junior engineers where appropriate Key Requirements As a Data Engineer , you should have: Strong programming experience in Java (preferred) or Python Experience building ETL/ELT or streaming data pipelines Hands-on experience with Kafka, Flink, or Spark (streaming experience preferred) Good understanding of stream-processing concepts (event time ...

Redshift, Glue), Azure (Data Factory, Synapse) or GCP (BigQuery, Dataflow) Advanced proficiency in SQL, including optimisation and performance tuning Strong experience with ETL/ELT pipelines and data transformation frameworks Programming capability in Python, Scala or Java for data processing Deep understanding of data warehousing concepts and best practices Experience ...

infrastructure. Develop and manage robust data pipelines to ingest, clean and transform data for reporting and analytics. Support and enhance the data warehouse, including ETL processes and data modelling activities. Collaborate with analysts, engineers and business stakeholders to deliver high-quality, data-led solutions. Monitor data performance and identify opportunities ...

maintainable, and efficient code and tests, ensuring adherence to best practices through code reviews. Big Data Engineering Design, develop, and maintain data pipelines and ETL workflows using Apache Spark and Apache Airflow. Optimize data storage, retrieval, and processing systems to ensure reliability, scalability, and performance. Develop and fine‐tune complex ...

role in designing and building scalable, governed, and high-performing data solutions across the full data engineering lifecycle. Key Responsibilities • Design and develop scalable ETL/ELT pipelines using Databricks, Python, SQL, and Spark • Build and optimise Delta Lake architectures and data pipelines on AWS • Implement ingestion frameworks using Databricks ...

and analytics tools including Power BI, Tableau or equivalent BI platforms used for programme performance reporting. Strong understanding of integration technologies including API design, ETL processes, data pipelines and interoperability standards relevant to controls ecosystems. Degree in engineering, computer science, project management or a related discipline or equivalent professional experience. ...

modern, AI-enabled data platform Real ownership and influence in a growing, forward-thinking data team What You'll Do: Build and maintain ETL/ELT pipelines and data models in Fabric (Data Factory, Notebooks, Spark) Write high-performance Spark SQL, T-SQL, Python/PySpark Manage ingestion, transformation, and ...

development, DAX, and data modelling Experience working with multiple data sources such as SQL, dataflows, Excel, and APIs Good understanding of data transformation and ETL processes Ability to design clear, user-friendly dashboards and visualizations. Strong attention to detail with a focus on data quality and consistency Excellent communication skills ...

collaborating with stakeholders, producing high-quality documentation, and working across the full data lifecycle in a cloud-first environment. The Role: Design and implement ETL and ELT data pipelines using cloud-native tools Develop and maintain data models and curated data products in Snowflake Build and support batch, micro-batch ...

analytics Proven experience defining and executing data strategies in complex organisations Strong expertise in cloud-based data platforms (AWS preferred) Experience with modern ETL/ELT tools and data pipeline frameworks Solid understanding of data modelling, warehousing, and transformation best practices Experience across the data science/ML life cycle ...

Comprehensive knowledge of cloud data platforms (AWS preferred: Redshift, Athena, S3, Glue; Azure or GCP beneficial)* Strong understanding of modern data engineering patterns including ETL/ELT, data lake architectures, and lakehouse approaches* Understanding of emerging technologies such as open table formats (Apache Iceberg, Delta Lake), data observability tools, and ...

database expertise using relational databases such as Oracle Database & PL/SQL or Microsoft T-SQL. Knowledge & Awareness: Extensive working knowledge and experience with ETL and data integration. Knowledge and expertise of IT architecture and infrastructure. Current knowledge of the public sector/NHS. Skills & Attributes: Excellent analytical, IT Keyboard ...

cases, including large-scale document processing Collaborating closely with Data Scientists to support model development, fine-tuning, and lifecycle management Supporting data integration, ETL, and cloud migration initiatives on Azure Acting as a technical thought leader, setting standards and sharing best practice across teams YOUR SKILLS AND EXPERIENCE You will ...

/observability (Langfuse), cost optimisation Delivery Governance: programme planning, roadmap ownership, risk & dependency management, stakeholder alignment, executive reporting Data & Analytics: Data lakes/warehouses, ETL/ELT, PySpark, SQL, BI integration, data quality and lineage ...

Good knowledge of cloud data platforms (AWS preferred: Redshift, Athena, S3, Glue, knowledge of Azure or GCP beneficial) and modern data engineering patterns including ETL/ELT Experience with data governance frameworks, data quality tools and ensuring compliance with security and regulatory requirements Strong business acumen with ability to translate ...

Experience supporting multiple departments and iterating on outputs. Strong commercial mindset with the ability to understand the "why" behind the data. Desirable. Familiarity with ETL/integration tools e.g. SSIS, ADF, LogicApps, Informatica or similar. Source Code Management e.g. Microsoft Devops or similar. Job Offer Based in the Leeds ...

3+ years of experience in Software Development Active SC is required for this role Strong experience using Python for data processing, transformation, and ETL workloads. Practical experience working with AWS cloud services, including compute, storage, and security tooling. Infrastructure-as-code experience using Terraform. Distributed data processing using Apache Spark. ...

integration, data platforms and AI-enabled products and services within a complex enterprise environment. Strong understanding of modern data engineering practices, including data pipelines, ETL/ELT, data modelling, data governance, security, privacy and access management. Experience working with data platforms and technologies such as Snowflake, SQL-based data environments ...

experience with Power BI (including DAX and data modelling) Experience working with multiple data sources (SQL, Excel, APIs, dataflows, SharePoint) Good understanding of ETL and data transformation processes Ability to design clear, intuitive dashboards and visualisations Strong attention to detail with a focus on data quality and consistency Excellent communication ...

architecture frameworks and methodologies (e.g. TOGAF, Zachman) Broad knowledge of enterprise data technologies, including lakehouse and medallion architectures, legacy data platforms and data engineering (ETL, ELT, CDC) Experience working within large, complex or highly regulated organisations In return, you can expect a flexible working culture, including: Non-contributory career-average ...

Ensure data accuracy and performance Essential Skills & Experience: Strong Power BI experience (DAX, reporting, data modelling) Experience with SQL, dataflows, Excel, APIs Understanding of ETL and data transformation Ability to design clear, user-friendly dashboards Strong attention to detail and data quality focus Excellent stakeholder communication skills Experience maintaining ...