1 to 25 of 77 ETL Jobs in the North of England

based data platforms (AWS, Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data ...

full lifecycle data solutions: acquisition, engineering, modelling, analysis, and visualisation Leading client workshops and translating business needs into technical solutions Designing and implementing scalable ETL/ELT pipelines using Azure tools (Fabric, Databricks, Synapse, Data Factory) Building data lakes with medallion architecture Migrating legacy on-prem data systems ...

Responsibilities Build and manage data pipelines using Azure Synapse, Data Factory, Databricks or Microsoft Fabric Design, implement and maintain data lakes data warehouses and ETL/ELT processes Develop scalable data models for reporting in Power BI Work closely with stakeholders to understand business needs and advise on solutions that ...

Experience with data warehouse design and data modelling (Kimball, Lakehouse/Medallion, Data Vault preferred) Building data lakes and end-to-end ELT/ETL pipelines Performance tuning across varied database environments Desirable: dbt, Docker, Microsoft BI stack, Aurora DB, Step Functions, Batch, IAM, SQS, SNS Excellent data development, modelling ...

known business in their search for a Data Engineer. The purpose of this role will be to design and build data infrastructure for efficient ETL from diverse sources, including integration and maintenance of analytics tools and ongoing pipeline monitoring and performance optimisation. This sits within the IT Department and ...

structured, and unstructured data (SQL and NoSQL). Experience integrating large, disparate datasets using modern tools and frameworks. Strong background in building and optimizing ETL/ELT data pipelines . Familiarity with source control and implementing Continuous Integration, Delivery, and Deployment via CI/CD pipelines. Experience supporting and collaborating ...

aptitude such as Computer Science, Data Engineering or a related field, is essential Knowledge & Experience: Essential: Some knowledge of data extraction, transformation, and loading (ETL) Introductory experience working with Power BI Advanced Excel skillset Desirable: Familiarity working with APIs, including to retrieve data from external sources, API configuration and data ...

libraries such as pandas, PySpark, numpy, pyodbc or associated would be beneficial Hands-on experience (or academic project experience) using PySpark. An understanding of ETL/ELT processes and/or building data flow pipelines in any technology, and how to structure data for analytical or reporting use. Familiarity with ...

months. It is also fully remote. Key Responsibilities • Design, develop, and maintain batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources ...

months. It is also fully remote. Key Responsibilities • Design, develop, and maintain batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources ...

months. It is also fully remote. Key Responsibilities • Design, develop, and maintain batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources ...

Proven hands-on experience as a Data Engineer or in a similar data-centric role. Strong proficiency in SQL and Python. Solid understanding of ETL/ELT pipelines, data modelling, and data warehousing principles. Experience working with cloud platforms such as AWS, Azure, or GCP. Exposure to modern data tools ...

data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset on a variety of internal and external data. Your Responsibilities Writes ETL (Extract/Transform/Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data … special projects and performs other duties as assigned. Your Profile Essential Skills/Knowledge/Experience Proficiency in designing, development, and maintenance of robust ETL pipelines for data ingestion and transformation. Cloud platform expertise: Good exposure with AWS services for data storage, processing, and orchestration. Data modeling and architecture: Design ...

enterprise deployments. Hands-on experience building AI and machine learning solutions using modern cloud tools (Azure preferred). Strong understanding of data engineering concepts (ETL/ELT, pipelines, warehousing). Ability to translate business challenges into technical AI/analytics solutions. Excellent stakeholder engagement and communication skills. Strategic thinker capable ...

Developer Key skills: * SQL Server * Cloud platforms, ideally Azure * Data pipeline tools, SSIS/Spark * Data warehousing and data modelling principles * ETL * MS Fabric * Python You will be a motivated SQL Developer with good communication skills and have prior experience within a similar position. The successful SQL Developer should have ...

strong sense of ownership Motivation to learn quickly in a fast-paced startup environment Nice to Have Exposure to data engineering or analytics concepts (ETL, data modelling, analytics engineering) Familiarity with tools such as PySpark, Airflow, dbt, or Databricks Experience working with business systems (ERP, CRM, operational data) Interest ...

strong sense of ownership Motivation to learn quickly in a fast-paced startup environment Nice to Have Exposure to data engineering or analytics concepts (ETL, data modelling, analytics engineering) Familiarity with tools such as PySpark, Airflow, dbt, or Databricks Experience working with business systems (ERP, CRM, operational data) Interest ...

strong sense of ownership Motivation to learn quickly in a fast-paced startup environment Nice to Have Exposure to data engineering or analytics concepts (ETL, data modelling, analytics engineering) Familiarity with tools such as PySpark, Airflow, dbt, or Databricks Experience working with business systems (ERP, CRM, operational data) Interest ...

complex business problems and designing workable technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company ...

administration of Microsoft SQL Server, including installation, configuration, upgrades, and patching. Experience supporting Databricks or other cloud-based analytics, big data, or ETL platforms. Business Intelligence Exposure: Familiarity with BI and reporting tools such as Power BI or Tableau, particularly for supporting data and performance investigations. Awareness of non-relational ...

and performance of the critical data assets. You will collaborate closely with architects, analysts, and business stakeholders to build cloud-native data platforms, streamline ETL/ELT processes, and implement best practices for data governance, quality, and security. The responsibilities include: Data Engineering & Development: Design, build and maintain high-performance … and implementing cloud-based data solutions (preferably in Azure). Expert-level SQL and database design (normalisation, indexing, query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/ ...

description :- Data Mapping & Migration: Experience with data mapping, data migration, and ETL (Extract, Transform, Load) processes. Database Knowledge: Hands-On Proficiency in SQL, relational databases (Oracle, SQL Server, DB2), and data modeling. Data Quality & Validation: Skills in data validation, cleansing, and reconciliation. Data Architecture & Design : Experience with Data Transformation programs ...

. Experience integrating telemetry into Splunk (HEC, UF, sourcetypes, CIM), building dashboards and alerting. . Strong data engineering skills in Python (or similar) for ETL/ELT, enrichment, and validation. . Knowledge of event schemas (Avro/Protobuf/JSON), contracts, and backward/forward compatibility. . Familiarity with observability ...

high-performance data warehouse that supports analytics, reporting and AI use cases Building clear, insightful Power BI dashboards used by senior stakeholders Developing ETL/ELT processes using Azure-native tools including Data Factory, Functions and Logic Apps Working hands-on with Python and SQL to transform, enrich and analyse … and compliance Main Skills Needed: Strong background in data engineering or data architecture (around 7–8 years’ experience) Proven experience building and maintaining complex ETL/ELT pipelines Advanced Python and SQL skills Solid hands-on experience with Azure data services (Data Factory, Synapse, Data Lake, Functions, Logic Apps) Power ...

than a rigid corporate machine). Technical Chops: Proficiency in SQL , and ideally Python or R , with a deep understanding of data warehousing and ETL processes. Platform Expertise: Solid experience with modern platforms like Microsoft Fabric . Stakeholder Mastery: An exceptional ability to communicate complex data insights to non-technical ...