1 to 25 of 60 ETL Jobs in the North of England

based data platforms (AWS, Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data ...

Responsibilities Build and manage data pipelines using Azure Synapse, Data Factory, Databricks or Microsoft Fabric Design, implement and maintain data lakes data warehouses and ETL/ELT processes Develop scalable data models for reporting in Power BI Work closely with stakeholders to understand business needs and advise on solutions that ...

Databricks and modern cloud technologies. Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, and Delta Lake Build and optimize ETL/ELT workflows for batch and streaming data Develop data models to support analytics, reporting, and machine learning use cases Ensure data quality, reliability, and ...

Experience with data warehouse design and data modelling (Kimball, Lakehouse/Medallion, Data Vault preferred) Building data lakes and end-to-end ELT/ETL pipelines Performance tuning across varied database environments Desirable: dbt, Docker, Microsoft BI stack, Aurora DB, Step Functions, Batch, IAM, SQS, SNS Excellent data development, modelling ...

known business in their search for a Data Engineer. The purpose of this role will be to design and build data infrastructure for efficient ETL from diverse sources, including integration and maintenance of analytics tools and ongoing pipeline monitoring and performance optimisation. This sits within the IT Department and ...

matures Skills & Experience Strong experience in data engineering within a Microsoft ecosystem with hands-on experience with: Azure Data Lake Azure data pipelines/ETL SQL and relational data modelling Comfortable working with high-volume, low-value transaction data Experience integrating multiple systems into a central data platform Ability ...

structured, and unstructured data (SQL and NoSQL). Experience integrating large, disparate datasets using modern tools and frameworks. Strong background in building and optimizing ETL/ELT data pipelines . Familiarity with source control and implementing Continuous Integration, Delivery, and Deployment via CI/CD pipelines. Experience supporting and collaborating ...

aptitude such as Computer Science, Data Engineering or a related field, is essential Knowledge & Experience: Essential: Some knowledge of data extraction, transformation, and loading (ETL) Introductory experience working with Power BI Advanced Excel skillset Desirable: Familiarity working with APIs, including to retrieve data from external sources, API configuration and data ...

libraries such as pandas, PySpark, numpy, pyodbc or associated would be beneficial Hands-on experience (or academic project experience) using PySpark. An understanding of ETL/ELT processes and/or building data flow pipelines in any technology, and how to structure data for analytical or reporting use. Familiarity with ...

Proven hands-on experience as a Data Engineer or in a similar data-centric role. Strong proficiency in SQL and Python. Solid understanding of ETL/ELT pipelines, data modelling, and data warehousing principles. Experience working with cloud platforms such as AWS, Azure, or GCP. Exposure to modern data tools ...

data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset on a variety of internal and external data. Your Responsibilities Writes ETL (Extract/Transform/Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data … special projects and performs other duties as assigned. Your Profile Essential Skills/Knowledge/Experience Proficiency in designing, development, and maintenance of robust ETL pipelines for data ingestion and transformation. Cloud platform expertise: Good exposure with AWS services for data storage, processing, and orchestration. Data modeling and architecture: Design ...

Developer Key skills: * SQL Server * Cloud platforms, ideally Azure * Data pipeline tools, SSIS/Spark * Data warehousing and data modelling principles * ETL * MS Fabric * Python You will be a motivated SQL Developer with good communication skills and have prior experience within a similar position. The successful SQL Developer should have ...

complex business problems and designing workable technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company ...

administration of Microsoft SQL Server, including installation, configuration, upgrades, and patching. Experience supporting Databricks or other cloud-based analytics, big data, or ETL platforms. Business Intelligence Exposure: Familiarity with BI and reporting tools such as Power BI or Tableau, particularly for supporting data and performance investigations. Awareness of non-relational ...

architecture, designing and delivering enterprise-scale data solutions Strong expertise in data modelling with excellent SQL skills Deep knowledge of modern data engineering patterns (ETL/ELT, data lakes, lakehouse, warehousing) Hands-on experience with cloud data platforms (AWS preferred: Redshift, Athena, S3, Glue; Azure or GCP beneficial) Experience with ...

and performance of the critical data assets. You will collaborate closely with architects, analysts, and business stakeholders to build cloud-native data platforms, streamline ETL/ELT processes, and implement best practices for data governance, quality, and security. The responsibilities include: Data Engineering & Development: Design, build and maintain high-performance … and implementing cloud-based data solutions (preferably in Azure). Expert-level SQL and database design (normalisation, indexing, query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/ ...

high-performance data warehouse that supports analytics, reporting and AI use cases Building clear, insightful Power BI dashboards used by senior stakeholders Developing ETL/ELT processes using Azure-native tools including Data Factory, Functions and Logic Apps Working hands-on with Python and SQL to transform, enrich and analyse … and compliance Main Skills Needed: Strong background in data engineering or data architecture (around 7–8 years’ experience) Proven experience building and maintaining complex ETL/ELT pipelines Advanced Python and SQL skills Solid hands-on experience with Azure data services (Data Factory, Synapse, Data Lake, Functions, Logic Apps) Power ...

than a rigid corporate machine). Technical Chops: Proficiency in SQL , and ideally Python or R , with a deep understanding of data warehousing and ETL processes. Platform Expertise: Solid experience with modern platforms like Microsoft Fabric . Stakeholder Mastery: An exceptional ability to communicate complex data insights to non-technical ...

optimisation. What You Will Need (Responsibilities/Requirements) Strong, demonstrable expertise in SQL and hands-on experience transforming data. Experience delivering data pipelines and ETL/ELT processes into Snowflake (or similar cloud data warehousing platforms). Understanding of modern data engineering concepts: modelling, integration, quality, monitoring, optimisation. Experience working ...

development projects. Advanced TypeScript skills and strong containerization experience (AKS). Hands-on expertise across Azure compute, storage, networking, and security. Exposure to Databricks, ETL, and analytics workflows. Strong leadership abilities: mentoring, code review, and collaborative solution-design. Excellent problem-solving skills and the ability to communicate technical concepts ...

development projects. Advanced TypeScript skills and strong containerization experience (AKS). Hands-on expertise across Azure compute, storage, networking, and security. Exposure to Databricks, ETL, and analytics workflows. Strong leadership abilities: mentoring, code review, and collaborative solution-design. Excellent problem-solving skills and the ability to communicate technical concepts ...

development projects. Advanced TypeScript skills and strong containerization experience (AKS). Hands-on expertise across Azure compute, storage, networking, and security. Exposure to Databricks, ETL, and analytics workflows. Strong leadership abilities: mentoring, code review, and collaborative solution-design. Excellent problem-solving skills and the ability to communicate technical concepts ...

tooling. Experience integrating telemetry into Splunk (HEC, UF, sourcetypes, CIM), building dashboards and alerting. Strong data engineering skills in Python (or similar) for ETL/ELT, enrichment, and validation. Knowledge of event schemas (Avro/Protobuf/JSON), contracts, and backward/forward compatibility. Familiarity with observability standards and practices ...

looking for from you: SQL technologies skills (e.g. MS SQL, Oracle...) noSQL technologies skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development (e.g. Python) skills Big data technologies knowledge (e.g. Hadoop stack) Knowledge in NLP (Natural Language Processing) Knowledge in OCR (Object Character Recognition ...

management, integration, or analytics for utilities or energy sectors. Strong knowledge of data fabric architectures, metadata management, and data governance principles. Experience with SQL, ETL tools, and big data technologies (e.g., Hadoop, Spark, Kafka). Familiarity with cloud platforms (AWS, Azure, or Google Cloud) and data integration frameworks. Strong problem ...