1 to 25 of 72 ETL Jobs in the North of England

modern cloud data platforms (e.g. Microsoft Fabric, Databricks) Expertise with multiple data analytics tools (e.g. Power BI) Deep understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity ...

modern cloud data platforms (e.g. Microsoft Fabric, Databricks) Expertise with multiple data analytics tools (e.g. Power BI) Deep understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity ...

modern cloud data platforms (e.g. Microsoft Fabric, Databricks) Expertise with multiple data analytics tools (e.g. Power BI) Deep understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity ...

based data platforms (AWS, Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data ...

full lifecycle data solutions: acquisition, engineering, modelling, analysis, and visualisation Leading client workshops and translating business needs into technical solutions Designing and implementing scalable ETL/ELT pipelines using Azure tools (Fabric, Databricks, Synapse, Data Factory) Building data lakes with medallion architecture Migrating legacy on-prem data systems ...

Responsibilities Build and manage data pipelines using Azure Synapse, Data Factory, Databricks or Microsoft Fabric Design, implement and maintain data lakes data warehouses and ETL/ELT processes Develop scalable data models for reporting in Power BI Work closely with stakeholders to understand business needs and advise on solutions that ...

Experience with data warehouse design and data modelling (Kimball, Lakehouse/Medallion, Data Vault preferred) Building data lakes and end-to-end ELT/ETL pipelines Performance tuning across varied database environments Desirable: dbt, Docker, Microsoft BI stack, Aurora DB, Step Functions, Batch, IAM, SQS, SNS Excellent data development, modelling ...

known business in their search for a Data Engineer. The purpose of this role will be to design and build data infrastructure for efficient ETL from diverse sources, including integration and maintenance of analytics tools and ongoing pipeline monitoring and performance optimisation. This sits within the IT Department and ...

libraries such as pandas, PySpark, numpy, pyodbc or associated would be beneficial Hands-on experience (or academic project experience) using PySpark. An understanding of ETL/ELT processes and/or building data flow pipelines in any technology, and how to structure data for analytical or reporting use. Familiarity with ...

months. It is also fully remote. Key Responsibilities • Design, develop, and maintain batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources ...

months. It is also fully remote. Key Responsibilities • Design, develop, and maintain batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources ...

months. It is also fully remote. Key Responsibilities • Design, develop, and maintain batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources ...

Exposure to multi-platform integration (MS tools preferred). On premise SQL environments, legacy SSIS, SSRS and other SQL-related technologies employed in complex ETL or ELT patterns Synapse Link for Dataverse Dataverse, Data Flows, Cloud Flows, DAX and Power Platform implementations Synchronisation methods for Synapse and Fabric from D365 ...

Exposure to multi-platform integration (MS tools preferred). On premise SQL environments, legacy SSIS, SSRS and other SQL-related technologies employed in complex ETL or ELT patterns Synapse Link for Dataverse Dataverse, Data Flows, Cloud Flows, DAX and Power Platform implementations Synchronisation methods for Synapse and Fabric from D365 ...

Exposure to multi-platform integration (MS tools preferred). On premise SQL environments, legacy SSIS, SSRS and other SQL-related technologies employed in complex ETL or ELT patterns Synapse Link for Dataverse Dataverse, Data Flows, Cloud Flows, DAX and Power Platform implementations Synchronisation methods for Synapse and Fabric from D365 ...

Exposure to multi-platform integration (MS tools preferred). On premise SQL environments, legacy SSIS, SSRS and other SQL-related technologies employed in complex ETL or ELT patterns Synapse Link for Dataverse Dataverse, Data Flows, Cloud Flows, DAX and Power Platform implementations Synchronisation methods for Synapse and Fabric from D365 ...

Exposure to multi-platform integration (MS tools preferred). On premise SQL environments, legacy SSIS, SSRS and other SQL-related technologies employed in complex ETL or ELT patterns Synapse Link for Dataverse Dataverse, Data Flows, Cloud Flows, DAX and Power Platform implementations Synchronisation methods for Synapse and Fabric from D365 ...

Exposure to multi-platform integration (MS tools preferred). On premise SQL environments, legacy SSIS, SSRS and other SQL-related technologies employed in complex ETL or ELT patterns Synapse Link for Dataverse Dataverse, Data Flows, Cloud Flows, DAX and Power Platform implementations Synchronisation methods for Synapse and Fabric from D365 ...

Exposure to multi-platform integration (MS tools preferred). On premise SQL environments, legacy SSIS, SSRS and other SQL-related technologies employed in complex ETL or ELT patterns Synapse Link for Dataverse Dataverse, Data Flows, Cloud Flows, DAX and Power Platform implementations Synchronisation methods for Synapse and Fabric from D365 ...

loading using Python. Build reproducible workflows and apply software engineering best practices, including CI/CD and version control. Design, implement and optimise business Extract, Transform and Load (ETL) pipelines. Collaborate on data modelling, storage and integration to support both geospatial and data science teams. Communicate effectively with technical and … and AI services, and MLOps Knowledge of geospatial data warehousing and analytics. Familiarity with leading AI/ML platforms and libraries Experience building and scheduling ETL workflows. Knowledge of spatial data management and geospatial queries. Experience with containerised application development (e.g. Docker). Experience in a consultancy environment, with ...

data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset on a variety of internal and external data. Your Responsibilities Writes ETL (Extract/Transform/Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data … special projects and performs other duties as assigned. Your Profile Essential Skills/Knowledge/Experience Proficiency in designing, development, and maintenance of robust ETL pipelines for data ingestion and transformation. Cloud platform expertise: Good exposure with AWS services for data storage, processing, and orchestration. Data modeling and architecture: Design ...

enterprise deployments. Hands-on experience building AI and machine learning solutions using modern cloud tools (Azure preferred). Strong understanding of data engineering concepts (ETL/ELT, pipelines, warehousing). Ability to translate business challenges into technical AI/analytics solutions. Excellent stakeholder engagement and communication skills. Strategic thinker capable ...

Developer Key skills: * SQL Server * Cloud platforms, ideally Azure * Data pipeline tools, SSIS/Spark * Data warehousing and data modelling principles * ETL * MS Fabric * Python You will be a motivated SQL Developer with good communication skills and have prior experience within a similar position. The successful SQL Developer should have ...

complex business problems and designing workable technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company ...

administration of Microsoft SQL Server, including installation, configuration, upgrades, and patching. Experience supporting Databricks or other cloud-based analytics, big data, or ETL platforms. Business Intelligence Exposure: Familiarity with BI and reporting tools such as Power BI or Tableau, particularly for supporting data and performance investigations. Awareness of non-relational ...