1 to 25 of 85 Permanent ETL Jobs in Lancashire

Databricks, SQL Database, Data Factory, and T-SQL. In-depth understanding of London Market insurance data and Actuarial/Finance business processes. Experience with ETL processes, data modelling, and dimensional modelling techniques. Proficient with Azure DevOps, CI/CD, GIT, and deployment strategies. Proven track record in delivering cloud-based More ❯

reporting. Strong programming skills in Python, with experience in data processing libraries like Pandas and NumPy. Experience with data pipeline development, data warehousing, and ETL processes. Strong analytical and problem-solving skills, with attention to detail and ability to work in a fast-paced environment. Excellent communication and collaboration skills. More ❯

core GCP data services such as BigQuery, Composer, Dataform, Dataproc, and Pub/Sub. Strong programming skills in PySpark, Python, and SQL. Proficiency in ETL processes, data mining, and data storage principles. Experience with BI and data visualisation tools, such as Looker or Power BI. Excellent communication skills, with the More ❯

Fabric , and/or Azure Synapse Analytics Hands-on experience with Python and working with APIs and SFTP data connectors Knowledge of data modelling , ETL pipelines , and data governance principles Demonstrable experience in stakeholder engagement , especially with senior leaders and cross-functional teams Ability to work independently and manage multiple More ❯

organization to address their data needs, craft agile solutions, and continuously improve the data environment. What will you be doing? Design and implement efficient ETL processes for data extraction, transformation, and loading. Build real-time data processing pipelines using platforms like Apache Kafka or cloud-native tools. Optimize batch processing More ❯

SQL & Cosmos DB Azure Purview (for Data Governance) Azure Blob Storage & Data Lake Azure Event Hubs & Streaming Analytics Hands-on experience with data integration, ETL/ELT pipelines, and batch/real-time processing. Strong knowledge of data security, governance frameworks, and NHS interoperability standards (FHIR, HL7). Familiarity with More ❯

and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist in gathering, documenting, and managing data engineering requirements and workflows. Contribute to the development … reviews of designs, prototypes, and other work products to ensure requirements are met. Skills & Experience: Essential: Basic understanding of data engineering concepts, such as ETL processes, data pipelines, and data quality management. Hands-on experience with SQL (e.g., writing queries, basic database management). Familiarity with data tools and platforms More ❯

On a daily basis your varied role will include, but will not be limited to: Design, build, and optimize high-performance data pipelines and ETL workflows using tools like Azure Synapse, Azure Databricks or Microsoft Fabric. Implement scalable solutions to ingest, store, and transform vast datasets, ensuring data availability and More ❯

Proficiency in Azure cloud services such as Azure Data Lake, Azure Synapse Analytics, Azure SQL Database, and Azure Key Vault. Hands-on experience with ETL/ELT processes, data transformation, and data integration patterns. Programming and Scripting : Proficiency in SQL, Python, or other scripting languages for data manipulation and automation. More ❯

configuration. Proficiency in Azure services such as Azure Data Lake, Azure Synapse Analytics, Azure SQL Database, and Azure Key Vault. Hands-on experience with ETL/ELT processes, data transformation, and data integration patterns. Programming and Scripting: Proficiency in SQL, Python, or other scripting languages for data manipulation and automation. More ❯

Design: Architect and implement robust designs, ensuring optimal performance, scalability, and security Translate high-level solution designs into detailed technical specifications, including data models, ETL processes, and database schemas Establish and enforce data modelling best practices, promoting data integrity and consistency across all platforms ETL Development & Optimization: Develop and optimize … complex ETL pipelines for diverse data sources (on-premise and cloud-based), utilizing best practices for data extraction, transformation, and loading Implement data quality checks and validation processes within ETL pipelines, ensuring data accuracy and reliability Optimize ETL performance for speed and efficiency, addressing bottlenecks and improving data processing times … information to non-technical stakeholders, and ensuring alignment with business objectives The Person Essential: Minimum 5+ years of experience in designing and implementing data ETL processes and design Expert-level proficiency in T-SQL, SSIS, and the Microsoft data stack (SQL Server, Azure SQL Database) Proven proficiency in Azure Data More ❯

Design: Architect and implement robust designs, ensuring optimal performance, scalability, and security Translate high-level solution designs into detailed technical specifications, including data models, ETL processes, and database schemas Establish and enforce data modelling best practices, promoting data integrity and consistency across all platforms ETL Development & Optimization: Develop and optimize … complex ETL pipelines for diverse data sources (on-premise and cloud-based), utilizing best practices for data extraction, transformation, and loading Implement data quality checks and validation processes within ETL pipelines, ensuring data accuracy and reliability Optimize ETL performance for speed and efficiency, addressing bottlenecks and improving data processing times … information to non-technical stakeholders, and ensuring alignment with business objectives The Person Essential: Minimum 5+ years of experience in designing and implementing data ETL processes and design Expert-level proficiency in T-SQL, SSIS, and the Microsoft data stack (SQL Server, Azure SQL Database) Proven proficiency in Azure Data More ❯

Design: Architect and implement robust designs, ensuring optimal performance, scalability, and security Translate high-level solution designs into detailed technical specifications, including data models, ETL processes, and database schemas Establish and enforce data modelling best practices, promoting data integrity and consistency across all platforms ETL Development & Optimization: Develop and optimize … complex ETL pipelines for diverse data sources (on-premise and cloud-based), utilizing best practices for data extraction, transformation, and loading Implement data quality checks and validation processes within ETL pipelines, ensuring data accuracy and reliability Optimize ETL performance for speed and efficiency, addressing bottlenecks and improving data processing times … information to non-technical stakeholders, and ensuring alignment with business objectives The Person Essential: Minimum 5+ years of experience in designing and implementing data ETL processes and design Expert-level proficiency in T-SQL, SSIS, and the Microsoft data stack (SQL Server, Azure SQL Database) Proven proficiency in Azure Data More ❯

Spoke architecture patterns. Experience and detailed understanding of AWS and/or Azure data provision through a loosely coupled cloud stack including Data Integration (ETL/ELT) eg Spark and/or Informatica, Data Quality, Data Catalogue, data storage to provide multi-cloud analytical and insight data for our critical More ❯

SSRS) Design and implement complex SQL queries, stored procedures, and performance tuning Contribute to data warehouse architecture and dimensional modeling Work within OLAP and ETL frameworks to support scalable BI solutions Collaborate with cross-functional teams to translate business needs into technical solutions Required Skills & Experience: Proven experience in a More ❯

ingesting, transforming, and loading data from various sources (e.g., APIs, databases, files) into the Azure Databricks platform. o Implement data extraction, transformation, and loading (ETL) processes. o Ensure data pipelines are efficient, reliable, and scalable. Data Transformation & Processing: o Implement data transformations using Spark (PySpark or Scala) and other relevant More ❯

dashboards Maintaining and leveraging CI/CD deployment pipelines to promote application code into higher tier environments ✅ Must have requirements: Experience developing ELT/ETL ingestion pipelines Python SQL Azure cloud 👍 Bonus points for experience with: DBT CI/CD - e.g. Azure DevOps IaC - e.g. Terraform or Pulumi Data warehousing More ❯

reporting development (advanced/expert levels only). Key Tools & Technologies Visualization Tools: Tibco Spotfire, Tableau, Power BI, or QlikView Data Management & Querying: SQL, ETL pipelines, Data Warehousing (e.g., ODW) Scripting/Programming: Iron Python, R, R Shiny, SAS Collaboration & Platforms: SharePoint, clinical trial data platforms Qualifications Entry Level: Bachelor More ❯

be a SPOC for all technical discussions across industry groups. Excellent design experience, with entrepreneurship skills to own and lead solutions for clients Excellent ETL skills, Data Modeling Skills Excellent communication skills Ability to define the monitoring, alerting, deployment strategies for various services. Experience providing solution for resiliency, fail over More ❯

in: Azure Data & AI services (e.g., Azure Machine Learning, Azure OpenAI, Cognitive Services, Synapse) Programming with Python for data and AI workloads Data pipelines, ETL/ELT processes, and analytics foundations App development techniques to integrate AI capabilities Working in secure, enterprise-ready cloud environments Consulting fundamentals and effective customer More ❯

and aligned with business goals. Key Responsibilities: · Design, build and maintain robust data pipelines and transformation logic · Own data engineering processes across ELT/ETL, batch, streaming, and APIs · Collaborate with cross-functional teams to understand and deliver on business needs · Ensure regulatory compliance, data quality, and pipeline documentation · Optimise More ❯

ll play a key role in delivering high-quality data solutions across the business. Responsibilities include: Designing and leading the development of data pipelines, ETL processes, and reporting dashboards Ensuring data integrity and consistency through effective governance practices Supporting key projects across insurance, credit risk, and financial services Collaborating with More ❯

Data Engineer - Non-Profit/Health Charity - Cambridge (Tech Stack: Data Engineer, Python, Azure, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) Our client, a health-focused non-profit based in Cambridge, is seeking a Lead Data Engineer with deep AWS expertise to help shape their cloud data infrastructure. More ❯

meet current best practices and internal standards. Work closely with project managers and technical leads to integrate new enterprise data sources into ongoing projects. ETL Development Develop robust, automated ETL (Extract, Transform, Load) pipelines using industry-standard tools and frameworks, prioritizing scalability, reliability, and fault tolerance. Essential Skills & Experience Strong … ESRI, 3GIS, Bentley, Hexagon, Crescent Link, CadTel, etc.). Experience with business requirement analysis and the development of reporting and analytics structures. Familiarity with ETL solutions, including experience with SAFE FME, is highly desirable. Strong knowledge of data privacy regulations and practices. Exposure to analytics and reporting tools is considered More ❯

Tools Proficiency: Expertise in Power BI, Tableau or similar visualisation tools. SQL and Databases: Strong knowledge of SQL, data warehousing concepts, and database management. ETL Processes: Experience with Extract, Transform, Load (ETL) processes (e.g. SSIS, AWS Glue, DBT). Data Modelling: Ability to create and manage data models. Data Analysis More ❯