1 to 25 of 56 ETL Jobs in Lancashire

services. Knowledge of using PySpark in notebooks for data analysis and manipulation. Strong proficiency with SQL and data modelling. Experience with modern ELT/ETL tools within the Microsoft ecosystem. Solid understanding of data lake and lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity More ❯

organization to address their data needs, craft agile solutions, and continuously improve the data environment. What will you be doing? Design and implement efficient ETL processes for data extraction, transformation, and loading. Build real-time data processing pipelines using platforms like Apache Kafka or cloud-native tools. Optimize batch processing More ❯

and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist in gathering, documenting, and managing data engineering requirements and workflows. Contribute to the development … reviews of designs, prototypes, and other work products to ensure requirements are met. Skills & Experience: Essential: Basic understanding of data engineering concepts, such as ETL processes, data pipelines, and data quality management. Hands-on experience with SQL (e.g., writing queries, basic database management). Familiarity with data tools and platforms More ❯

IF YOU ARE Experienced with Python/PySpark Proficient working with Databricks Lakehouse architecture and principles Having 2+ years of designing data models, building ETL pipelines, and wrangling data to solve business problems Experienced with Azure cloud technologies Modern Data Estate such as Azure Data Factory, Azure DevOps, Azure Synapse More ❯

collaborate with many technology partners like AWS, GCP, Microsoft, Databricks, Snowflake, Confluent, and others. IF YOU ARE A technology professional focused on Data Warehouses, ETL, and BI solutions development Experienced in eliciting business requirements to address the customer’s data visualization needs Ready to dive into a customer's subject More ❯

On a daily basis your varied role will include, but will not be limited to: Design, build, and optimize high-performance data pipelines and ETL workflows using tools like Azure Synapse, Azure Databricks or Microsoft Fabric. Implement scalable solutions to ingest, store, and transform vast datasets, ensuring data availability and More ❯

understanding of standard Enterprise IT solutions and data modelling in a manufacturing and distribution context is essential. Experience with leading BI tools in Azure, ETL, Streaming Data and Data Warehousing such as Synapse Analytics, Power BI, Azure SQL Data Warehouse, ADF and related platforms is crucial. Advanced T-SQL programming More ❯

reporting development (advanced/expert levels only). Key Tools & Technologies Visualization Tools: Tibco Spotfire, Tableau, Power BI, or QlikView Data Management & Querying: SQL, ETL pipelines, Data Warehousing (e.g., ODW) Scripting/Programming: Iron Python, R, R Shiny, SAS Collaboration & Platforms: SharePoint, clinical trial data platforms Qualifications Entry Level: Bachelor More ❯

to offices and client sites Employment: Permanent, Full-time What You'll Actually Be Doing: Designing, developing, and deploying robust Azure data solutions including ETL pipelines, data warehouses, and real-time analytics. No fluff, just solid engineering. Turning complex client requirements into clear, scalable Azure solutions alongside experienced Architects and More ❯

Design: Architect and implement robust designs, ensuring optimal performance, scalability, and security Translate high-level solution designs into detailed technical specifications, including data models, ETL processes, and database schemas Establish and enforce data modelling best practices, promoting data integrity and consistency across all platforms ETL Development & Optimization: Develop and optimize … complex ETL pipelines for diverse data sources (on-premise and cloud-based), utilizing best practices for data extraction, transformation, and loading Implement data quality checks and validation processes within ETL pipelines, ensuring data accuracy and reliability Optimize ETL performance for speed and efficiency, addressing bottlenecks and improving data processing times … information to non-technical stakeholders, and ensuring alignment with business objectives The Person Essential: Minimum 5+ years of experience in designing and implementing data ETL processes and design Expert-level proficiency in T-SQL, SSIS, and the Microsoft data stack (SQL Server, Azure SQL Database) Proven proficiency in Azure Data More ❯

Design: Architect and implement robust designs, ensuring optimal performance, scalability, and security Translate high-level solution designs into detailed technical specifications, including data models, ETL processes, and database schemas Establish and enforce data modelling best practices, promoting data integrity and consistency across all platforms ETL Development & Optimization: Develop and optimize … complex ETL pipelines for diverse data sources (on-premise and cloud-based), utilizing best practices for data extraction, transformation, and loading Implement data quality checks and validation processes within ETL pipelines, ensuring data accuracy and reliability Optimize ETL performance for speed and efficiency, addressing bottlenecks and improving data processing times … information to non-technical stakeholders, and ensuring alignment with business objectives The Person Essential: Minimum 5+ years of experience in designing and implementing data ETL processes and design Expert-level proficiency in T-SQL, SSIS, and the Microsoft data stack (SQL Server, Azure SQL Database) Proven proficiency in Azure Data More ❯

Design: Architect and implement robust designs, ensuring optimal performance, scalability, and security Translate high-level solution designs into detailed technical specifications, including data models, ETL processes, and database schemas Establish and enforce data modelling best practices, promoting data integrity and consistency across all platforms ETL Development & Optimization: Develop and optimize … complex ETL pipelines for diverse data sources (on-premise and cloud-based), utilizing best practices for data extraction, transformation, and loading Implement data quality checks and validation processes within ETL pipelines, ensuring data accuracy and reliability Optimize ETL performance for speed and efficiency, addressing bottlenecks and improving data processing times … information to non-technical stakeholders, and ensuring alignment with business objectives The Person Essential: Minimum 5+ years of experience in designing and implementing data ETL processes and design Expert-level proficiency in T-SQL, SSIS, and the Microsoft data stack (SQL Server, Azure SQL Database) Proven proficiency in Azure Data More ❯

practices, and best practices for data modeling, warehousing, and interoperability. Lead the evaluation and implementation of data tools, platforms, and technologies (e.g., cloud services, ETL tools, data lakes). Ensure data security, compliance, and privacy policies are embedded in all architecture designs. Provide technical guidance and mentorship to data engineers More ❯

meet current best practices and internal standards. Work closely with project managers and technical leads to integrate new enterprise data sources into ongoing projects. ETL Development Develop robust, automated ETL (Extract, Transform, Load) pipelines using industry-standard tools and frameworks, prioritizing scalability, reliability, and fault tolerance. Essential Skills & Experience Strong … ESRI, 3GIS, Bentley, Hexagon, Crescent Link, CadTel, etc.). Experience with business requirement analysis and the development of reporting and analytics structures. Familiarity with ETL solutions, including experience with SAFE FME, is highly desirable. Strong knowledge of data privacy regulations and practices. Exposure to analytics and reporting tools is considered More ❯

in: Azure Data & AI services (e.g., Azure Machine Learning, Azure OpenAI, Cognitive Services, Synapse) Programming with Python for data and AI workloads Data pipelines, ETL/ELT processes, and analytics foundations App development techniques to integrate AI capabilities Working in secure, enterprise-ready cloud environments Consulting fundamentals and effective customer More ❯

Tools Proficiency: Expertise in Power BI, Tableau or similar visualisation tools. SQL and Databases: Strong knowledge of SQL, data warehousing concepts, and database management. ETL Processes: Experience with Extract, Transform, Load (ETL) processes (e.g. SSIS, AWS Glue, DBT). Data Modelling: Ability to create and manage data models. Data Analysis More ❯

business/data analyst role, ideally in a consultancy or commercial setting. - Strong analytical, problem-solving, and communication skills. - Experience with operational data processes, ETL, data warehouse migration, schema mapping, and MI/BI reporting. - Proficient in tools such as JIRA, Confluence, Asana, Miro, and Excel. - Familiarity with Agile (SCRUM More ❯

for data analysis Experience with data visualisation software (PowerBI preferred) to create clear and insightful visualisations Experience using SQL suite of software including the ETL process Ability to present data and findings clearly and concisely to both technical and non-technical audiences. Ability to work collaboratively within a team environment More ❯

Application Gateways and API Management services. SQL Services - MI, PaaS, IaaS, ADF, SSIS, etc. Storage services - files and blob. Data Lake Services, PowerBI and ETL technologies. More ❯

shape something from the ground up — this is for you. What you’ll do: Design and build a cloud-native data warehouse Develop scalable ETL/ELT pipelines and dimensional models (Kimball, Data Vault, etc.) Integrate multiple data sources (cloud & on-prem) Ensure high data quality, performance and reliability Collaborate More ❯

data sets, produce dashboards and drive actionable insights. SQL Development: Write and optimise complex Microsoft SQL Server queries for data extraction, transformation and loading (ETL). Data Governance: Implement master data management and governance policies to maintain data quality, compliance and lineage. Stakeholder Management: Communicate effectively with project managers and More ❯

of opportunities for ownership and innovation. Key Responsibilities Design and deploy cloud-based data platforms using Snowflake, DBT, and related tools Develop performant, scalable ETL/ELT pipelines across varied data sources Build and maintain dimensional models using Kimball, Data Vault, or Data Mesh methodologies Collaborate with cross-functional teams More ❯

Risk and Claims) using data ingestion/analysis tools such as Intrali, Quantemplate or Matillion. The project centres on the extraction, transformation and loading (ETL) of data from various sources into data warehouses and data lakes. This is the perfect role for an aspiring Data Architect in the Insurance Industry. More ❯

needs and business strategies. Cloud Architecture: Design and implement scalable, cost-effective architectures across AWS, Azure, or GCP environments. Data Engineering: Develop and manage ETL/ELT pipelines, data integration workflows, and implement CDC and delta load design for effective data management. SAP Tools: Lead SAP BW to SAP Datasphere More ❯

Knowledge (Snowflake, PostgreSQL, MSSQL, etc.). Scripting languages (Python, PowerShell). Data quality and resolving related processes Cloud Data Warehousing solutions and ELT/ETL solutions (e.g., Snowflake, DBT). Experience in working within an Agile environment. Experience with Automation, including Unit and Integration Testing. Knowledge of Cloud Concepts. For More ❯