1 to 25 of 37 Permanent ETL Jobs in the North West

data warehouses, and data lakes, to efficiently handle large volumes of structured and unstructured data. Develop and maintain scalable ETL pipelines to extract, transform, and load data from various sources into the target data systems. Create and manage data schemas, data models, and data dictionaries to facilitate data governance and … complex data pipelines. Experience with big data processing frameworks and technologies. Experience with data modelling and designing efficient data structures. Experience with data integration and ETL (Extract, Transform, Load) processes. Experience in data cleansing, validation, and enrichment processes. Strong programming skills in languages such as Python, Java, or Scala. Knowledge ...

ownership of data engineering initiatives and deliver solutions aligned with enterprise data architecture as well as governance principles. Responsibilities Build complex ETL/ELT pipelines from scratch, integrating multiple data sources while implementing advanced transformations using mapping data flows Optimise performance and manage dependencies, ensuring robust monitoring/debugging ...

with at least one major cloud platform (Azure, AWS or GCP). Exposure to big data technologies such as Spark or Hadoop. Experience with ETL/orchestration tools like Airflow, Talend or Azure Data Factory. Understanding of data warehousing solutions (Snowflake, BigQuery, Redshift or similar). Good understanding of data ...

Strong technical leadership experience, with the ability to guide and develop engineering teams Deep expertise in designing and implementing data architectures, data pipelines, and ETL processes Hands-on experience with cloud platforms (GCP, AWS, Azure) and their data-specific services Proficiency in Python, SQL, and data orchestration tools (e.g., Airflow ...

and to work well as part of, a team using the agile methodology Desirable Skills: Palantir Foundry (Pipeline Builder) experience Knowledge of ELT/ETL tools such as Informatica DEI/BDM and Talend would be beneficial Experience of mentoring junior to mid-level Data Engineers would be beneficial ...

modern data platform to seamlessly integrate and manage data from diverse sources. Maintain and enhance sophisticated financial models and reporting systems. Implement robust Extract, Transform, and Load (ETL) processes to ensure data flows smoothly and accurately. Champion data accuracy, consistency, and integrity across all BI deliverables. Contribute to the establishment ...

site production & distribution organisation Experience with BI tools and reporting systems (Power BI, DAX, SQL, Advanced Excel) advantageous Experience in building or working with ETL tools is a must Excellent communication skills and ability to work across departments, locations and countries. Proactive, detail-oriented, and technically minded with a problem ...

loading using Python. Build reproducible workflows and apply software engineering best practices, including CI/CD and version control. Design, implement and optimise business Extract, Transform and Load (ETL) pipelines. Collaborate on data modelling, storage and integration to support both geospatial and data science teams. Communicate effectively with technical and … and AI services, and MLOps Knowledge of geospatial data warehousing and analytics. Familiarity with leading AI/ML platforms and libraries Experience building and scheduling ETL workflows. Knowledge of spatial data management and geospatial queries. Experience with containerised application development (e.g. Docker). Experience in a consultancy environment, with ...

data models that effectively represent business entities and relationships and support efficient querying and analysis from relational data warehouses. Experience building and maintaining reliable ETL pipelines to integrate data from diverse sources. Strong Python expertise, including development of clean, reusable functions and object-oriented code for production-quality solutions. Solid ...

problems, enabling others to thrive, and shaping the future of data at CAVU. Qualifications & Experience Strong experience with medallion architecture and Databricks Proficiency with ETL tools (e.g., Rivery) and ML-Ops frameworks Strong programming skills (Python, Scala or Java) Experience with cloud platforms (AWS, Azure, or GCP) Excellent communication skills ...

complex business problems and designing workable technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company ...

looking for candidates with a blend of the following: Strong knowledge of AWS data services (Glue, S3, Lambda, Redshift, etc.) Solid understanding of ETL processes and data pipeline management Proficiency in Python and PySpark Experience working with SQL-based platforms Previous involvement in migrating on-premise solutions to cloud ...

example S3, Glue, Athena, Lambda, IAM, EMR). • Strong SQL skills (joins, window functions, optimization). • Solid Python for data processing. • Experience building production ETL/ELT pipelines. • Working knowledge of security and IAM (roles, policies, least privilege). • Experience with Infrastructure as Code ( IaC) and CI/ ...

and Skills Required: - Proficiency in Azure Databricks for data engineering tasks. - Strong understanding of data transformation and pipeline development. - Experience with data integration and ETL processes. - Ability to collaborate with cross-functional teams to enhance data solutions. - Familiarity with cloud-based data storage and processing solutions. This is an excellent ...

and Skills Required:- Proficiency in Azure Databricks for data engineering tasks.- Strong understanding of data transformation and pipeline development.- Experience with data integration and ETL processes.- Ability to collaborate with cross-functional teams to enhance data solutions.- Familiarity with cloud-based data storage and processing solutions.This is an excellent opportunity ...

more. Produce reports and analysis summarising the performance of offices, branches and regions. Analyse individual business data and make recommendations to improve performance. Creating ETL solutions to capture data from multiple sources and map/structure into either QVD files or SQL databases depending on the solution required. Optimize ...

looking for from you: SQL technologies skills (e.g. MS SQL, Oracle...) noSQL technologies skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development (e.g. Python) skills Big data technologies knowledge (e.g. Hadoop stack) Knowledge in NLP (Natural Language Processing) Knowledge in OCR (Object Character Recognition ...

pandas, polars, numpy) Experience with Microsoft SQL Server and preferably time series databases Familiarity with machine learning operations (MLOps) Experience designing and developing scalable ETL pipelines and knowledge of DevOps principles Collaborative approach with strong stakeholder engagement skills Effective problem-solving and critical thinking abilities Proactive mindset with a focus ...

and coding standards. Support data integrity checks, assist with data migrations, and implement data transformation processes using tools like Data Loader or third-party ETL/DWH solutions. Respond to and resolve system-related incidents, bugs, and service requests in a timely and effective manner. Participate in audits, compliance reviews ...

and deploying applications using DevOps practises in a production environment through a CI/CD pipeline. Demonstrable experience of testing across e2e lifecycle, including ETL, Unit, Regression Strong technical leadership skills, demonstrating the ability to effectively lead and collaborate with other developers and teams to solve technical problems and achieve ...

and performance of the critical data assets. You will collaborate closely with architects, analysts, and business stakeholders to build cloud-native data platforms, streamline ETL/ELT processes, and implement best practices for data governance, quality, and security. The responsibilities include: Data Engineering & Development: Design, build and maintain high-performance … and implementing cloud-based data solutions (preferably in Azure). Expert-level SQL and database design (normalisation, indexing, query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/ ...

and performance of the critical data assets. You will collaborate closely with architects, analysts, and business stakeholders to build cloud-native data platforms, streamline ETL/ELT processes, and implement best practices for data governance, quality, and security. The responsibilities include: Data Engineering & Development: Design, build and maintain high-performance … and implementing cloud-based data solutions (preferably in Azure). Expert-level SQL and database design (normalisation, indexing, query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/ ...

experience in providing application support Ability to create technical documentation, knowledge-based articles and user guides Knowledge of reporting tools, SQL, Power BI or ETL Familiar with supporting Northgate Housing Management System (or similar) is advantageous Experience supporting repairs & scheduling systems (ROCC, DRS or similar) also advantageous but not essential ...

experience in providing application support Ability to create technical documentation, knowledge-based articles and user guides Knowledge of reporting tools, SQL, Power BI or ETL Familiar with supporting Northgate Housing Management System (or similar) is advantageous Experience supporting repairs & scheduling systems (ROCC, DRS or similar) also advantageous but not essential ...

and implement a comprehensive data strategy for the Digital function, focused on ERP transformation. Lead the data workstream, covering the full data migration lifecycle (ETL). Oversee data governance, profiling, cleansing, enrichment, and quality assurance. Manage and mentor a team of analysts, migration specialists, and external consultants. Report on data ...