426 to 450 of 774 ETL Jobs in the UK excluding London

to 30), Flexible hours, hybrid (1-2 days in Cardiff), 6% pension, healthcare + more! What you'd bring: Experience architecting & building data pipelines (ETL) Strong Python & SQL skills Knowledge of Storage/DWH solutions Tech stack: Python, SQL, Matillion, Snowflake, Tableau, LLMs (GBT), AWS (no tech essentials outside Python More ❯

cloud platform. Skilled in scalable, reliable, and efficient data solutions, often using AWS services like S3, Redshift, EMR, Glue, and Kinesis. This involves designing ETL processes, ensuring data security, and collaborating with other teams for data analysis and business requirements Key Skills: AWS Services: Strong understanding and experience with AWS … languages like Python or Java, used for designing and building data pipelines. SQL: Knowledge of SQL for querying and manipulating data in relational databases. ETL Processes: Experience with ETL tools and techniques. Cloud Computing: Familiarity with cloud computing concepts and principles. Data Architecture: Understanding of data architecture principles and best … to move data between different systems and applications on AWS. Data Warehouse Management: Designing, building, and maintaining data warehouses using AWS services like Redshift. ETL Process Development: Developing and maintaining Extract, Transform, Load (ETL) processes to move and transform data. Data Governance and Security: Implementing data governance and security policies More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the … join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing … developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you. Key Responsibilities: Design, develop, maintain, and optimise data pipelines, ETL processes, and databases. Drive continuous improvement by refining processes, products, and More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the … join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing … developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you. Key Responsibilities: Design, develop, maintain, and optimise data pipelines, ETL processes, and databases. Drive continuous improvement by refining processes, products, and More ❯

Accountabilities: Ensure the existing design, development, and expansion of a near real-time data platform integrating AWS, Databricks and on-prem JDE systems. Develop ETL processes to integrate and transform data from multiple sources into a centralised data platform. Develop and optimise complex queries and data pipelines. Optimise and manage … data requirements. Design and build interactive and insightful dashboards and reports for internal and external stakeholders. Develop and maintain comprehensive documentation for data models, ETL processes, and BI solutions. Ensure data accuracy, integrity, and consistency across the data platform. Knowledge, Skills and Experience: Essentia l Strong expertise in Databricks and … analytics. Proficient in SQL and Python/PySpark for data transformation and analysis. Experience in data lakehouse development and Delta Lake optimisation. Experience with ETL/ELT processes for integrating diverse data sources. Experience in gathering, documenting, and refining requirements from key business stakeholders to align BI solutions with business More ❯

data engineers, setting standards and best practices. Architecting and building end-to-end data solutions and streaming platforms. Designing and implementing data pipelines and ETL workflows using Pentaho BA. Creating engaging BI reports and dashboards using Power BI. Managing cloud-based data environments (AWS, Azure), ensuring scalability and resilience. Collaborating … years in data engineering with leadership responsibilities. Deep expertise in AWS and/or Azure data platforms and services. Proficiency with Pentaho BA for ETL processes and data workflows. Strong skills in Power BI, Python, and Java. Agile development experience and a pragmatic, team-first approach. Excellent problem-solving and … Factory. Familiarity with Hadoop, Jenkins, or DevOps practices including CI/CD. Cloud certifications (Azure or AWS). Knowledge of additional programming languages or ETL tools. This is a fantastic opportunity to take a leadership role on meaningful, large-scale government programmes while continuing to develop your skills and experience More ❯

Data Engineer - Leading Fashion Company - London (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) We’re recruiting on behalf of a leading fashion brand based in London that’s recognised for combining creativity with cutting-edge technology. They’re on the lookout for … of GCP services including: Cloud Composer (Apache Airflow) BigQuery Cloud Storage Dataflow Pub/Sub Cloud Functions IAM Design and implement data models and ETL processes. Apply infrastructure-as-code practices using tools like Terraform. Ensure data quality and compliance with governance standards. Collaborate with data analysts, scientists, and stakeholders … in Data Engineering roles. Strong skills in Python and SQL . Hands-on experience with GCP , particularly the services listed above. Solid understanding of ETL , data warehousing , and data modelling principles. Familiarity with Terraform or similar infrastructure-as-code tools. Knowledge of data governance and data quality management . Experience More ❯

paced, collaborative environment. Key Responsibilities: Design, develop, and maintain scalable cloud-based data pipelines to collect, process, and analyze large datasets. Build and optimize ETL workflows to ensure efficient data integration and processing. Collaborate with data scientists, analysts, and engineers to support data modeling, analytics, and reporting needs. Leverage Python … for data engineering tasks. Experience with cloud platforms (e.g., AWS, Azure, or GCP), including services like S3, Lambda, BigQuery, or Databricks. Solid understanding of ETL processes , data modeling, and data warehousing. Familiarity with SQL and relational databases. Knowledge of big data technologies , such as Spark, Hadoop, or Kafka, is a More ❯

understand business requirements for data migration. Design and implement robust data migration strategies. Develop scripts and processes to automate data extraction, transformation, and loading (ETL) processes. Work closely with stakeholders, including business users and IT teams, to ensure data requirements are met, and migrations proceed without disruption to business operations. … Responsibilities: Plan, coordinate, and execute data migration projects within set timelines. Design and build ETL solutions, ensuring data quality and integrity throughout the migration process. Troubleshoot and resolve data-related issues promptly to minimise disruption. Collaborate with various teams to align migration processes with organisational goals and regulatory standards. Proficiency … in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure Data Factory), Azure DB, Azure Synapse, Azure Data lake More ❯

understand business requirements for data migration. Design and implement robust data migration strategies. Develop scripts and processes to automate data extraction, transformation, and loading (ETL) processes. Work closely with stakeholders, including business users and IT teams, to ensure data requirements are met, and migrations proceed without disruption to business operations. … Responsibilities: Plan, coordinate, and execute data migration projects within set timelines. Design and build ETL solutions, ensuring data quality and integrity throughout the migration process. Troubleshoot and resolve data-related issues promptly to minimise disruption. Collaborate with various teams to align migration processes with organisational goals and regulatory standards. Proficiency … in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure Data Factory), Azure DB, Azure Synapse, Azure Data lake More ❯

understand business requirements for data migration. Design and implement robust data migration strategies. Develop scripts and processes to automate data extraction, transformation, and loading (ETL) processes. Work closely with stakeholders, including business users and IT teams, to ensure data requirements are met, and migrations proceed without disruption to business operations. … Responsibilities: Plan, coordinate, and execute data migration projects within set timelines. Design and build ETL solutions, ensuring data quality and integrity throughout the migration process. Troubleshoot and resolve data-related issues promptly to minimise disruption. Collaborate with various teams to align migration processes with organisational goals and regulatory standards. Proficiency … in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure Data Factory), Azure DB, Azure Synapse, Azure Data lake More ❯

a Senior Data Engineer looking to transition into this domain will also be considered. Key Responsibilities: Oversee and lead the design and implementation of ETL/ELT processes to ingest data from new ERP system into Snowflake Architect and develop the Snowflake data warehouse to support reporting and analytics needs … into a strategic application portfolio plan and ensure its effective management and alignment with organisational goals. Business Intelligence: Knowledge of the data lifecycle from ETL, through to the analysis of datasets, leading to the publication of information and aiding business stake holders to derive insight and potential trends. IT Security … services with the needs of the business, through high-quality products services and the management of external services Key Skills & Experience: Essential: Experience with ETL/ETL tools (Matillion preferred) Experience of SQL Server and Snowflake (or other variants of Cloud Data Warehousing solutions e.g Azure/AWS etc) Experience More ❯

a Senior Data Engineer looking to transition into this domain will also be considered. Key Responsibilities: Oversee and lead the design and implementation of ETL/ELT processes to ingest data from new ERP system into Snowflake Architect and develop the Snowflake data warehouse to support reporting and analytics needs … into a strategic application portfolio plan and ensure its effective management and alignment with organisational goals. Business Intelligence: Knowledge of the data lifecycle from ETL, through to the analysis of datasets, leading to the publication of information and aiding business stake holders to derive insight and potential trends. IT Security … services with the needs of the business, through high-quality products services and the management of external services Key Skills & Experience: Essential: Experience with ETL/ETL tools (Matillion preferred) Experience of SQL Server and Snowflake (or other variants of Cloud Data Warehousing solutions e.g Azure/AWS etc) Experience More ❯

with SQL Server databases is a must, along with experience using Python for scripting purposes. You’ll also have previously built, maintained and optimised ETL processes and have some knowledge of data visualisation tools. If you’re passionate about data, SQL and can handle working in a risk-focused role More ❯

and tools Required Skills & Experience: Strong proficiency in data conversion tools and techniques Ability to analyse, manipulate and transform large data sets Experience with ETL (Extract, Transform, Load) processes Knowledge of data integration and migration best practices Attention to detail and ability to ensure data accuracy and completeness Excellent problem More ❯

availability for weekly processing •Experienced in working with digital and offline campaign datasets as well as experience in Adobe Analytics •Hands on experience with ETL (Extract, Transform, Load) and data stitching techniques to processes, clean and stitch large volumes of digital datasets (campaign/creative/on-site analytics datasets More ❯

They utilize tools such as Informatica, Ab Initio software, and DataStage (formerly Ascential) - IBM's WebSphere Data Integration Suite. This role involves creating and implementing Extract, Transform, and Load (ETL) processes, ensuring the seamless flow of data throughout the business intelligence solution's lifecycle. Required education None Preferred education Bachelor More ❯

operations. What You'll Be Doing: Designing, building, and optimising data pipelines across multiple sources using Microsoft Fabric and other Azure technologies Creating reliable ETL/ELT processes to transform and surface data for reporting and analytics Ensuring data quality... More ❯

design access to our transactional systems and other data sources. Model data in line with the medallion architecture principles of our data platform. Design ETL pipelines that produce datasets that can easily be consumed by our analytical teams, used as sources for our systems and complement our wider data architecture. More ❯

modelling Experience developing and implementing knowledge graphs Proficiency in scaling AI solutions from concept to production Working knowledge of backend systems, data pipelines, and ETL processes Familiarity with cloud platforms, particularly Microsoft Azure Understanding of microservices architecture and distributed systems Experience with DevOps practices for AI/ML workflows (MLOps More ❯

Create dashboards and visualizations using Elastic Stack for real-time security event analysis. Data Integration: Integrate data sources into Elasticsearch, ensuring data quality through ETL processes. Incident Response: Investigate and respond to security incidents using ElasticSIEM capabilities. Performance Optimization: Monitor and optimize Elastic Stack clusters for high availability. Security Best More ❯

principles, microservice & event driven architectures. Experience leveraging CI/CD, DevOps, Infrastructure as Code. Experience in Relational and NoSQL database and understanding of modern ETL processes Experience in the Insurance or other Financial industry Benefits for you Please find some of the great benefits we offer here at Hastings Direct More ❯

principles, microservice & event driven architectures. Experience leveraging CI/CD, DevOps, Infrastructure as Code. Experience in Relational and NoSQL database and understanding of modern ETL processes Experience in the Insurance or other Financial industry Benefits for you Please find some of the great benefits we offer here at Hastings Direct More ❯

principles, microservice & event driven architectures. Experience leveraging CI/CD, DevOps, Infrastructure as Code. Experience in Relational and NoSQL database and understanding of modern ETL processes Experience in the Insurance or other Financial industry Benefits for you Please find some of the great benefits we offer here at Hastings Direct More ❯

Stack for real-time monitoring and analysis of security events. Data Integration : Integrate various data sources into Elasticsearch, ensuring data quality and consistency through ETL processes. Incident Response : Investigate and respond to security incidents, leveraging Elastic SIEM capabilities to identify and mitigate threats. Performance Optimization : Monitor and optimize the performance More ❯