176 to 200 of 454 ETL Jobs in London

Lambda), Snowflake , Databricks , and Reltio to design and implement scalable data solutions. Key Responsibilities: Lead data architecture design using AWS, Snowflake, Databricks, and Reltio. Manage data migration, data modeling, ETL processes, and data integration. Work with reporting tools such as Power BI or Tableau. Implement and maintain data governance frameworks. Ensure compliance with GDPR and other data privacy regulations. Maintain … plus. Required Skills & Experience: 15-20 years of experience in data architecture . Expertise in AWS , Snowflake , Databricks , and Reltio . Experience with data governance , data privacy regulations , and ETL tools . Familiarity with reporting tools like Power BI and Tableau . Experience with motor fleet insurance is a plus. Additional Information: Remote work with occasional travel to Belgium More ❯

Lambda), Snowflake , Databricks , and Reltio to design and implement scalable data solutions. Key Responsibilities: Lead data architecture design using AWS, Snowflake, Databricks, and Reltio. Manage data migration, data modeling, ETL processes, and data integration. Work with reporting tools such as Power BI or Tableau. Implement and maintain data governance frameworks. Ensure compliance with GDPR and other data privacy regulations. Maintain … plus. Required Skills & Experience: 15-20 years of experience in data architecture . Expertise in AWS , Snowflake , Databricks , and Reltio . Experience with data governance , data privacy regulations , and ETL tools . Familiarity with reporting tools like Power BI and Tableau . Experience with motor fleet insurance is a plus. Additional Information: Remote work with occasional travel to Belgium More ❯

working closely with senior leadership. The team has already laid the foundations for a modern data platform using Azure and Databricks and is now focused on building out scalable ETL processes, integrating AI tools, and delivering bespoke analytics solutions across the organisation. THE ROLE As a Data Engineer, you'll play a pivotal role in designing and implementing robust data … This role combines hands-on development with collaborative architecture design, and offers the opportunity to contribute to AI readiness within a fast-paced business. KEY RESPONSIBILITIES Develop and maintain ETL pipelines, including manual and semi-manual data loads Connect and integrate diverse data sources across cloud platforms Collaborate with analytics and design teams to create bespoke, scalable data solutions Support … ready for future AI use cases REQUIRED SKILLS & EXPERIENCE Strong experience with Azure and Databricks environments Advanced Python skills for data engineering (pandas, PySpark) Proficiency in designing and maintaining ETL pipelines Experience with Terraform for infrastructure automation Track record of working on cloud migration projects, especially Azure to Databricks Comfortable working onsite in London 2 days/week and engaging More ❯

ensure data is reliable, accessible, and valuable across all areas of the business. What you’ll be doing: Designing, building, and owning high-performance data pipelines and APIs Developing ETL processes to support analytics, reporting, and business operations Assembling complex datasets from a wide variety of sources using tools like SQL, Python, dbt, and Azure Supporting and improving data quality … we’re looking for: Strong experience with Azure cloud technologies , particularly around data services Proficient in SQL and experienced with Python for data transformation Hands-on experience with dbt , ETL development , and data warehousing best practices Comfortable with deploying infrastructure as code and building CI/CD pipelines (e.g., using GitHub, Azure DevOps) Ability to manage large, unstructured datasets and More ❯

moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark. Must have hands-on experience with PySpark, Python, AWS, data modelling. Must have experience in ETL processes. Must have hands-on experience in Databricks development. Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must More ❯

SSIS) packages and new cloud-native solutions within a microservice and containerised architecture. Key accountabilities include: Developing near real-time integration services using cloud technologies. Building and optimising SSIS ETL packages. Selecting appropriate integration approaches (ETL/ELT) aligned to business outcomes. Collaborating across product and analytics teams to integrate with platforms such as Azure Data Lake and Synapse. Managing … through innovation, prototyping, and cross-functional collaboration. We are looking for a technically skilled and proactive professional with: Strong experience in Microsoft SQL, Azure Data Factory, Synapse, and related ETL/ELT tools. Proven capability in managing Azure-based integration services and data solutions. A solid understanding of microservices, data modelling, and DevOps principles. Experience in handling large, complex datasets More ❯

QUALIFICATIONS - Experience in analyzing and interpreting data with Redshift, Oracle, NoSQL etc. - Experience with data visualization using Tableau, Quicksight, or similar tools - Experience with data modeling, warehousing and building ETL pipelines - Experience in Statistical Analysis packages such as R, SAS and Matlab - Experience using SQL to pull data from a database or data warehouse and scripting experience (Python) to process … for modeling - Experience with SQL - Experience in the data/BI space PREFERRED QUALIFICATIONS - Experience with AWS solutions such as EC2, DynamoDB, S3, and Redshift - Experience in data mining, ETL, etc. and using databases in a business environment with large-scale, complex datasets Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to More ❯

the board - all while building slick, automated data pipelines in Python. Key Responsibilities: Lead data migration and integration tasks, ensuring quality and alignment across systems. Design, implement, and optimise ETL processes to streamline data movement from diverse sources. Build and enhance a robust Snowflake data warehouse to support evolving reporting needs. Troubleshoot and resolve data quality issues, supporting business users … data lifecycle - from ingestion and transformation to validation and analysis. Strong Python skills and confidence building automation for large-scale data tasks. Hands-on Snowflake experience. Deep understanding of ETL/ELT pipelines and data governance standards. A solid grasp of financial data or lending domain knowledge is highly desirable. A passion for mentoring and upskilling teammates in a supportive More ❯

support strategic decision-making and network improvements. BASIC QUALIFICATIONS - Experience with SQL - Experience with data visualization using Tableau, Quicksight, or similar tools - Experience with data modeling, warehousing and building ETL pipelines - Experience in analyzing and interpreting data with Redshift, Oracle, NoSQL etc. - Experience using SQL to pull data from a database or data warehouse and scripting experience (Python) to process … data for modeling PREFERRED QUALIFICATIONS - Experience with AWS solutions such as EC2, DynamoDB, S3, and Redshift - Experience in data mining, ETL, etc. and using databases in a business environment with large-scale, complex datasets Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your More ❯

and the mapping of data lineage/inventory models to support business practices. A high level of proficiency with Data management and analysis tools (e.g., Azure data products, SQL, ETL, APIs, Power BI, DQ analysis tools, Excel etc). Experience in financial services and an understanding of investment, insurance and pension products. Sound report writing skills, able to appropriately select More ❯

expertise Assessing your clients’ technical needs and understanding how their needs are different to wants and managing clients’ stakeholders relationship appropriately Identifying data sources, data extraction, transformation, and loading (ETL/ELT) concepts and methods Developing suitable data governance and provenance strategies and how they will be implemented in data architecture Designing and evaluating on-premise, cloud-based and hybrid … data problems and/or engineering problems and suitably designing data architectures You have led client delivery across a range of projects for delivering data platforms, e.g. data analysis, ETL/ELT, machine learning pipelines/deployments, business intelligence reporting, data security. You have proven experience in their technologies You have developed data governance plans that are in line with More ❯

Hybrid Role with 2 days per week onsite in Central London. Skillset required: * Data Pipeline Expertise: Extensive experience in designing and implementing scalable ETL/ELT data pipelines in Azure Databricks, transforming raw data into usable datasets for analysis. * Azure Databricks Proficiency: Strong knowledge of Spark (SQL, PySpark) for data transformation and processing within Databricks, along with experience building workflows More ❯

Hybrid Role with 2 days per week onsite in Central London. Skillset required: * Data Pipeline Expertise: Extensive experience in designing and implementing scalable ETL/ELT data pipelines in Azure Databricks, transforming raw data into usable datasets for analysis. * Azure Databricks Proficiency: Strong knowledge of Spark (SQL, PySpark) for data transformation and processing within Databricks, along with experience building workflows More ❯

alongside data scientists and ML engineers, you'll support everything from raw ingestion to curated layers powering LLMs and advanced analytics.Your responsibilities will include: Building and maintaining production-grade ETL/ELT workflows with DBT and Airflow Collaborating with AI/ML teams to support data readiness for experimentation and inference Writing clean, modular SQL and Python code for use More ❯

data delivery mechanisms to our various products Work with Dirs. of Data Science and Data Delivery to optimise data processes and improve interoperability Strengthen and help scale our existing ETL pipelines, with a focus on flexible and adaptable delivery mechanisms Work with Data Governance Manager to monitor, maintain and utilise our internal university database Work with our Engineering team on More ❯

technical consulting experience ● Track record of leading enterprise analytics or data platform projects ● Hands-on experience with Snowflake platform solutions ● Strong understanding of end-to-end data architecture, including ETL/ELT, data modeling, and business intelligence tools ● Experience with SQL, Python, Java, and/or Spark in data engineering or analytics contexts ● Familiarity with large-scale data warehouse technologies More ❯

years of analyzing and interpreting data with Redshift, Oracle, NoSQL etc. experience - Experience with data visualization using Tableau, Quicksight, or similar tools - Experience with data modeling, warehousing and building ETL pipelines - Experience in Statistical Analysis packages such as R, SAS and Matlab - Experience using SQL to pull data from a database or data warehouse and scripting experience (Python) to process … data for modeling PREFERRED QUALIFICATIONS - Experience with AWS solutions such as EC2, DynamoDB, S3, and Redshift - Experience in data mining, ETL, etc. and using databases in a business environment with large-scale, complex datasets Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during More ❯

hands-on development (C# and/or Python) Strong background in hedge fund, asset management , or financial markets Solid DevOps skills: CI/CD, containerisation, source control (e.g. Git) ETL experience with financial data (including tick data) SQL and database systems knowledge Familiarity with cloud (Azure ideal, others acceptable) Excellent communication skills - confident with stakeholders and leadership What You'll More ❯

hands-on development (C# and/or Python) Strong background in hedge fund, asset management , or financial markets Solid DevOps skills: CI/CD, containerisation, source control (e.g. Git) ETL experience with financial data (including tick data) SQL and database systems knowledge Familiarity with cloud (Azure ideal, others acceptable) Excellent communication skills - confident with stakeholders and leadership What You'll More ❯

Python experience in a collaborative, version-controlled production environment. Familiarity with financial markets and instruments, especially derivatives and fixed income products. Exposure to systems involving data movement or transformation (ETL processes) is beneficial though not central to the role. Strong verbal and written communication skills, with a track record of collaborating across both technical and non-technical teams. Practical knowledge More ❯

Python experience in a collaborative, version-controlled production environment. Familiarity with financial markets and instruments, especially derivatives and fixed income products. Exposure to systems involving data movement or transformation (ETL processes) is beneficial though not central to the role. Strong verbal and written communication skills, with a track record of collaborating across both technical and non-technical teams. Practical knowledge More ❯

Proven track record leading multi-million-pound projects within consulting or enterprise-level engagements. • Strong stakeholder engagement at CxO or Director level. • Deep experience in cloud data lake architectures, ETL/ELT patterns, and metadata/data quality management. • Expertise in Matillion, Redshift, Glue, Lambda, DynamoDB, and data pipeline automation. • Familiarity with data visualisation platforms such as Quicksight, Tableau, or More ❯

Proven track record leading multi-million-pound projects within consulting or enterprise-level engagements. • Strong stakeholder engagement at CxO or Director level. • Deep experience in cloud data lake architectures, ETL/ELT patterns, and metadata/data quality management. • Expertise in Matillion, Redshift, Glue, Lambda, DynamoDB, and data pipeline automation. • Familiarity with data visualisation platforms such as Quicksight, Tableau, or More ❯

using .NET framework backend services and React frontends. You'll utilise tools such as Terraform for infrastructure-as-code ( IaC ), AWS (Lambda, EC2, EKS, Step Functions, VPC etc.) for ETL, Airflow pipelines, Snowflake, and ensure architectural alignment with AI/ML initiatives and data-driven services. You will serve as the go-to engineer for: End-to-end data migration … environments using AWS and our bespoke Conversion Framework. Build new and maintain existing bespoke systems. Implement .NET-based microservices with strong observability and integration with data platforms. Develop custom ETL pipelines using AWS, Python, and MySQL. Implement governance, lineage, and monitoring to ensure high availability and traceability. AI & Advanced Analytics Integration: Collaborate with AI/ML teams to enable model More ❯

using .NET framework backend services and React frontends. You'll utilise tools such as Terraform for infrastructure-as-code ( IaC ), AWS (Lambda, EC2, EKS, Step Functions, VPC etc.) for ETL, Airflow pipelines, Snowflake, and ensure architectural alignment with AI/ML initiatives and data-driven services. You will serve as the go-to engineer for: End-to-end data migration … environments using AWS and our bespoke Conversion Framework. Build new and maintain existing bespoke systems. Implement .NET-based microservices with strong observability and integration with data platforms. Develop custom ETL pipelines using AWS, Python, and MySQL. Implement governance, lineage, and monitoring to ensure high availability and traceability. AI & Advanced Analytics Integration: Collaborate with AI/ML teams to enable model More ❯