51 to 75 of 633 ETL Jobs in London

work from the office 2 days per week. Key Responsibilities Develop and maintain scalable data pipelines using Azure Data Factory. Build and manage ETL processes using SQL and Python. Work with Azure Databricks and Azure SQL/SQL Server to process and manage large datasets. Design and implement data models ...

Delta Lake concepts, UC governanceSolid understanding of streaming technologies (e.g., Spark Structured Streaming, Autoloader)Programming skills in Python, SQL, or ScalaProficiency in data modelling, ETL/ELT processes, and data architectureExperience in MS Copilot, AI Foundry , Databricks (MosiacAI, MLflow, Agentbricks, Genie)Strong analytical background with problem-solving skillsPerformance tuning concepts ...

work from the office 2 days per week. Key Responsibilities Develop and maintain scalable data pipelines using Azure Data Factory. Build and manage ETL processes using SQL and Python. Work with Azure Databricks and Azure SQL/SQL Server to process and manage large datasets. Design and implement data models ...

industry and understand the complexities of insurance data, systems, and business processes. What You'll Do Design, develop, and maintain scalable data pipelines and ETL/ELT processes. Build and optimise cloud-based data solutions and data platforms. Integrate data from multiple source systems into enterprise data environments. Work closely ...

cleansing, and enrichment Data cleansing and standardisation : Experience resolving data quality issues and ensuring data accuracy. Exposure to data integration tools : Basic experience with ETL tools for data integration. Collaboration with data professionals : Some experience working with other data professionals. Understanding visualisation requirements : Ability to understand visualisation needs and create ...

validation, and GDPR/PII compliancePartner with analytics, MarTech, and marketing teams to align data solutions with business needsRequirementsStrong SQL skills and experience with ETL/ELT and pipeline orchestration tools (e.g., Airflow, dbt, Data Factory)Experience with cloud data platforms (e.g., Azure, AWS, or GCP)Proficiency in data modelling ...

warehouses, marts, and distributed processing (Spark‐based pipelines). Strong proficiency in SQL for tracing transformations and validating mappings across layers. Working knowledge of ETL/ELT patterns, data modeling (dimensional + normalized), and batch scheduling dependencies. Ability to interpret data transformation logic from pipelines (Spark SQL/PySpark/ ...

Duration: 6 months Start: ASAP Location: Hybrid, 2/3 days per week in London Key responsibilities Design, build and optimise scalable ETL/ELT data pipelines. Develop and maintain data solutions using Databricks, Python and SQL. Support the migration of data assets from legacy platforms to modern cloud architectures. ...

/PII compliance Partner with analytics, MarTech, and marketing teams to align data solutions with business needs Requirements Strong SQL skills and experience with ETL/ELT and pipeline orchestration tools (e.g., Airflow, dbt, Data Factory) Experience with cloud data platforms (e.g., Azure, AWS, or GCP) Proficiency in data modelling ...

and infrastructure-as-code (Terraform, CloudFormation). Hands-on expertise with data lake/lakehouse architectures and modern streaming solutions. Experience with SQL, NoSQL, ETL/ELT pipelines, and programming languages (Python, R, Java). Familiarity with BI, data visualisation, and DevOps principles. Strong understanding of data governance, security, and ...

and the Microsoft Power Platform, including building on top of central/curated data models. Familiarity with data pipeline concepts, transformation logic, and ETL/ELT processes. Working understanding of how data assets are structured and prepared to support AI, machine learning, and agentic use cases - this ...

controls. Deep understanding of analytics architecture, data modelling methodologies, semantic layer design, and approaches for delivering discoverable, governed and reusable data products. Expertise in ETL and ELT frameworks for large-scale batch and near real-time processing, with hands-on experience using orchestration and transformation technologies such as Airflow and ...

time‐series (TimescaleDB/InfluxDB), and document (MongoDB) stores used by applications Design the data ingestion and movement architecture – real‐time CDC pipelines, batch ETL/ELT patterns, and event‐driven feeds from the NATS messaging layer into Snowflake Define data domain boundaries, ownership, and lineage standards aligned with Project ...

distributed or remote teams. Strong proficiency in programming languages like PythonProven experience designing and implementing enterprise data warehouse solutionsProven expertise in building and optimizing ETL pipelines using tools like SQL, Python and dbt. Experience with AI development tools and platforms (e.g., GPT APIs, Copilot) and AI agent frameworks. Architect, designing ...

ability to provide credible technical leadership. Experience leading, mentoring or providing technical direction to BI/reporting professionals. Solid understanding of data warehousing, ETL/ELT, semantic modelling and enterprise reporting concepts. Proven experience delivering and supporting business‐critical, enterprise‐level reporting solutions. Ability to manage competing priorities, translate business ...

standardisation : Experience in resolving data quality issues and ensuring data accuracy through cleansing and standardisation techniques. Use of data integration tools : Skilled in using ETL tools for data integration and storage. Ensures data interoperability with other datasets. Collaboration with data professionals : Experience collaborating with other data professionals to improve modelling ...

and with different software solutions (Snowflake, Azure, SQL, Python); Provide the handling of (and where needed training of) Large Language Models (LLMs) in the Extract, Transform, and Load (ETL) of large corpus of data into a data lake; Participate in the Natural Language Processing (NLP) extract of unstructured data into … Knowledge of developing dimensional data models from unstructured content and awareness of the advantages and limitations of Star Schema and Snowflake schema designs; Solid ETL development, reporting knowledge based off intricate understanding of business process and measures; Knowledge of Snowflake cloud data warehouse and Azure cloud is preferred; Knowledge ...

promote AI-enabled software development, and help build a high-performing engineering culture across a growing global team. In this role you will Write ETL (Extract/Transform/Load) processes, designs database systems and, develops tools for real-time and offline analytic processing Troubleshoot software and processes for data ...

promote AI-enabled software development, and help build a high-performing engineering culture across a growing global team. In this role you will Write ETL (Extract/Transform/Load) processes, designs database systems and, develops tools for real-time and offline analytic processing Troubleshoot software and processes for data ...

promote AI-enabled software development, and help build a high-performing engineering culture across a growing global team. In this role you will Write ETL (Extract/Transform/Load) processes, designs database systems and, develops tools for real-time and offline analytic processing Troubleshoot software and processes for data ...

trusted advisor to client stakeholders on data analytics matters Python for data analysis and automation (pandas, numpy, scipy, etc.) Data Engineering Knowledge: Familiarity with ETL processes, data integration tools, and modern data platforms (e.g., Databricks) Communication: Excellent stakeholder management and presentation skills; fluent English (written and verbal) Power BI Expertise ...

Mongo DB with Python and Pyspark Building data warehouse or data lakes with SCVs or in conjunction with CDP platforms Experience of ELT/ETL tools such as Databricks, Azure Data Factory, SSIS, Talend, Informatica and Palantir Managing and motivating teams and individuals Understanding and application of statistical and analytical ...

Acceldata, and data governance/quality platforms like Informatica, Collibra or Microsoft Purview is highly desirable. Experience within the Azure ecosystem (data lakes, ETL/ELT pipelines) would be a strong advantage. Working across Data Engineering and Data Governance teams, you'll help shift the organisation from reactive issue resolution ...

Acceldata, and data governance/quality platforms like Informatica, Collibra or Microsoft Purview is highly desirable. Experience within the Azure ecosystem (data lakes, ETL/ELT pipelines) would be a strong advantage. Working across Data Engineering and Data Governance teams, you'll help shift the organisation from reactive issue resolution ...

analytics and AI-driven solutions.ResponsibilitiesLead the architecture, design and build of large-scale data platforms using Azure Databricks and modern cloud technologiesImplement and optimize ETL workflows and streaming pipelines with PySpark and Delta Live Tables following Lakehouse principlesEnhance performance, manage cloud costs and ensure platform reliability for structured streaming workloadsDefine ...