26 to 50 of 181 ETL Jobs in London

e.g., ChatGPT, Claude), Databricks GenAI tooling (including embedding models), and modern data structures such as vector databases. Strong expertise in designing end to end ETL solutions using Databricks, including identifying, extracting, and curating datasets for machine learning model development. Strong knowledge of cloud platforms (Azure and AWS) and relevant services. ...

insights. Key Responsibilities Data Pipeline Development & Optimisation Design, develop, and maintain scalable and reliable data pipelines. Build ETL/ELT solutions to ingest, transform, and load data from multiple sources, including APIs, databases, and external data providers. Optimise pipeline performance, scalability, and cost efficiency. Implement data quality controls, validation processes ...

modern data engineering practices, cloud platforms (Azure), and a passion for building intelligent, data-driven solutions. Key Responsibilities Design and develop real-time and ETL/ELT data pipelines integrating multiple data sources (APIs, databases, flat files). Support the development and maintenance of a scalable data warehouse for reporting … governance, security, and compliance . Required Qualifications 4–5 years of experience in Data Engineering or similar roles . Hands-on experience in building ETL/ELT data pipelines . Strong proficiency in Python for data manipulation and automation. Solid SQL skills for querying and managing data. Experience with Azure ...

clearance, due to the nature of the work. Key Requirements Proven experience as a Data Engineer in enterprise environments Strong expertise in data pipelines, ETL processes, and data integration Hands-on experience with modern data tools and platforms (e.g. Azure, AWS, Databricks, Spark, SQL, Python) Ability to design, build, and ...

REST APIs , working with JSON payloads, authentication, pagination and basic error handling. Essential Skills Strong SQL fundamentals, including joins, aggregations and subqueries Understanding of ETL/ELT concepts and data pipelines Exposure to Apache Kafka or similar streaming platforms Basic knowledge of AWS services, particularly managed databases Awareness of Docker ...

and Cloud Data Warehouse. Ability to work with large datasets, and knowledge of data manipulation, interrogation, transformation and import procedures. Experience with data loading, ETL/ELT concepts and Big Data tools. Possesses a high-level of analytical skills, process automation, problem solving and attention to detail. Formal education ...

Engineering function, shaping architectural direction, ensuring engineering excellence, and partnering with Technology, Architecture, and Business teams across the organisation. Tech Stack SQL Oracle Python ETL Background: The bank is migrating from an on-premise Oracle estate to a modern data platform built on cloud and Databricks. This role leads ...

skills) your application to our client in conjunction with this vacancy only. KEY SKILLS Lead Data Engineer, Senior Data Engineer, Data Engineering, Python, SQL, ETL, Data Pipelines, Cloud, AWS, Azure, GCP, Data Architecture, Data Modelling, Data Warehousing, Distributed Systems, Big Data, Agile. ...

requirements. Proficient use of enterprise data platforms, semantic models and dimensional modelling (star schemas, fact/dimension tables). Proficient in data architecture principles, ETL processes and data pipeline concepts. Experience with data cataloguing tools, SQL for data validation and analysis, and familiarity with data visualisation tools and cloud‐based ...

modeling - ERStudio Message-oriented data movement API design and access Data Analytics and AL/ML - AzureML Data virtualization Streaming data Data integration and ETL/ELT Tools - Matillion, Alteryx, Qlik PowerBI Machine Learning, Generative AI and Agentic AI. Strong experience Must have prior experience with end-to-end implementation ...

Databricks using PySpark Work with large and complex datasets, including streaming and batch data Build and maintain data platforms and data warehouses Implement ETL/ELT processes and data transformation logic Collaborate with stakeholders across engineering, analytics, and business teams Required Experience Strong experience as a Senior Data Engineer Expertise ...

Pipelines, CI/CD) Proficiency in SQL and Python Experience with Azure Data Services (Data Lake, Data Factory) Strong knowledge of Data warehousing and ETL/ELT concepts Knowledge of Data governance and security best practices Design and Leading the team of Data Engineers Manage stakeholder interactions independently. Good ...

Athena) Proven experience in public sector or regulated environments Data modelling (conceptual, logical, physical) expertise Knowledge of data governance, security, and compliance Experience with ETL/ELT, APIs, and data integration tools Nice to Have AWS certifications (e.g., Data Analytics Specialty, Solutions Architect) Experience with big data, streaming (Kafka/ ...

supporting event operations across channels. 5+ years in data architecture or related fields. Deep knowledge of modern data architecture, cloud platforms (Azure, AWS, Databricks), ETL/ELT. Experience with metadata management, AI/Machine Learning integration. Strong communication and stakeholder engagement skills. Understanding of information security, privacy, and compliance regulations. ...

Engineering and Data Science teams Technical Skills & Experience Programming & Data Engineering Strong experience with Python, Scala and SQL Solid background in data modelling and ETL/ELT pipelines Experience building enterprise-grade data solutions Cloud & Platform Hands-on experience with Google Cloud Platform (GCP) , ideally including: BigQuery Dataflow Pub/ ...

enable self-service of data analytics to data hungry internal users as well as automation of all our data workflows - from simple ETL jobs to ML training and prediction. \n The data team at OEV is growing at speed. We have invested time and resources on establishing a core data ...

similar container orchestration platforms. Demonstrated ability to lead or manage engineering teams in a technical environment. Solid understanding of data engineering principles, including ETL/ELT, data warehousing and data pipeline orchestration. Additional Skills & Qualifications: experience working with large-scale, high-volume data platforms. Familiarity with infrastructure-as-code and ...

and reporting internal policies and documentation on, including following and creating best practice methods Documenting key information relating to processes on data work e.g. ETL pipelines, transformations, data models, integrations, workflows and similar. Analysing information in a health environment Desirable Proven experience in analysing and interpreting complex datasets and dashboards ...

communicate effectively with both technical and non-technical stakeholders Desirable Exposure to financial services, risk, or data platforms Understanding of data pipelines/ETL processes Experience with Agile/Scrum environments Knowledge of market or counterparty risk Java experience (nice to have) French language skills (optional) Guidant, Carbon60, Lorien ...

nAgile Delivery: Experienced in Scrum/Kanban environments, participating in ceremonies (Dailies, Refinement, Retrospectives) and managing tasks via backlogs.Data Engineering Best Practices: Knowledge of ETL/ELT patterns, data versioning, and building robust, automated pipelines. You'll ensure data security and compliance requirements are met with solutions you propose and ...

London Market/Specialty Insurance data domains Proficient in Azure Data Factory and Databricks, including pipeline design and orchestration Solid understanding of data warehousing, ETL/ELT pipelines, and integration practices Knowledge of SDLC methodologies (Agile, DevOps, etc.) Confident communicator with the ability to engage technical and business stakeholders Relevant ...

querying. Familiarity with cloud data platforms (e.g., AWS, Azure) and big data technologies (e.g., Kafka, Spark, Databricks, Snowflake). Expert-level knowledge of building ETL processes in Python. Expert-level knowledge of performance tuning and optimization in a Python/SQL Server environment This role offers highly competitive compensation ...

technical audienc es.Experience within Financial Services or Insuran ce.Strong problem-solving and analytical capabili ty. Desir ableExperience with Alteryx, Qualtrics or other ETL to ols.Knowledge of Power Autom ate.SharePoint and Power BI administration experie nce.Insurance industry qualifications (e.g., AC II). What Success Looks LikeDelivering high-quality reporting and dashbo ...

innovation and continuous improvement are genuinely encouraged. Key areas of focus include: • Developing and embedding data management strategy and governance • Leading data migration and ETL initiatives with strong auditability and control • Improving data quality, structure, accessibility, and reporting automation • Supporting analytics and insight generation for operational and strategic decision-making ...

organisation through training and internal champions •Ensuring GDPR compliance and robust data security controls throughout Essential Experience: •Solid, hands-on understanding of data warehousing, ETL/ELT processes, data modelling and Medallion architecture •Experience managing vendors delivering hosted or managed data warehouse solutions •Ability to design and implement governance frameworks ...