51 to 75 of 180 ETL Jobs in London

and ready for business-as-usual handover. Required Skills & Qualifications: Proficient in Python, Scala, and SQL. Extensive experience in data modelling and ELT/ETL processes. Strong hands-on experience with Google Cloud Platform, including BigQuery, Dataflow, Pub/Sub, Composer, and Cloud Run/App Engine. Familiarity with ...

systems (e.g., GitHub Actions, GitLab CI, ArgoCD) and infrastructure-as-code tools (e.g., Terraform, Helm). Familiarity with data engineering concepts such as ETL pipelines, data lakes, and large-scale batch/stream processing. Ability to design scalable, secure, and observable systems in fast-moving environments. Strong debugging and problem ...

roles, and secure data sharing. Key Responsibilities (Please specify if the position is an individual one or part of a team) Architect and optimize ETL/ELT pipelines using services such as: DBT, AWS Glue, Lambda, Kinesis, S3, EMR Design high performance Snowflake data models (3NF, dimensional, Data Vault, etc. ...

backend Python, REST APIs and microservices You have a good knowledge of AWS including Amazon RedShift You have experience with PostgreSQL, DBT, data pipelines, ETL, data modelling, LLMs and agentic programming You have a good understanding of event driven systems You're comfortable working with complex, data rich environments and ...

Business Analyst, Data Solutions Engineer, or similar role. Strong ability using SQL and have a solid understanding of relational database design. An understanding of ETL application systems and file transfer methods. Experience navigating Linux for file archival servers and using terminal commands. Experience with agile methodologies Passionate about problem-solving ...

issues within data sets and propose solutions. Proficiency in data analysis tools such as advanced MS Excel, SQL, Python, SAS, and R. Understanding of ETL, data management, and data quality best practices. Familiarity with cloud technologies and APIs. Impact You'll Make: What's In It For you? At TransUnion ...

Extras: Understands financial processes such as P2P, R2R, and O2C, and how to use relevant data markers from these processes to link datasets, develop ETL pipelines and identify transactions of potential concern Has an understanding of advanced data science techniques such as machine learning, natural language processing and statistical analysis. ...

driven transformation across critical UK industries. Core Responsibilities Design, build, and optimise data pipelines using Azure Data Factory, Synapse, and Databricks Develop and maintain ETL/ELT workflows to ensure high data quality and reliability Collaborate with analysts and AI engineers to deliver robust and reusable data products Manage data … and modern data pipeline design Hands-on experience within Microsoft's Azure ecosystem, with an interest in emerging technologies such as Fabric, AI-enhanced ETL, and real-time data streaming Proven ability to lead technical workstreams and mentor junior team members A strong alignment with the organisation's IDEAL values ...

driven transformation across critical UK industries. Core Responsibilities Design, build, and optimise data pipelines using Azure Data Factory, Synapse, and Databricks Develop and maintain ETL/ELT workflows to ensure high data quality and reliability Collaborate with analysts and AI engineers to deliver robust and reusable data products Manage data … and modern data pipeline design Hands-on experience within Microsoft’s Azure ecosystem, with an interest in emerging technologies such as Fabric, AI-enhanced ETL, and real-time data streaming Proven ability to lead technical workstreams and mentor junior team members A strong alignment with the organisation’s IDEAL values ...

and security standards. Skills Required: Previous experience in a data role. Experience with data visualization tools (e.g., Tableau, Power BI, Looker). Knowledge of ETL processes and data warehousing concepts. Strong analytical and problem-solving skills. Strong presentation skills, both written and verbal; able to describe complex technical problems ...

data pipelines, including troubleshooting incidents, conducting root cause analysis, managing SLAs, and improving resiliency across business-critical data feeds. Requirements: SQL Python/Bash ETL/ELT support Workflow orchestration (Airflow or Dagster) AWS data services (Athena, S3, MWAA, Iceberg) Data quality monitoring & incident management Nice to Have: Airbyte ...

Engineer Strong development skills in Python Advanced SQL skills with experience working on complex datasets Experience with core data engineering tools and technologies (e.g. ETL/ELT pipelines, data warehouses, orchestration tools) Strong understanding of data modelling, data quality, and performance optimisation Desirable Experience Experience with Palantir (Foundry, Gotham) Willingness ...

platforms supporting large transformation programmes. • Define modern architectures including lakehouse platforms, distributed analytics, and event-driven systems. • Provide oversight of data engineering environments, including ETL/ELT pipelines, orchestration, and DataOps practices. • Ensure platforms are secure, scalable, resilient, and aligned with governance standards. • Lead architecture workshops and governance forums, aligning ...

security, and monitoring Data Migration Lead end‐to‐end data migration strategy and execution Use DMF, Dual‐write (where applicable), Azure Data Factory/ETL tools Manage data assessment, cleansing, transformation, validation, and cutover Ensure data accuracy and reconciliation at go‐live Governance & Quality Enforce extension‐based development, performance, and ...

and Redshift. 🔧 What you’ll be doing: • Scaling and optimising ELT pipelines (Python + Airflow) • Enhancing the data warehouse (performance, cost, complexity) • Expanding Reverse ETL and data activation capabilities • Deepening dbt modelling and data quality frameworks • Driving automation, governance and reliability across AWS • Collaborating closely with Product, Design, Marketing & Finance ...

dashboards Modernise systems into cloud-native, API-first architectures Key skills Cloud engineering (Azure, Kubernetes, serverless, DevOps) Python and relational databases (SQL) Data platforms, ETL/ELT, and analytics AI tools and LLM integrations (e.g. GPT, Claude, Gemini) Security, governance, and regulated environment experience Why this team? Work ...

Drive technical discussions with Front Office Traders, Quants, and Risk Managers to translate complex business needs into scalable technical specs. Technical Governance : Own the ETL pipelines and data parsers. Ensure the system is capable of handling increasing volumetric data demands without compromising latency. Mentorship & Hiring : Define the technical ...

hard to deliver That Superdrug feeling. Here's the exciting bit... A day includes: The BI Developer designs and delivers dashboards, data models, and ETL processes that provide actionable insights to the business. Reporting to the Lead BI Developer, this role contributes to the organisations ability to make data-driven ...

design robust, secure, and future-ready data solutions that support analytics, AI, and strategic decision-making. What Youll Do: Build, test, and maintain ETL/ELT pipelines for structured and unstructured data. Design and optimise data warehouses, lakes, and cloud-native platforms . Implement monitoring, security, and compliance frameworks … with modern technologies, including cloud platforms, orchestration tools, and streaming frameworks . What Were Looking For: Strong SQL & Python skills. Hands-on experience with ETL/ELT tools (e.g., Matillion, Talend, FiveTran, Azure Data Factory). Experience designing and managing cloud data platforms (Snowflake essential; AWS/Azure/ ...

knowledge of data quality and data processes principles and best practice at a corporate level · Knowledge of the application of data modelling, database design, ETL and data flow · Experience with Data Analytics · Have strong Analytical skills · Be able to work independently and as part of a team. ...

relational database design & support Strong SQL and query optimisation expertise Hands-on AWS data services experience (RDS, Aurora, DynamoDB, S3 etc.) Experience with modern ETL, replication & cloud migrations Python or similar scripting skills Bonus points for previous experience in Financial Services 🎁 What’s On Offer Salary ...

improve delivery speed, and raise engineering standards Guide and mentor an offshore engineering team What We’re Looking For Strong data warehousing experience (modelling, ETL/ELT, pipelines) Hands-on with Snowflake, SQL and Python Experience in AWS (or similar cloud) Background in insurance or financial services (Lloyd’s ideal ...

developing REST APIs or microservices with Spring Boot. Experience containerising applications with Docker. Understanding of relational and NoSQL databases. Familiarity with modern data architectures (ETL/ELT, streaming, event-driven systems). Knowledge of cloud platforms (AWS, Azure, GCP) is a plus. Excellent problem-solving skills and a collaborative mindset. ...

pipelines & cloud deployment (AWS/Azure) Experience working across business requirements/user journeys (BA background beneficial) Strong understanding of data models, MDM, and ETL processes Experience in Agile environments Leadership & Stakeholder Skills Experience managing or mentoring developers and QA teams Strong communication skills with the ability to challenge and ...

mobile apps and internal tools • Designing data architecture for efficient storage, processing, and retrieval • Developing forecasting and optimisation models for staffing and operations • Owning ETL pipelines integrating multi-source data (APIs, internal systems) • Collaborating with data scientists, engineers, and business stakeholders • Monitoring, maintaining, and improving production ML systems What they ...