51 to 75 of 160 ETL Jobs in the City of London

distributed data processing (Spark, Flink, or similar) Experience working with large datasets and complex data models Knowledge of data engineering fundamentals: data modelling, pipelines, ETL/ELT, testing Familiarity with cloud environments (AWS, GCP, or Azure) is a plus A focus on clean, maintainable code and engineering excellence Comfortable working ...

distributed data processing (Spark, Flink, or similar) Experience working with large datasets and complex data models Knowledge of data engineering fundamentals: data modelling, pipelines, ETL/ELT, testing Familiarity with cloud environments (AWS, GCP, or Azure) is a plus A focus on clean, maintainable code and engineering excellence Comfortable working ...

tools and processes Core skills • SQL: day-to-day user • Python: beneficial but not essential • Visualisation: experience with PowerBI, Looker or Tableau • Familiarity with ETL workflows • Proven autonomy running A/B tests end-to-end (typically 3–5 per quarter), including statistical analysis using Python, SQL packages or third ...

Strong experience in data architecture and modelling (conceptual, logical, physical) Background working with data lakes, warehouses, and master data management Hands‐on skills in ETL/ELT, integration, and orchestration Familiarity with Azure, Fabric, PowerBI, SQL Server, and PostgreSQL 5+ years’ recent experience in financial services or fintech Desirable: Certifications ...

large, complex datasets. Working knowledge of Python for analytics and experimentation workflows. Hands-on experience designing and interpreting A/B tests. Understanding of ETL processes and the ability to troubleshoot data pipeline issues. Proficiency with data visualisation tools such as Looker or Tableau. Excellent communication skills with the ability ...

database design. Strong analytical and problem-solving skills. Excellent communication and collaboration abilities. Knowledge of data governance, quality, and management best practices. Experience with ETL processes and data warehousing solutions. Familiarity with industry standards and compliance requirements. Ability to lead and mentor a team. ABOUT CAPGEMINI Capgemini is a global ...

across multiple sectors. Tech stack highlights: AWS services: EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB Languages: Java, Python, Scala, Spark, SQL Big data architecture and ETL pipelines What we’re looking for: Strong problem-solving and analytical skills Experience designing and deploying production data pipelines Ability to process large structured/ ...

enhance and support products as well as design & deliver new innovations for growth, including Agentic development. Technology/Skills requirements SQL ELT/ETL Data Modelling dbt models Version control (Git) Data processing and orchestration using Airflow or similar Google BigQuery or Redshift Cloud based services: GCP (preferred ...

stack AI ready, drive innovation and leverage Agentic development where its needed. Technology/Skills requirements SQL and another language e.g. Python ELT/ETL CI/CD Data Modelling Data Architecture Data Frameworks dbt Data processing and orchestration using Airflow or similar Google BigQuery or Redshift Cloud based services ...

services. Knowledge of MLOps tools and practices (e.g., MLflow, Kubeflow, Vertex AI, Azure ML). Strong understanding of data engineering, data pipelines, and ETL workflows. Excellent problem-solving, communication, and stakeholder engagement skills. Bachelor's or Master's degree in Computer Science, AI/ML, Data Science, or related field. ...

Responsibilities Build and maintain Power BI reports and dashboards that deliver accurate and timely insights for operational and business stakeholders. Develop, test, and maintain ETL pipelines in Azure Data Factory (ADF) to ensure reliable data integration and transformation. Work with Azure Synapse Analytics to model, query, and optimise data … experience in developing and publishing reports, dashboards, and data models using DAX and Power Query. Azure Data Factory: Hands-on experience building and maintaining ETL pipelines. Azure Synapse Analytics: Working knowledge of data modelling, views, and performance tuning. SQL: Proficient in writing, optimising, and troubleshooting queries. Azure Data Lake: Understanding ...

optimisation. Data Warehousing & Modelling: In-depth understanding of data warehousing principles and modelling concepts. Experience with designing efficient schemas, including normalisation and denormalisation techniques. ETL/ELT Pipelines: Proven experience building and maintaining ETL/ELT processes. Ability to extract data from diverse sources, transform it effectively, and load ...

Location - London (Hybrid) Duration - 6 months (Initially) I've included key skills below (detailed job specification is attached): Strong understanding of ETL processes - including data extraction, transformation, and loading. Experience with database migration - validating and testing data movement across heterogeneous systems. Hands-on testing experience with Azure Data Factory - including ...

deployment scripts and contributing to continuous improvement of deployment processes Required Competencies Strong knowledge of database systems, particularly Microsoft SQL Server, and familiarity with ETL processes and tools. Strong understanding of cloud-based data solutions, preferably Microsoft Azure. Experience maintaining online reporting tools such as Power BI. Proficiency in PowerShell ...

Senior Data Engineer with some team leadership responsibilities Strong technical expertise with PySpark, Databricks, Azure, and Data Lake Deep understanding of data architecture and ETL processes in cloud environments The ability to balance coding and technical delivery with people management Excellent problem-solving skills and the energy to thrive ...

large, complex datasets Basic working knowledge of Python for analysis or experimentation Experience with A/B testing design, execution, and interpretation Familiarity with ETL workflows and debugging data quality issues Hands-on experience with data visualisation tools (e.g. Looker, Tableau, or similar) Excellent communication and stakeholder management skills Commercial ...

/LLD/DFD. Essential Skills & Experience Proven experience owning system architecture for large-scale compliance or AML platforms Strong background building and optimising ETL/ELT data pipelines handling high-volume financial data Hands-on expertise with microservices, APIs and event-driven systems (e.g., Kafka) Ability to translate ...

data extraction, transformation, and pipeline development. Proficiency in Tableau, Qlik, or similar visualization tools. Experience with big data tools (Snowflake, Databricks, Spark) and ETL processes. Exposure to Python or R for automation, experimentation, or analytics. Excellent communication and storytelling skills with both technical and non-technical audiences. Proactive, growth-oriented ...

and data literacy within the product organisation. SKILLS Strong SQL skills with experience querying large, complex datasets. Basic working knowledge of Python. Familiarity with ETL workflows and debugging data issues. Proven experience designing and interpreting A/B tests. Hands-on experience with data visualisation tools (e.g. Looker, Tableau ...

experience with enterprise data models for credit, counterparty, and exposure reporting. Strong understanding of integration design patterns (REST APIs, message queues, event-driven integration, ETL, batch processing). Experience working with master data domains (Party, Facility, Instrument, Product, Country, Sector, Ratings). Technology & Platform Knowledge: Experience with industry-standard credit ...

scalable data pipelines across modern cloud platforms Drive the implementation of GenAI frameworks, including model deployment, monitoring, and lifecycle management ('GenAI Ops') Develop robust ETL/ELT workflows and optimise performance within Snowflake Collaborate with cross-functional teams to integrate AI solutions into data ecosystems Must-Haves Strong background ...

Databricks - need to be comfortable getting into the weeds of the work and building stuff yourself as well. Solid understanding of data architecture concepts, ETL pipelines, and big data processing. Excellent stakeholder management and communication skills. Passion for building teams and mentoring talent. Pre-sales experience, putting together POCs ...

environments AWS Solutions Architect – Associate certification Experience with Iceberg– an advantage Experience with Kubernetes, CI/CD, and DevOps tools – an advantage Experience with ETL processes, data lakes, and pipelines – an advantage Experience writing SOWs, HLDs, and effort estimates – an advantage AWS Professional or Data Analytics/Data Engineer certifications ...

Secure coding and API versioning Data & Integration SQL Server, Azure SQL, Cosmos DB ORM optimisation, caching (Redis, Azure Cache for Redis) Data migration and ETL integration (APIs, pipelines) Cloud & DevSecOps Azure DevOps (Repos, Pipelines, Boards, Artifacts, Test Plans) CI/CD automation, gated releases, and environment governance Infrastructure-as-Code ...

define data architecture. Re-engineer manual data flows to enable scalability and reusability. Support the build of data streaming and batch processing systems. Write ETL (extract, transform, load) scripts and code to ensure optimal ETL performance. Develop reusable Business Intelligence reports and dashboards. Build accessible and governed data solutions ...