1 to 25 of 32 ETL Jobs in the City of London

reliable, performant, and secure. Key Responsibilities Platform Development & Maintenance Design and implement data pipelines using Azure Data Factory, Databricks, and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect ...

BigQuery, Dataflow, Cloud Storage, Composer/Orchestration tools) Solid programming skills in Python and SQL Experience designing and maintaining data warehouses, data models, and ETL/ELT pipelines Exposure to orchestration, batch and/or streaming data processing patterns Experience working in cloud environments beyond GCP (e.g. AWS or Azure ...

maintain end‐to‐end web applications —from intuitive front‐end interfaces to robust back‐end servers and APIs. Build and optimise data platforms and ETL/ELT pipelines supporting analytics and AI‐driven applications. Prepare and structure data for dashboards, reporting, and machine learning solutions. Collaborate with consultants, data scientists ...

data governance. •Solid understanding of Insurance domain concepts (Specialized Insurance, London Market, Regulatory Data). •Excellent communication and stakeholder management skills. Preferred •Experience with ETL tools and data integration processes. •Familiarity with data warehousing concepts and cloud data platforms. •Exposure to Fivetran, SSIS, or Snowflake advanced features. Personal Besides ...

with orchestration (like Airflow, Dagster, Databricks Workflows) and distributed processing in a cloud environment Experience with analytical data modelling (star and snowflake schemas), DWH, ETL/ELT patterns, and dimensional concepts Experience with data governance concepts: access control, retention, data classification, auditability, and compliance standards Familiarity with CI/ ...

and end-to-end scenarios Validate financial calculations, transaction flows, compliance logic, and reporting across multiple platforms Perform end-to-end data validation across ETL pipelines, databases, and reporting layers Develop, maintain, and enhance test automation scripts using Python and PyTest Support API testing using tools such as Postman and ...

Engineering or Analytics Engineering f unctions within a multichannel business. Strong hands-on technical background across modern data platforms (cloud data lakes/warehouses, ETL/ELT, SQL, Python), with the ability to operate strategically at leadership level. Experience designing and delivering scalable, production-grade data pipelines that support ...

growth. Essential Requirements: Experience leading teams of engineers in implementing data-intensive systems. Proficient in Java, Scala, or Python for software development. Experience with ETL/data-processing platforms (e.g., Informatica, Azure Databricks) and advanced SQL. Strong understanding of distributed data stores, frameworks, and data modelling for analytical and operational ...

lifecycle, reproducibility, deployment patterns, and monitoring needs Hands-on experience with orchestration and distributed processing in a cloud environment Experience with data modelling and ETL/ELT patterns; ability to deliver analysis-ready datasets Familiarity with containerization and deployment workflows (Docker, CI/CD, basic Kubernetes/serverless concepts) Strong ...

and CLI tooling. Experience integrating telemetry into Splunk (HEC, UF, sourcetypes, CIM) and creating dashboards/alerts. Proficiency in Python or similar languages for ETL/ELT, enrichment, and validation workflows. Solid experience with Avro/Protobuf/JSON schemas and compatibility best practices. Knowledge of observability frameworks and ability ...

security models). Platform & Integration Lead the design of data flows between ARGUS investment models and Yardi operational and financial systems. Architect APIs, middleware, ETL pipelines, and event-based integrations where appropriate. Ensure consistent master data management across properties, leases, tenants, and financials. Support cloud and SaaS-based architectural approaches ...

Secure coding and API versioning Data & Integration SQL Server, Azure SQL, Cosmos DB ORM optimisation, caching (Redis, Azure Cache for Redis) Data migration and ETL integration (APIs, pipelines) Cloud & DevSecOps Azure DevOps (Repos, Pipelines, Boards, Artifacts, Test Plans) CI/CD automation, gated releases, and environment governance Infrastructure-as-Code ...

Location - London (Hybrid) Duration - 6 months (Initially) I've included key skills below (detailed job specification is attached): Strong understanding of ETL processes - including data extraction, transformation, and loading. Experience with database migration - validating and testing data movement across heterogeneous systems. Hands-on testing experience with Azure Data Factory - including ...

Salary: Up to £70,000 Location: London Data Engineer Responsibilities Design, build, and maintain robust data pipelines from the ground up Develop and optimise ETL workflows using Python and AWS Work closely with Accounting and Finance teams on month-end, IBNR, and financial reporting data Ensure data quality, accuracy, and ...

Salary: Up to £80,000 Location: London Data Engineer Responsibilities Design, build, and maintain robust data pipelines from the ground up Develop and optimise ETL workflows using Python and AWS Work closely with Accounting and Finance teams on month-end, IBNR, and financial reporting data Ensure data quality, accuracy, and ...

succeed Experience with Microsoft Power Platform (Power Apps, Power Automate, Power BI, Power Virtual Agents) Strong Data Engineering background - specifically with Azure Data Factory ETL, Matillion ETL and SQL Experience designing and managing Snowflake Data Warehouse solutions Strong experience with Qliksense, data modelling and self-service analytics Experience ...

responsible for: Requirements Analysis: Understand business and technical requirements to design effective test strategies. Test Planning & Execution: Create detailed test scenarios and scripts for ETL processes, data transformations, and reporting layers. Validate data accuracy, completeness, and consistency across source and target systems. Automation & Regression: Build automated test packs for regression ...

Interest in regulatory systems, financial platforms, or enterprise technology Exposure to CI/CD tooling (e.g. Jenkins) and Agile delivery methodologies Strong SQL and ETL knowledge Experience with database performance analysis and tuning Axiom experience is a plus, but not essential – full training provided This is an excellent opportunity ...

perform Quality Assurance checks according to the project and industry standards Ability to coordinate and manage own workload support project delivery Familiarity with ETL tools like FME and GIS integrations Excellent communication and engagement skills Understanding of construction processes, asset lifecycles and industry regulations and standards Experience in large infrastructure ...

technical assets within Collibra e.g. Data Lineage and Physical Data Mappings to Logical. Liaising and communicating across all functions i.e. Data Office, Application Teams, ETL Teams, DBAs and other Project and IT Teams to ensure Prerequisites for Data Sources are met, managed, and configured. Designing and implementing advanced data governance ...

available to start within 1–2 weeks. Preferred Skills (Nice to Have) IBM Initiate (Master Data Management). Experience with Nginx, Apache Tomcat, and ETL processes. Exposure to Cognitec FaceVACS, MiniO, or Virtualisation technologies. Why Apply? This role offers the chance to lead a high-profile digital transformation that directly ...

governance, and risk policies. Skills & Experience - Essential Strong SQL Server or Snowflake skills. Advanced knowledge of low-code/no-code data engineering/ETL tools - ideally Markit EDM (v19.2+) or similar (e.g. Informatica). Proven delivery experience in Financial Services/Banking sector. Deep understanding of SDLC, systems integration … bank with long-term stability, world-class resources, and clear career progression routes. Enterprise Data Architect, EDM Developer, Data Engineering Lead, Data Architect, ETL Developer, Data Solutions Architect, Senior Data Engineer (Financial Services). Apply today for full details. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy ...

Energy/Gas), who is technically well versed in systematic trading development, and analysis data-sets (time series, market-data). Stack: Python, AWS, ETL, Airflow The team has a flat structure, where developers are interfaced with PMs and traders, to ensure the software systems created are bespoke. ...

ensure reliable, secure, and efficient data infrastructure for the organisation. What you'll be doing: Design, develop, and maintain scalable data architectures and ETL pipelines Build and manage data models and data warehouse solutions (Airflow, dbt, and Redshift) Write clean, efficient Python and SQL code for data processing and transformation … improvement of data processes and tooling across the organisation Experience required: Proven experience in data engineering and building scalable data solutions Strong experience with ETL processes , data modelling, and data warehousing Proficiency in Python and SQL Expertise in relational (SQL) and NoSQL database technologies Hands-on experience with AWS Solid ...

coordinate and manage own workload support project delivery. Basic understanding of reporting and audit functions, including viewing activity logs and document histories. Familiarity with ETL tools like FME and GIS integrations. Excellent communication and engagement skills Minimum Qualifications Needed for Role Degree in BIM/Design/Architecture/Civil ...