1 to 25 of 27 ETL Jobs in the City of London

Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform ...

enterprise-wide data governance policies and regulatory standards. Data pipeline automation and orchestration: Experience with Foundry's Pipeline Builder for designing, developing, and automating ETL processes that ensure the availability of clean, curated data for business analytics and decision-making. Code development, testing, and deployment in Foundry: Demonstrated ability ...

reliability carry direct commercial weight. * Requirements * 6+ years data engineering in production environments; Python expertise - idiomatic, well-tested, production-grade code, not notebook scripts * ETL/ELT pipeline design and implementation at scale; orchestration with Airflow, Prefect, or equivalent; reliability-first mindset including backfill, retry, and exactly-once semantics * Azure ...

Revit, Revit API, pyRevit, Rhino, Grasshopper, IES VE (and its Python API), BIM data standards (IFC, COBie) Cloud & Infrastructure: AWS/Azure, Git, Ansible Extract, Transform and Load (ETL) Responsibilities Key responsibilities of the role In addition to the core technology listed above, this role will involve: Designing and implementing ...

Acceldata, and data governance/quality platforms like Informatica, Collibra or Microsoft Purview is highly desirable. Experience within the Azure ecosystem (data lakes, ETL/ELT pipelines) would be a strong advantage. Working across Data Engineering and Data Governance teams, youll help shift the organisation from reactive issue resolution ...

. The right person will be comfortable sitting between data engineering and security/IAM teams . What youll be doing Build and maintain ETL/ELT pipelines using Azure Data Factory, Databricks and SQL Server Develop and support data models, reporting layers and curated datasets for IAM/access ...

looking for: Proven data engineering experience with strong Python and SQL Hands-on with Airflow and/or dbt Solid AWS experience Experience with ETL pipeline development at scale Comfortable working in Agile/Scrum environments Full right to work in the UK — no sponsorship available for this role ...

Platform (ADF, ADLS, Synapse) Be hands-on in development, debugging, optimization, and production support of data pipelines Work with or extend existing/proprietary ETL frameworks (e.g., Mar's Simpel or similar) and improve performance and reliability Implement data modeling, transformation, and orchestration patterns aligned with best practices Apply data ...

organisation through training and internal champions Ensuring GDPR compliance and robust data security controls throughout Essential Experience: Solid, hands-on understanding of data warehousing, ETL/ELT processes, data modelling and Medallion architecture Experience managing vendors delivering hosted or managed data warehouse solutions Ability to design and implement governance frameworks ...

backend Python, REST APIs and microservices You have a good knowledge of AWS including Amazon RedShift You have experience with PostgreSQL, DBT, data pipelines, ETL, data modelling, LLMs and agentic programming You have a good understanding of event driven systems You're comfortable working with complex, data rich environments and ...

more it helps) Experience designing and building APIs Strong mathematical or quantitative background Experience modernising legacy systems Experience designing data processing pipelines or ETL solutions Experience using AI-assisted development tools such as GitHub Copilot Experience in financial services, market data, or capital markets environments Degree in Computer Science, Software ...

data pipelines, including troubleshooting incidents, conducting root cause analysis, managing SLAs, and improving resiliency across business-critical data feeds. Requirements: SQL Python/Bash ETL/ELT support Workflow orchestration (Airflow or Dagster) AWS data services (Athena, S3, MWAA, Iceberg) Data quality monitoring & incident management Nice to Have: Airbyte ...

years of software and data engineering skills. Nice-to-Haves Financial services or market data background Experience modernising legacy platforms API design and ETL/data pipeline experience AI-assisted development tools (GitHub Copilot) Quantitative or mathematics background To Apply - click the link provided. OR Email Barry.Ansell@HarringtonStarr.com ...

developing REST APIs or microservices with Spring Boot. Experience containerising applications with Docker. Understanding of relational and NoSQL databases. Familiarity with modern data architectures (ETL/ELT, streaming, event-driven systems). Knowledge of cloud platforms (AWS, Azure, GCP) is a plus. Excellent problem-solving skills and a collaborative mindset. ...

pipelines & cloud deployment (AWS/Azure) Experience working across business requirements/user journeys (BA background beneficial) Strong understanding of data models, MDM, and ETL processes Experience in Agile environments Leadership & Stakeholder Skills Experience managing or mentoring developers and QA teams Strong communication skills with the ability to challenge and ...

and execute. MUST HAVE SKILLS: NON-NEGOTIABLES 5+ years in Data Engineering Experience in Azure Synapse & Azure DL Development in Python and maintenance of ETL Processes Interesting in analytical platforms such as Microsoft Fabric. INTERVIEW PROCESS 1 st stage – 30 minutes – Teams call – Technical dive with the Lead Engineer Final ...

major communication platforms and capture solutions (e.g., Bloomberg, LSEG, ICE, Symphony, whats app, WeCom, Smarsh, Global Relay, Behavox). Experience with communications data structures, ETL/ELT pipelines, and data integrity standards. Strong understanding of CI/CD practices and agile methodologies. Excellent communication and stakeholder-management skills. Desired Understanding ...

Understanding of GDPR, HIPAA, or UK Data Protection Act compliance Experience with Infrastructure as Code (Terraform, CloudFormation, AWS CDK) Experience designing data ingestion or ETL pipelines across heterogeneous source systems What's On Offer Competitive salary and equity in an early-stage company with significant upside The opportunity ...

and data replication patterns. Knowledge of CDC mechanisms: database log-based CDC, trigger-based CDC, and timestamp-based extraction. Experience with Talend or equivalent ETL tooling for on-premises source extraction. Familiarity with MongoDB data extraction and transformation patterns. Experience designing integration architectures for multi-source estates of 10+ systems. ...

Azure integrations primarily utilising AIS (Azure Integration Services) including optimising enhancement with the MDM platform and integrating data via ADF albeit in conjunction with ETL developers. Working in an SME/Lead capacity you will: Liaise with other technical teams, vendors and wider business stakeholders Design, config and deploy application ...

international investment-banking environment. Systems Expertise: Deep practical knowledge of Oracle ERP/EPM modules, financial data integration, reporting tools, API-based integrations, ETL technologies, data lakes, accounting rules engines, and reference data. This is a fascinating role with a wide range of visibility from day one For more information ...

international investment-banking environment. Systems Expertise: Deep practical knowledge of Oracle ERP/EPM modules, financial data integration, reporting tools, API-based integrations, ETL technologies, data lakes, accounting rules engines, and reference data. This is a fascinating role with a wide range of visibility from day one For more information ...

international investment-banking environment. Systems Expertise: Deep practical knowledge of Oracle ERP/EPM modules, financial data integration, reporting tools, API-based integrations, ETL technologies, data lakes, accounting rules engines, and reference data. This is a fascinating role with a wide range of visibility from day one For more information ...

coordinate and manage own workload support project delivery. Basic understanding of reporting and audit functions, including viewing activity logs and document histories. Familiarity with ETL tools like FME and GIS integrations. Excellent communication and engagement skills Minimum Qualifications Needed for Role Degree in BIM/Design/Architecture/Civil ...

Work closely with engineers, data engineers, and analysts to deliver scalable data solutions Drive delivery performance using data, reporting, and KPIs Oversee data pipelines (ETL), reporting layers, and dashboards Track and optimise delivery metrics such as velocity, cycle time, lead time, and throughput Ensure alignment between business goals, product outcomes … data products, analytics platforms, or insight-led solutions Experience working with cross-functional technical teams (engineering, data, analytics) Solid knowledge of data pipelines (ETL), dashboards, and reporting frameworks Experience using delivery and product metrics to drive decision-making Background in mid-sized (mid-market) organisations, with broad ownership across delivery ...