1 to 25 of 26 ETL Jobs in the City of London

with high-quality, reliable data. Key Responsibilities: Develop and maintain scalable data pipelines using Azure Data Factory, Synapse, Databricks, and Microsoft Fabric. Build efficient ETL/ELT processes and data models to support analytics, reporting, and dashboards. Optimise existing pipelines for performance, reliability, and cost efficiency. Implement best practices ...

make an impact. What You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards ETL & Data Modelling: T-SQL, metadata-driven pipelines DevOps: CI/CD Bonus: Python What you'll do Design and implement scalable Azure-based data solutions ...

similar for reporting and visualization. Version Control & Automation: CI/CD pipelines, and automated testing frameworks. Data Management: Strong understanding of data modelling, ETL/ELT processes, and governance standards. A relevant degree in finance, economics, mathematics, or a related field. Strong proficiency in financial modelling and analytical tools. Experience ...

strong reputation for excellence in analytics and data-driven decision-making. Description Senior Data Engineer Develop and maintain robust and scalable data pipelines and ETL processes. Optimise data workflows and ensure efficient data storage solutions. Collaborate with analytics and engineering teams to meet business objectives. Ensure data integrity and implement ...

platforms/dashboards inc SQL, ADF, PowerBI etc Management and leadership of multi-disciplinary teams within data Data Science, Data Analysis, Engineering/ETL, Data Visualisation Experience of developing and, critically, delivering AI/NLP/ML and predictive analytics capability within commercial environments. Experience of ensuring that all data ...

engineering field. You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards and analytics ETL & Data Modelling: T-SQL, metadata-driven pipelines Design and implement scalable Azure-based data solutions Build and optimise data pipelines for integration and transformation Develop ...

combining multiple technologies. Data Engineering & Pipeline Development - Strong skills in building data pipelines for AI/automation solutions including data extraction, transformation, and loading (ETL). Experience with SQL databases (SQL Server), data validation, cleansing workflows, scheduling tools (Azure Data Factory), and ensuring data quality for machine learning applications. Machine ...

environments, ideally within policing, public safety, or similar sectors. Strong background in data engineering and data architecture, including experience with large-scale data integration, ETL processes, and automation. Familiarity with data science and machine learning concepts, especially as applied to risk modelling and predictive analytics. Experience with cloud platforms and ...

with modern data technologies (ClickHouse, PostgreSQL, Kafka, or equivalents.). Experience implementing ML Ops frameworks (e.g. MLflow, Kubeflow, Prefect, or SageMaker) Deep understanding of ETL/ELT pipelines, streaming architectures, and data lifecycle management. Experience working in Kubernetes and cloud-native environments (AWS preferred). Sound knowledge of data governance ...

performing workloads. Implement data quality, lineage tracking, and access control policies aligned with Databricks Unity Catalogue and governance best practices. Develop PySpark applications for ETL, data transformation, and analytics, following modular and reusable design principles. Create and manage Delta Lake tables with ACID compliance, schema evolution, and time travel ...

deployment scripts and contributing to continuous improvement of deployment processes Required Competencies Strong knowledge of database systems, particularly Microsoft SQL Server, and familiarity with ETL processes and tools. Strong understanding of cloud-based data solutions, preferably Microsoft Azure. Experience maintaining online reporting tools such as Power BI. Proficiency in PowerShell ...

/DFD. Essential Skills & Experience Proven experience designing and owning system architecture for large-scale compliance or AML platforms Strong background building and optimising ETL/ELT data pipelines handling high-volume financial data Hands-on expertise with microservices, APIs and event-driven systems (e.g., Kafka) Ability to translate ...

scalable data pipelines across modern cloud platforms Drive the implementation of GenAI frameworks, including model deployment, monitoring, and lifecycle management ('GenAI Ops') Develop robust ETL/ELT workflows and optimise performance within Snowflake Collaborate with cross-functional teams to integrate AI solutions into data ecosystems Must-Haves Strong background ...

Location - London (Hybrid) Duration - 6 months (Initially) I've included key skills below (detailed job specification is attached): Strong understanding of ETL processes - including data extraction, transformation, and loading. Experience with database migration - validating and testing data movement across heterogeneous systems. Hands-on testing experience with Azure Data Factory - including ...

documenting APIs. Deep knowledge of Python ecosystem (Pandas, Numpy, Bokeh, PyArrow, Matplotlib, IPyWidgets, Jupyter, etc.). Proven experience with large-scale data pipelines and ETL workflows. Comfortable working in Jupyter notebooks. Understanding of crypto or traditional financial markets. Nice to Have: Experience with crypto exchanges and market microstructure. Hands ...

operational projects. Develop predictive models and machine-learning workflows using spatial and non-spatial data. Build and maintain spatial databases, data pipelines, and automated ETL processes. Create high-quality maps, dashboards, and visualisations for both technical and non-technical stakeholders. Collaborate with cross-functional teams to define requirements and deliver ...

with enterprise integration, governance, and security best practices. Technical expertise in web, service-based, and cloud architectures. Knowledge of databases (MS SQL, Oracle) and ETL tools (eg, Informatica). Proven track record of delivering solutions with measurable business outcomes. Ability to coach, mentor, and influence technical teams. For a full ...

/OpenAPI), and testing tools (e.g. Postman). Working knowledge of cloud platforms (primarily Azure) and associated data services. Strong understanding of data modelling, ETL workflows, and system integration. Services offered by Computappoint Limited are those of an Employment Business and/or Employment Agency in relation to this vacancy. ...

/d Contract length: 6 months Base Location: London - 3/d a week Skills required: - Azure/Azure Data bricks - ADF/ETL - Pyspark/Scala Experience: Experience working on large data sets, and complex data pipelines. Understanding of Data Architecture and Design, and Data pipeline optimisation. Proven expertise ...

/d Contract length: 6 months Base Location: London - 3/d a week Skills required: - Azure/Azure Data bricks - ADF/ETL - Pyspark/Scala Experience: Experience working on large data sets, and complex data pipelines click apply for full job details ...

data solutions covering acquisition, engineering, modelling, analysis, and visualisation. Client workshops and communication at both technical and business levels. Design and implementation of robust ETL/ELT solutions using the Microsoft/Azure ecosystem (Fabric/Databricks). Development of data lakehouse architectures using a medallion design approach. Scalable engineering … relationships with teams and clients. Practical experience in data engineering or data warehousing with Azure/Microsoft or SQL Server technologies. Skills in developing ETL/ELT pipelines using Azure Synapse, Data Factory, Databricks, or Fabric, with SQL and Python. Strong understanding of data lake and lakehouse architectures. Experience working ...

governance, and risk policies. Skills & Experience - Essential Strong SQL Server or Snowflake skills. Advanced knowledge of low-code/no-code data engineering/ETL tools - ideally Markit EDM (v19.2+) or similar (e.g. Informatica). Proven delivery experience in Financial Services/Banking sector. Deep understanding of SDLC, systems integration … bank with long-term stability, world-class resources, and clear career progression routes. Enterprise Data Architect, EDM Developer, Data Engineering Lead, Data Architect, ETL Developer, Data Solutions Architect, Senior Data Engineer (Financial Services). Apply today for full details. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy ...

scope and deliver projects. Contribute to technical delivery, designing scalable data solutions in Azure/Microsoft environments. Support cloud migrations, data lake builds, and ETL/ELT pipeline development. Ensure delivery follows best practices and internal standards. Skills & Experience Strong leadership and relationship-building skills. Experience guiding or managing technical … experience in Data Engineering using Microsoft Fabric, Azure Databricks, Synapse, Data Factory, and/or SQL Server. Expertise in SQL and Python for ETL/ELT development. Knowledge of data lakes, medallion lakehouse architecture, and large-scale dataset management. Solid understanding of BI, data warehousing, and database optimisation. To apply ...

technical delivery when needed, including designing scalable data solutions in Microsoft/Azure environments. Contribute to innovation through cloud migrations, data lakes, and robust ETL/ELT solutions. What We're Looking For Hands-on Data Engineering experience (not Data Analyst or Data Scientist roles). Strong background in Azure … Synapse, Databricks, or Microsoft Fabric. Expertise in ETL/ELT development using SQL and Python. Experience implementing data lakes and medallion lakehouse architecture. Skilled in managing large datasets and writing advanced SQL/Python queries. Solid understanding of BI and data warehousing concepts. Excellent communication skills and ability to build ...

Innovation Support technical delivery when needed, including designing scalable Azure/Microsoft data solutions. Drive innovation through cloud migrations, data lake implementations, and robust ETL/ELT pipeline development. Skills & Experience You'll thrive in this role if you have: Leadership Proven ability to build strong relationships and foster … Strong background in Data Engineering or Data Warehouse development using Microsoft Fabric, Azure Databricks, Synapse, Data Factory, and/or SQL Server. Expertise in ETL/ELT design with SQL and Python. Solid understanding of data lakes, medallion lakehouse architecture, and large-scale dataset management. Strong BI and data warehousing ...