1 to 25 of 27 ETL Jobs in the City of London

data platfo rm.Design and develop dimensional data models within Snowflake to support enterprise reporting and analyti cs.Build, maintain and optimise production-grade ELT/ETL processes using modern engineering practic es.Develop scalable data transformation workflows with appropriate version control, testing and documentati on.Optimise Snowflake environments to improve performance and cost ...

and analytics tools including Power BI, Tableau or equivalent BI platforms used for programme performance reporting. Strong understanding of integration technologies including API design, ETL processes, data pipelines and interoperability standards relevant to controls ecosystems. Degree in engineering, computer science, project management or a related discipline or equivalent professional experience. ...

data modelling and SQL Server/database design expertise. Experience designing modern Microsoft data platforms, ideally Microsoft Fabric or Databricks. Strong understanding of ETL, Azure Data Factory, data warehousing and Lakehouse architectures. Background within Financial Services, with exposure to investment data highly desirable. Excellent stakeholder management skills with the ability ...

Azure technologies Expertise in Azure Databricks development, including efficient handling of large datasets Strong working knowledge of Azure Data Factory for building complex ETL workflows Experience with performance optimization of data pipelines and distributed processing setups Proficiency in Scala development (hands‐on experience highly desirable) Solid understanding of Azure services ...

. Strong knowledge of Spark, PySpark, Delta Lake, SQL and modern data engineering. Expertise with Microsoft Azure Strong understanding of data modelling, governance and ETL pipelines. Excellent stakeholder management and consultancy experience. What's in it for you? 📍Remote with travel to clients expected 💰Salary: £100,000 - £120,000 📈Great ...

pipelines, process billions of market data records, and deliver reliable, production-quality datasets for research, analytics and real-time applications. Key Responsibilities Build scalable ETL/ELT pipelines for batch and streaming market data. Develop production-grade Python and SQL solutions. Ingest, normalise and validate market data, including trades, ticks ...

organisation through training and internal champions Ensuring GDPR compliance and robust data security controls throughout Essential Experience: Solid, hands-on understanding of data warehousing, ETL/ELT processes, data modelling and Medallion architecture Experience managing vendors delivering hosted or managed data warehouse solutions Ability to design and implement governance frameworks ...

Data & Cloud SQL/NoSQL databases — Snowflake Cloud platforms: AWS (S3, RDS, Glue), Azure (ADLS, Purview), GCP (BigQuery) Data cataloguing tools — Collibra, Alation, Informatica ETL pipelines and data lineage concepts Security & Privacy SIEM/DLP tools integration (Splunk, Microsoft Purview) Identity & Access Management basics (IAM, RBAC) Encryption, tokenization, and data ...

curation for large-scale datasets Preferred Qualifications Knowledge or interest in investment banking or financial instruments Experience with big data concepts, such as Lakehouse, ETL data pipelines (e.g. Spark, AWS Glue) Experience with near real time and event-based systems like Kafka ABOUT GOLDMAN SACHS At Goldman Sachs, we commit ...

Analytics, Mathematics, or related field.Actuarial Knowledge: Strong understanding of Commercial Insurance actuarial concepts (e.g., reserving methods, pricing tools)Data Proficiency: Experience with data environments, ETL and visualization toolsLeadership: Demonstrated experience leading Agile teams and managing product backlogs.Soft Skills: Excellent communication skills, with the ability to translate technical concepts ...

projects for those that are keen to develop and build a successful career. Core Responsibilities Establishing new data integrations within the data foundation Conduct ETL activities as conducted by SMEs Configuring connections to other datasets within the data foundation Collaborate with SMEs to create, test and validate data models and ...

industry isn't important). Strong knowledge of data integration methodologies and tools, specifically within the Collibra ecosystem. Proficiency in SQL and experience with ETL processes. Familiarity with data governance principles and frameworks. Excellent problem-solving skills and attention to detail. Strong communication skills, both written and verbal, with ...

ensuring they are efficient and robust. Database Solutions: Build and optimise database solutions, focusing on schema design, indexing strategies, and query performance tuning. ETL/ELT Pipelines: Develop and maintain pipelines for ingesting, transforming, and serving data across systems. Integration: Seamlessly integrate applications with data lakes and lake house platforms. … Platforms: - Hands-on experience with data lakes and lakehouse architectures. - Familiarity with big data processing frameworks like Spark. Data Engineering Knowledge: - Proven experience building ETL/ELT pipelines and using orchestration tools (Airflow, Azure Data Factory). - Understanding of JSON, XML, APIs, and data ingestion technologies. Cloud Experience: - Familiarity with ...

designing and evolving data systems that power Tier 1 datasets, improving reliability, reducing technical debt and modernizing legacy workflows. This includes building advanced ETL pipelines, implementing intelligent automation and developing robust data quality controls and monitoring frameworks to ensure data accuracy, completeness and timeliness. In addition, you will play … takes ownership of both data systems and data quality outcomes, and uses modern technologies including AI and machine learning to enhance data workflows and extract additional value from our datasets. We'll trust you to: Build and maintain highly scalable, resilient and observable data pipelines supporting critical Commodities datasets Modernize ...

using Databricks on AWS. Build and optimize data processing frameworks using PySpark, Spark SQL, Python, Delta Lake, and Databricks notebooks. Develop end-to-end ETL/ELT pipelines for ingestion, transformation, validation, and consumption. Work with AWS services such as S3, Glue, Lambda, EMR, IAM, KMS, CloudWatch, Secrets Manager, Athena … processing. Strong understanding of Delta Lake and lakehouse architecture. Hands-on experience with AWS S3 as a data lake storage layer. Experience in building ETL/ELT pipelines for batch and near-real-time data processing. Experience with data formats such as Parquet, Avro, ORC, JSON, and CSV. Good understanding ...

Spark within a modern Lakehouse environment. Key Responsibilities Design, develop and maintain scalable data pipelines using Python and Databricks. Build, optimise and support enterprise ETL/ELT workflows using Apache Spark and Delta Lake. Design and develop robust data models and Lakehouse architectures. Implement and manage data workflows within … Extensive hands-on experience with Databricks , including Workflows, Notebooks and Delta Lake. Strong experience with Apache Spark/PySpark . Proven experience building scalable ETL/ELT pipelines. Strong SQL and data modelling skills. Experience designing modern Lakehouse architectures. Experience working with cloud platforms including AWS, Azure or GCP. Experience ...

structured outputs, evals. Prior consultancy or client-facing delivery experience. Cloud and data infrastructure depth (GCP/AWS, Terraform, CI/CD, warehouses, ETL). Front-end or IaC delivery experience to complement the backend core. How you'll know this job is for you You like being the person ...

perform Quality Assurance checks according to the project and industry standards Ability to coordinate and manage own workload support project delivery Familiarity with ETL tools like FME and GIS integrations Excellent communication and engagement skills Understanding of construction processes, asset lifecycles and industry regulations and standards Experience in large infrastructure ...

engineering standards, defining best practices and mentoring a growing team while remaining hands-on with complex technical delivery. You'll design and build scalable ETL and ELT pipelines, develop robust data models, oversee CI/CD processes, and ensure high-quality data solutions are delivered across AI, analytics and client … team. DATA ENGINEER ESSENTIAL SKILLS Commercial experience in a Lead or Senior Data Engineering position Strong SQL and Python development skills Expertise building ETL and ELT pipelines Experience designing scalable data models and data warehouses Knowledge of Azure, AWS or GCP cloud platforms Experience with CI/CD, Git and ...

will own end-to-end data systems, driving data quality, reliability, and scalable workflows across Tier 1 datasets. You will design and modernize ETL pipelines, implement robust monitoring, and define governance practices. Collaboration with Product, Engineering, and data stakeholders is essential to deliver high‐impact solutions that align with Bloomberg ...

Senior Data Engineer, you'll design, build and optimise scalable data pipelines that support high-performance applications and analytics. You'll develop reliable ETL processes, improve data quality and platform performance, and work closely with Product and Engineering teams to deliver robust data solutions. You'll also contribute to architectural … subject to required skills) your application to our client in conjunction with this vacancy only. KEY SKILLS Senior Data Engineer, Data Engineering, Python, SQL, ETL, Data Pipelines, Data Architecture, Data Modelling, PostgreSQL, NoSQL, Cloud, AWS, Azure, GCP, Big Data, Agile. ...

Quality Assurance Analyst (Data & ETL Testing) - 18 Month FTC We are seeking an experienced Quality Assurance Analyst with a strong data testing background to join a growing technology team undergoing significant transformation. This is an excellent opportunity to play a key role in ensuring the quality, integrity, and reliability … test plans, and test cases. - Perform hands-on testing across data, integration, and application solutions. - Manage defects and test execution using Azure DevOps. - Validate ETL processes, data transformations, and large-volume data migrations. - Collaborate with Developers, Data Engineers, Product Owners, and Scrum teams. - Provide clear reporting on test progress, risks ...

business. What You Will Be Doing Pipeline Engineering: Design and develop robust data ingestion, transformation, and migration solutions utilizing Azure Data Factory (ADF). ETL/ELT Development: Build and maintain seamless pipelines across SQL Server, Azure Data Lake Storage (ADLS), and Snowflake ecosystems. Automation & Frameworks: Build reusable frameworks … must have strong hands-on experience in the following areas: Core Technologies: Azure Data Factory (ADF), Azure Data Lake (ADLS), Azure SQL, and core ETL concepts. SQL Server Mastery: Advanced SQL Server development and administration skills, including hands-on experience managing SQL Server on Azure Virtual Machines. Database Expertise: Proven ...

pipelines and orchestration tooling. Develop database schemas and data models. Integrate and enrich data from multiple sources, ensuring quality and consistency. Design and implement ETL processes (e.g. using NiFi). Write clean, secure, test-driven code that is reusable by default. Maintain and enhance data ingestion and storage architectures. Investigate … into epics and stories. Implement appropriate data security controls. Monitor, maintain and optimise data platforms to ensure performance and reliability. Skills and Experience Required: ETL development using Python or similar languages Apache Spark, NiFi, or Kafka Relational (PostgreSQL, MySQL) and NoSQL (MongoDB, Cassandra) databases AWS and cloud-based data services ...

data migration into Dynamics 365 for Finance. This role involves working closely with data leads, functional consultants, and architects to design and execute efficient ETL processes, ensuring a smooth transition from legacy systems with an emphasis on accuracy and scalability. Responsibilities Design and build ETL processes and migration solutions. Extract … data leads, functional consultants, and architects. Support cutover, deployment, and post go-live hypercare. Document processes, scripts, and migration runbooks. Requirements Proven experience in ETL and data migration engineering. Exposure to Dynamics 365 for Finance & Operations. Strong knowledge of SQL and data modelling. Experience with integration tools such as Azure ...