1 to 25 of 36 ETL Jobs in Central London

improvements Ensure data security and integrity. Stay updated with the latest database technologies and best practices. Data Warehouse Implement best practices for data modelling, ETL processes, and data integration. Optimise data warehouse performance through efficient query design, indexing strategies, and data partitioning. Stay updated on emerging trends and technologies ...

and the hybrid pattern provides a sensible balance between office collaboration and focused work from home. The role will involve: Designing and maintaining automated ETL and ELT processes to integrate data from core systems and APIs Supporting the technical setup and day-to-day maintenance of a central data lake ...

related technologies. Establish strong architectural and engineering standards while optimising platform performance, reliability and cost. Data engineering and delivery Lead the development of reliable ETL and ELT pipelines, data models and integrations. Ensure data solutions are appropriately tested, monitored, documented and supported. Resolve complex technical issues and promote automation and ...

data platfo rm.Design and develop dimensional data models within Snowflake to support enterprise reporting and analyti cs.Build, maintain and optimise production-grade ELT/ETL processes using modern engineering practic es.Develop scalable data transformation workflows with appropriate version control, testing and documentati on.Optimise Snowflake environments to improve performance and cost ...

and analytics tools including Power BI, Tableau or equivalent BI platforms used for programme performance reporting. Strong understanding of integration technologies including API design, ETL processes, data pipelines and interoperability standards relevant to controls ecosystems. Degree in engineering, computer science, project management or a related discipline or equivalent professional experience. ...

highest levels. Job Responsibilities Data Engineering Own the architecture, quality, and scalability of Proximie's data platform. Lead the team building and maintaining ETL/ELT pipelines, data warehousing, and analytics infrastructure. Set engineering standards, tooling decisions, and technical direction across the data stack (Python, SQL, DBT, AWS: S3, Glue ...

data modelling and SQL Server/database design expertise. Experience designing modern Microsoft data platforms, ideally Microsoft Fabric or Databricks. Strong understanding of ETL, Azure Data Factory, data warehousing and Lakehouse architectures. Background within Financial Services, with exposure to investment data highly desirable. Excellent stakeholder management skills with the ability ...

Azure technologies Expertise in Azure Databricks development, including efficient handling of large datasets Strong working knowledge of Azure Data Factory for building complex ETL workflows Experience with performance optimization of data pipelines and distributed processing setups Proficiency in Scala development (hands‐on experience highly desirable) Solid understanding of Azure services ...

. Strong knowledge of Spark, PySpark, Delta Lake, SQL and modern data engineering. Expertise with Microsoft Azure Strong understanding of data modelling, governance and ETL pipelines. Excellent stakeholder management and consultancy experience. What's in it for you? 📍Remote with travel to clients expected 💰Salary: £100,000 - £120,000 📈Great ...

pipelines, process billions of market data records, and deliver reliable, production-quality datasets for research, analytics and real-time applications. Key Responsibilities Build scalable ETL/ELT pipelines for batch and streaming market data. Develop production-grade Python and SQL solutions. Ingest, normalise and validate market data, including trades, ticks ...

organisation through training and internal champions Ensuring GDPR compliance and robust data security controls throughout Essential Experience: Solid, hands-on understanding of data warehousing, ETL/ELT processes, data modelling and Medallion architecture Experience managing vendors delivering hosted or managed data warehouse solutions Ability to design and implement governance frameworks ...

and a BI tool (e.g. Data Studio, Tableau, Power BI) in a data, analytics, or marketing operations role Experience with a data integration/ETL tool (Adverity experience ideal, but Supermetrics, Funnel, or Fivetran experience is transferable) Experience building and maintaining dashboards in Data Studio (or a similar BI tool ...

/or cloud platforms such as AWS or Azure. Good understanding of CI/CD, DevOps practices, performance optimisation, security architecture, SQL, data modelling, ETL, and data migration. Ability to operate effectively across technical and business audiences, translating complex architecture concepts into clear, practical recommendations. What we are looking ...

Data & Cloud SQL/NoSQL databases — Snowflake Cloud platforms: AWS (S3, RDS, Glue), Azure (ADLS, Purview), GCP (BigQuery) Data cataloguing tools — Collibra, Alation, Informatica ETL pipelines and data lineage concepts Security & Privacy SIEM/DLP tools integration (Splunk, Microsoft Purview) Identity & Access Management basics (IAM, RBAC) Encryption, tokenization, and data ...

curation for large-scale datasets Preferred Qualifications Knowledge or interest in investment banking or financial instruments Experience with big data concepts, such as Lakehouse, ETL data pipelines (e.g. Spark, AWS Glue) Experience with near real time and event-based systems like Kafka ABOUT GOLDMAN SACHS At Goldman Sachs, we commit ...

Analytics, Mathematics, or related field.Actuarial Knowledge: Strong understanding of Commercial Insurance actuarial concepts (e.g., reserving methods, pricing tools)Data Proficiency: Experience with data environments, ETL and visualization toolsLeadership: Demonstrated experience leading Agile teams and managing product backlogs.Soft Skills: Excellent communication skills, with the ability to translate technical concepts ...

projects for those that are keen to develop and build a successful career. Core Responsibilities Establishing new data integrations within the data foundation Conduct ETL activities as conducted by SMEs Configuring connections to other datasets within the data foundation Collaborate with SMEs to create, test and validate data models and ...

and modern data platform technologies. Expertise in data architecture, data warehousing, and large-scale data platforms. Strong knowledge of Data Mesh , database design, and ETL/ELT methodologies. Experience designing scalable, secure, and governed data solutions. Understanding of data security, compliance, and GDPR requirements. Excellent analytical and problem-solving abilities. ...

industry isn't important). Strong knowledge of data integration methodologies and tools, specifically within the Collibra ecosystem. Proficiency in SQL and experience with ETL processes. Familiarity with data governance principles and frameworks. Excellent problem-solving skills and attention to detail. Strong communication skills, both written and verbal, with ...

ensuring they are efficient and robust. Database Solutions: Build and optimise database solutions, focusing on schema design, indexing strategies, and query performance tuning. ETL/ELT Pipelines: Develop and maintain pipelines for ingesting, transforming, and serving data across systems. Integration: Seamlessly integrate applications with data lakes and lake house platforms. … Platforms: - Hands-on experience with data lakes and lakehouse architectures. - Familiarity with big data processing frameworks like Spark. Data Engineering Knowledge: - Proven experience building ETL/ELT pipelines and using orchestration tools (Airflow, Azure Data Factory). - Understanding of JSON, XML, APIs, and data ingestion technologies. Cloud Experience: - Familiarity with ...

designing and evolving data systems that power Tier 1 datasets, improving reliability, reducing technical debt and modernizing legacy workflows. This includes building advanced ETL pipelines, implementing intelligent automation and developing robust data quality controls and monitoring frameworks to ensure data accuracy, completeness and timeliness. In addition, you will play … takes ownership of both data systems and data quality outcomes, and uses modern technologies including AI and machine learning to enhance data workflows and extract additional value from our datasets. We'll trust you to: Build and maintain highly scalable, resilient and observable data pipelines supporting critical Commodities datasets Modernize ...

using Databricks on AWS. Build and optimize data processing frameworks using PySpark, Spark SQL, Python, Delta Lake, and Databricks notebooks. Develop end-to-end ETL/ELT pipelines for ingestion, transformation, validation, and consumption. Work with AWS services such as S3, Glue, Lambda, EMR, IAM, KMS, CloudWatch, Secrets Manager, Athena … processing. Strong understanding of Delta Lake and lakehouse architecture. Hands-on experience with AWS S3 as a data lake storage layer. Experience in building ETL/ELT pipelines for batch and near-real-time data processing. Experience with data formats such as Parquet, Avro, ORC, JSON, and CSV. Good understanding ...

Spark within a modern Lakehouse environment. Key Responsibilities Design, develop and maintain scalable data pipelines using Python and Databricks. Build, optimise and support enterprise ETL/ELT workflows using Apache Spark and Delta Lake. Design and develop robust data models and Lakehouse architectures. Implement and manage data workflows within … Extensive hands-on experience with Databricks , including Workflows, Notebooks and Delta Lake. Strong experience with Apache Spark/PySpark . Proven experience building scalable ETL/ELT pipelines. Strong SQL and data modelling skills. Experience designing modern Lakehouse architectures. Experience working with cloud platforms including AWS, Azure or GCP. Experience ...

structured outputs, evals. Prior consultancy or client-facing delivery experience. Cloud and data infrastructure depth (GCP/AWS, Terraform, CI/CD, warehouses, ETL). Front-end or IaC delivery experience to complement the backend core. How you'll know this job is for you You like being the person ...

This is not a paper-architect role. The successful candidate will pick up an in-flight, multi-year programme to decouple and replatform the ETL processes that sit behind every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake …/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. Hands-on T-SQL, stored procedure, ETL framework and PowerShell development at expert level partition design and partition-aligned indexing, clustered/nonclustered index strategy, deduplication, parallel-run cutovers, schema migration, performance ...