1 to 25 of 83 ETL Jobs in the City of London

Exp: 10 + yrs Job Summary The Senior Test Specialist/Architect in Cloud Automation Testing focuses on automating testing processes in ETL (Extract, Transform, Load) and Data Warehousing environments to ensure the quality and reliability of data pipelines. The role involves designing, developing, and implementing automation scripts for testing data transformations, data loading processes, and data quality verification. Key … Responsibilities 1. Develop and execute automated test scripts for etl processes and data pipelines. 2. Collaborate with cross functional teams to design and implement automated testing frameworks. 3. Create test plans and test cases for etl and data warehouse testing. 4. Identify and troubleshoot issues in data transformations and data loading processes. 5. Conduct performance testing and ensure scalability of … data pipelines. 6. Implement best practices for data quality assurance in etl environments. Skill Requirements 1. Proficiency in cloud-based automation testing tools like selenium, appium, or similar. 2. Experience in automation testing of etl (extract, transform, load) processes and data warehousing. 3. Strong understanding of sql for data querying and validation. 4. Knowledge of big data technologies such as More ❯

This role has a direct opportunity to grow into a Head of Data and AI position. Key Responsibilities Data Engineering & Architecture Lead the development and maintenance of data pipelines, ETL processes, and warehouse architecture (GCP, Azure). Ensure high-quality, scalable, and secure data infrastructure that supports campaign reporting and advanced analytics. Design and support the delivery of AI and More ❯

This role has a direct opportunity to grow into a Head of Data and AI position. Key Responsibilities Data Engineering & Architecture Lead the development and maintenance of data pipelines, ETL processes, and warehouse architecture (GCP, Azure). Ensure high-quality, scalable, and secure data infrastructure that supports campaign reporting and advanced analytics. Design and support the delivery of AI and More ❯

suited to someone who's confident communicating with data, product, and engineering teams, not a 'heads-down coder' type. Top 4 Core Skills Python - workflow automation, data processing, and ETL/ELT development. Snowflake - scalable data architecture, performance optimisation, and governance. SQL - expert-level query writing and optimisation for analytics and transformations. dbt (Data Build Tool) - modular data modelling, testing More ❯

Dimensional modelling (star schema, snowflake, denormalised structures, SCD handling) DAX, Visual Studio and data transformation logic Azure Fabric, Azure Data Factory, Synapse, Data Lakes and Lakehouse/Warehouse technologies ETL/ELT orchestration for structured and unstructured data Proficiency in: PySpark, T-SQL, Notebooks and advanced data manipulation Performance monitoring and orchestration of Fabric solutions Power BI semantic models and More ❯

Extensive experience in designing cloud data platforms using Azure, AWS, or exceptional on-premise design expertise. - At least 5 years in data engineering or business intelligence roles. - Proficiency in ETL and data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data modelling capabilities. About the Company More ❯

Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and insights strategy. Provide ongoing support for data products, including incident management and defining More ❯

or GCP). Snowflake Expertise: Strong practical experience with Snowflake components (Snowpipe, Snowpark, Tasks, Dynamic Tables, UDFs). SnowPro certification preferred. Technical Proficiency: Advanced Python and SQL skills for ETL/ELT workflows and data transformations. Cloud & Automation: Familiarity with CI/CD pipelines and automated testing for data workflows. Governance & Security: Understanding of data governance frameworks and security best More ❯

learning algorithms , statistical modelling , and deep learning architectures . Hands-on experience with MLOps tools and frameworks (e.g., MLflow, Kubeflow, SageMaker, Vertex AI). Experience with data engineering concepts — ETL pipelines, data lakes, and cloud data platforms. Proficiency with cloud services (AWS, Azure, or GCP) for model deployment and orchestration. Knowledge of containerization and orchestration tools (Docker, Kubernetes). Experience More ❯

field or relevant industry industry experience Have knowledge of programming and data manipulation skills such as SQL and Python, and version control (Github) is essential Experience building multi-step ETL jobs/data pipelines and working with job scheduling systems is a plus Demonstrated ability to thrive with minimal oversight and process. You connect the dots across business needs and More ❯

native Azure services Requirements: 10+ years in cloud architecture/engineering with a strong focus on building scalable data pipelines Expertise in Azure Databricks (7+years) including building and managing ETL pipelines using PySpark or Scala (essential) Solid understanding of Apache Spark, Delta Lake, and distributed data processing concepts Hands-on experience with Azure Data Lake Storage Gen2, Azure Data Factory More ❯

Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs Monitor, troubleshoot, and optimise data More ❯

at least one of: Front Office (Sales & Trading), Risk Management, or Finance. Strong programming in Python, Java and SQL (Rust a plus). Proven experience building streaming and batch ETL/ELT pipelines at scale. Strong understanding of market/trade data lifecycles and time series concepts. Experience with AWS and cloud-native data services. Excellent communication and stakeholder management More ❯

Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs Monitor, troubleshoot, and optimise data More ❯

at least one of: Front Office (Sales & Trading), Risk Management, or Finance. Strong programming in Python, Java and SQL (Rust a plus). Proven experience building streaming and batch ETL/ELT pipelines at scale. Strong understanding of market/trade data lifecycles and time series concepts. Experience with AWS and cloud-native data services. Excellent communication and stakeholder management More ❯

DevOps team to deliver data solutions and maintain live systems. Apply best practices for data integration, transformation, and delivery in a secure and scalable environment. Support data pipelines and ETL processes across various technologies and cloud platforms Maintain, monitor, and troubleshoot systems using a wide array of tools and platforms. Contribute to automation and continuous integration/deployment (CI/ More ❯

years of industry experience in Data Engineering roles Advanced-level Python for data applications and high proficiency in SQL (query tuning, complex joins) Hands-on experience designing and deploying ETL/ELT pipelines using Google Cloud Dataflow (Apache Beam) or similar tools Proficiency in data architecture, data modeling, and scalable storage design Solid engineering practices: Git and CI/CD More ❯

years of industry experience in Data Engineering roles Advanced-level Python for data applications and high proficiency in SQL (query tuning, complex joins) Hands-on experience designing and deploying ETL/ELT pipelines using Google Cloud Dataflow (Apache Beam) or similar tools Proficiency in data architecture, data modeling, and scalable storage design Solid engineering practices: Git and CI/CD More ❯

work closely with the Director of Analytics and Strategic Data Manager and be responsible for implementing data pipelines in Azure Data Factory and Azyre Databricks, supporting Darewhaoure implementation and ETL process. Location: Hybrid in London Salary: £55,000 to £65,000 + Benefits To be considered: Minimum 3 years of experience working as a Data Engineer within an Azure Environment. More ❯

work closely with the Director of Analytics and Strategic Data Manager and be responsible for implementing data pipelines in Azure Data Factory and Azyre Databricks, supporting Darewhaoure implementation and ETL process. Location: Hybrid in London Salary: £55,000 to £65,000 + Benefits To be considered: Minimum 3 years of experience working as a Data Engineer within an Azure Environment. More ❯

plus. * AI/ML frameworks: PyTorch, TensorFlow, LangChain. * Cloud: Azure (preferred), AWS, GCP. * MLOps: CI/CD, model lifecycle, monitoring. * Generative AI: LLMs, RAG, chat agents. * Data engineering alignment: ETL, governance. * Strong coding, communication, and collaboration skills. * Strategic thinking, problem-solving, and stakeholder engagement. In accordance with the Employment Agencies and Employment Businesses Regulations 2003, this position is advertised based More ❯

objectives and digital innovation goals. - Manage JIRA project tracking, maintain Confluence documentation, and oversee code design for efficient development and collaboration. - Lead technical design and implementation of data models, ETL processes, and visualisation tools (BigQuery, Airflow, SSIS, Tableau, SSRS). - Define and implement best practices in data modeling, including data warehouse and lakehouse integration (Medallion Architecture). Skills and Experience More ❯

Agile (SCRUM) methodologies. Experience integrating automated test cases with CI/CD frameworks (Azure DevOps). Excellent understanding of risk management, defect management, and performance metrics. Desirable: experience with ETL testing, BrowserStack, and service-oriented protocols (XML). Personal Attributes Exceptional analytical and problem-solving skills. Highly organised, with strong attention to detail. Effective communicator who can influence and collaborate More ❯

ability to translate business needs into smart, scalable solutions. • Proven experience with Microsoft 365 and Power Platform (PowerApps, PowerAutomate, Dataverse) • Strong SQL skills, including data modeling, performance tuning, and ETL processes • Hands-on experience with SharePoint, Teams, and Exchange integration • Experience with Azure DevOps, API integration, and application lifecycle management • Excellent communication skills with the confidence to engage technical and More ❯

ability to translate business needs into smart, scalable solutions. • Proven experience with Microsoft 365 and Power Platform (PowerApps, PowerAutomate, Dataverse) • Strong SQL skills, including data modeling, performance tuning, and ETL processes • Hands-on experience with SharePoint, Teams, and Exchange integration • Experience with Azure DevOps, API integration, and application lifecycle management • Excellent communication skills with the confidence to engage technical and More ❯