1 to 25 of 40 ETL Jobs in the City of London

Azure Data Factory, Synapse, SQL Server and Power BI Solid understanding of data warehousing, lakehouse and datalake architectures Familiarity with modern data engineering patterns (ETL/ELT, medallion architecture, observability) Experience working with Apache Spark and large-scale data processing For a full consultation on this exciting new role, please ...

full lifecycle data solutions: acquisition, engineering, modelling, analysis, and visualisation Leading client workshops and translating business needs into technical solutions Designing and implementing scalable ETL/ELT pipelines using Azure tools (Fabric, Databricks, Synapse, Data Factory) Building data lakes with medallion architecture Migrating legacy on-prem data systems ...

and speaking for communicating requirements and development tasks/issues Hands-on experience with lake houses, dataflows, pipelines, and semantic models Ability to build ETL workflows Familiarity with time-series data, market feeds, transactional records, and risk metrics Familiarity with Git, DevOps pipelines, and automated deployment Strong communication skills with ...

data governance. •Solid understanding of Insurance domain concepts (Specialized Insurance, London Market, Regulatory Data). •Excellent communication and stakeholder management skills. Preferred •Experience with ETL tools and data integration processes. •Familiarity with data warehousing concepts and cloud data platforms. •Exposure to Fivetran, SSIS, or Snowflake advanced features. Personal Besides ...

similar for reporting and visualization. Version Control & Automation: CI/CD pipelines, and automated testing frameworks. Data Management: Strong understanding of data modelling, ETL/ELT processes, and governance standards. A relevant degree in finance, economics, mathematics, or a related field. Strong proficiency in financial modelling and analytical tools. Experience ...

strong reputation for excellence in analytics and data-driven decision-making. Description Senior Data Engineer Develop and maintain robust and scalable data pipelines and ETL processes. Optimise data workflows and ensure efficient data storage solutions. Collaborate with analytics and engineering teams to meet business objectives. Ensure data integrity and implement ...

Data Engineering roles Advanced-level Python for data applications and high proficiency in SQL (query tuning, complex joins) Hands-on experience designing and deploying ETL/ELT pipelines using Google Cloud Dataflow (Apache Beam) or similar tools Proficiency in data architecture, data modeling, and scalable storage design Solid engineering practices ...

combining multiple technologies. Data Engineering & Pipeline Development - Strong skills in building data pipelines for AI/automation solutions including data extraction, transformation, and loading (ETL). Experience with SQL databases (SQL Server), data validation, cleansing workflows, scheduling tools (Azure Data Factory), and ensuring data quality for machine learning applications. Machine ...

and end-to-end scenarios Validate financial calculations, transaction flows, compliance logic, and reporting across multiple platforms Perform end-to-end data validation across ETL pipelines, databases, and reporting layers Develop, maintain, and enhance test automation scripts using Python and PyTest Support API testing using tools such as Postman and ...

operational projects. Develop predictive models and machine-learning workflows using spatial and non-spatial data. Build and maintain spatial databases, data pipelines, and automated ETL processes. Create high-quality maps, dashboards, and visualisations for both technical and non-technical stakeholders. Collaborate with cross-functional teams to define requirements and deliver ...

Looking For Proven Data Engineer with 5+ years of hands-on Databricks experience. Insurance domain expertise - essential. Strong background in data management, ETL, and SQL. Familiarity with Azure and Microsoft BI tools. Immediate start No VISA sponsorship. This is more than a job - it's a chance to shape ...

and C#. Skills and experience required: Strong proficiency in SQL, Python, and C# (including query optimisation and performance tuning). Experience with data modelling, ETL pipelines, and data integration. Proven ability to work directly with stakeholders and data users to understand problems and deliver effective solutions Strong analytical and problem ...

PyTorch, TensorFlow, LangChain. * Cloud: Azure (preferred), AWS, GCP. * MLOps: CI/CD, model lifecycle, monitoring. * Generative AI: LLMs, RAG, chat agents. * Data engineering alignment: ETL, governance. * Strong coding, communication, and collaboration skills. * Strategic thinking, problem-solving, and stakeholder engagement. In accordance with the Employment Agencies and Employment Businesses Regulations ...

Senior Data Engineer with some team leadership responsibilities Strong technical expertise with PySpark, Databricks, Azure, and Data Lake Deep understanding of data architecture and ETL processes in cloud environments The ability to balance coding and technical delivery with people management Excellent problem-solving skills and the energy to thrive ...

and C#. Skills and experience required: Strong proficiency in SQL, Python, and C# (including query optimisation and performance tuning). Experience with data modelling, ETL pipelines, and data integration. Proven ability to work directly with stakeholders and data users to understand problems and deliver effective solutions Strong analytical and problem ...

and driving a data-driven culture Nice to have (not essential) Cloud exposure (Azure/Fabric/Power BI) and modern data platforms (warehouse, ETL/ELT) Experience with tooling such as data catalogues/metadata management/data quality tools If you’re looking for a role where ...

stack AI ready, drive innovation and leverage Agentic development where its needed. Technology/Skills requirements SQL and another language e.g. Python ELT/ETL CI/CD Data Modelling Data Architecture Data Frameworks dbt Data processing and orchestration using Airflow or similar Google BigQuery or Redshift Cloud based services ...

Secure coding and API versioning Data & Integration SQL Server, Azure SQL, Cosmos DB ORM optimisation, caching (Redis, Azure Cache for Redis) Data migration and ETL integration (APIs, pipelines) Cloud & DevSecOps Azure DevOps (Repos, Pipelines, Boards, Artifacts, Test Plans) CI/CD automation, gated releases, and environment governance Infrastructure-as-Code ...

Location - London (Hybrid) Duration - 6 months (Initially) I've included key skills below (detailed job specification is attached): Strong understanding of ETL processes - including data extraction, transformation, and loading. Experience with database migration - validating and testing data movement across heterogeneous systems. Hands-on testing experience with Azure Data Factory - including ...

scalable data pipelines across modern cloud platforms Drive the implementation of GenAI frameworks, including model deployment, monitoring, and lifecycle management ('GenAI Ops') Develop robust ETL/ELT workflows and optimise performance within Snowflake Collaborate with cross-functional teams to integrate AI solutions into data ecosystems Must-Haves Strong background ...

Cloud Functions Dataflow Analytics Hub Looker Studio APIs & Python What we’re looking for: Strong GCP data engineering experience Building & optimising data pipelines/ETL API & connector integrations Problem-solver, cloud-first mindset AI Experience (Preferred) Google Cloud Professional Data Engineer (preferred ...

operational projects. Develop predictive models and machine-learning workflows using spatial and non-spatial data. Build and maintain spatial databases, data pipelines, and automated ETL processes. Create high-quality maps, dashboards, and visualisations for both technical and non-technical stakeholders. Collaborate with cross-functional teams to define requirements and deliver ...

Engineer , you’ll design and implement real-time data pipelines that feed high-quality data to their AI research team. This isn’t about ETL maintenance or analytics. t’s about building scalable, high-throughput systems that handle millions of events per day. You’ll work autonomously, collaborate closely with ...

and data literacy within the product organisation. SKILLS Strong SQL skills with experience querying large, complex datasets. Basic working knowledge of Python. Familiarity with ETL workflows and debugging data issues. Proven experience designing and interpreting A/B tests. Hands-on experience with data visualisation tools (e.g. Looker, Tableau ...

/d Contract length: 6 months Base Location: London - 3/d a week Skills required: - Azure/Azure Data bricks - ADF/ETL - Pyspark/Scala Experience: Experience working on large data sets, and complex data pipelines. Understanding of Data Architecture and Design, and Data pipeline optimisation. Proven expertise ...