26 to 50 of 633 ETL Jobs in London

query performance tuning Dataform or equivalent transformation frameworks (dbt, etc.), writing SQLX, managing dependencies, and maintaining modular, well‐tested transformation logic Solid understanding of ETL/ELT pipeline design, including incremental loads, idempotency, error handling, and pipeline monitoring Working with event‐driven or streaming data pipelines (Pub/Sub, Kafka ...

including performance and development plans Lead recruitment and be the engineering voice in cross-functional planning Data Engineering & Architecture Design and build high-performance ETL/ELT pipelines across operational, analytical, and AI data layers Lead schema design, model validation, scalable partitioning, and metadata-driven SQL frameworks Hands-on ownership ...

analytics solutions using Synapse Analytics and Data Lake Storage. Collaborate with clients to understand their data needs and provide tailored solutions. Develop and optimise ETL/ELT processes to maintain data integrity and performance. Ensure data solutions are scalable, resilient, and secure. Troubleshoot and resolve data-related issues efficiently. Document ...

with large datasets in a data engineering or similar role. Good understanding of data warehousing concepts, data modelling (Star/Snowflake/3NF), and ETL/ELT pipelines. Experience tuning SQL/PLSQL queries and improving performance of reports and data extracts. Hands‐on experience with at least one cloud ...

scalable data solutions. Technical Expertise Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow). Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent. Strong SQL and Python (or equivalent language) skills for data manipulation and automation. Hands ...

business stakeholders to make data-driven decisions that shape the future of our company. Key Responsibilities Design, build, and maintain robust, scalable, and reliable ETL/ELT data pipelines . Develop data models and schemas in our data warehouse to support business analytics and reporting needs. Integrate data from ...

scalable data solutions. Technical Expertise Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow). Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent. Strong SQL and Python (or equivalent language) skills for data manipulation and automation. Hands ...

data modeling, semantic layers, KPI standardization) Modern data platforms: Microsoft Fabric (preferred) or Snowflake/equivalent cloud data platforms Data integration patterns, including: APIs ETL/ELT processes Programming and data manipulation (Python, SQL) Proven ability to: Transition organizations from fragmented reporting to standardized data-driven decision making Drive business ...

party APIs, returning complex data from multiple endpoints. Implement processes to retain and refresh this data within business systems.Data Modeling: Using the businesses preferred ETL tools, generate curated datasets from raw input tables. Ensure all datasets have clear, documented lineage and integrated testing to protect against bad data entering datasets ...

APIs, returning complex data from multiple endpoints. Implement processes to retain and refresh this data within business systems. Data Modeling: Using the businesses preferred ETL tools, generate curated datasets from raw input tables. Ensure all datasets have clear, documented lineage and integrated testing to protect against bad data entering datasets ...

certifications in Azure, Power BI, data, or AI architecture. Core Technology Stack Data platform : Azure Data Factory, Databricks, Azure data lake, SQL, dimensional modeling, ETL/ELT, orchestration. AI platform : Azure OpenAI, Azure AI Foundry, Azure AI Search, Copilot Studio, Semantic Kernel, Prompt Flow. Analytics : Power BI, semantic models ...

e.g. Cloud, Azure, Databricks), and enterprise data and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) Experience with data product thinking, domain-oriented ownership or federated operating models Understanding of data standards and industry models ...

modelling, experimental design & A/B testing, Bayesian methods, model validation Significant knowledge and experience of supervised & unsupervised machine learning, ensemble methods Knowledge of ETL/ELT processes Significant experience of successfully operating in a politically sensitive environment. Knowledge and experience of designing end to end pipelines Knowledge and experience ...

leading an organization of 25 or more people in a large, matrixed enterprise. Strong hands-on foundation in SQL, dimensional modeling, and ELT/ETL design, with production experience on a modern cloud data warehouse or lakehouse (for example Snowflake, Databricks, BigQuery, Redshift, or Synapse) and a transformation framework such ...

platform – Microsoft Fabric, Azure Synapse/Databricks, data lakehouse and warehouse design, migration and modernisation from legacy platforms. Data engineering and integration – ingestion pipelines, ETL/ELT modernisation, master data management, unstructured content preparation (SharePoint, file shares, Teams) for retrieval-augmented AI. Data governance, quality and security – Microsoft Purview, cataloguing ...

platform – Microsoft Fabric, Azure Synapse/Databricks, data lakehouse and warehouse design, migration and modernisation from legacy platforms. Data engineering and integration – ingestion pipelines, ETL/ELT modernisation, master data management, unstructured content preparation (SharePoint, file shares, Teams) for retrieval-augmented AI. Data governance, quality and security – Microsoft Purview, cataloguing ...

analytics, or related disciplines in a complex, global organisation. Proven delivery of modern cloud‐based data platforms, data lakes or warehouses, integration patterns, ETL/ELT pipelines, semantic models, and analytics solutions. Strong knowledge of the Microsoft data and analytics ecosystem, including Azure data services, SQL, Power BI, and modern ...

foundational data systems that underlie modern AI infrastructure, including vector, NoSQL, and document databases. Develop end-to-end data engineering solutions, including robust ETL/ELT pipelines, API services, and data ingestion frameworks. Design and build the storage and processing layers powering our analytics workloads: data lakes, data warehouses, distributed ...

practical, curious and commercially-minded approach to problem-solving. Desirable Experience with machine learning and predictive modelling. Experience with Snowflake. Experience working with ETL/data integration tools, ideally Matillion. Experience with cloud data platforms and modern data stacks Experience working with large-scale video, image or other unstructured datasets. ...

data modelling. Strong understanding of query languages and analytics technologies, including SQL, MDX, DAX, Power Query (M), and PostgreSQL. Experience building, maintaining, and optimizing ETL/ELT processes using SSIS, Azure Data Factory, Microsoft Fabric, or equivalent tools. Hands‐on experience developing and supporting Power BI solutions, including Power ...

Reference Data. Cloud Platforms: Microsoft Azure; AWS; GCP. Modern Data Platforms: Databricks; Microsoft Fabric; PostgreSQL. Data Integration: Azure Data Factory; API-led Integration; Kafka; ETL/ELT; Streaming and Event-Driven Architectures. Architecture & Modelling: TOGAF; DAMA; ArchiMate; Sparx Enterprise Architect. Data Governance: Microsoft Purview; Collibra; Informatica; Security by Design; Data ...

frameworks.* Collaborate with business stakeholders, solution architects, product owners, and engineering teams to translate requirements into effective data solutions.* Define data integration patterns using ETL/ELT, APIs, event-driven architectures, and real-time streaming technologies.* Drive cloud migration and modernization of legacy data platforms.* Support advanced analytics, AI/ ...

and transform diverse data types into standardized, unified schemas Good understanding of serverless, code-driven data transformation pipelines as well as traditional batch-oriented ETL systems. Technologies While mastery of everything is not required, we are seeking Engineers who possess hands‐on experience with one or more of the following ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business and technology teams Essential Experience Proven Data Architect experience ...

Talend, etc. Understanding of machine learning algorithms and statistics. Experience with data visualization tools like Tableau, PowerBI, etc. Knowledge of data warehousing solutions and ETL tools. Familiarity with data architecture and data modeling techniques. Experience with stream-processing systems: Storm, Spark-Streaming, etc. Knowledge of software development methodologies like Agile ...