251 to 275 of 606 ETL Jobs in the UK excluding London

processing (NLP) techniques, and the optimization of large language models for enterprise deployment. Data Engineering & Cloud Computing: Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands-on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and ...

processing (NLP) techniques, and the optimization of large language models for enterprise deployment. Data Engineering & Cloud Computing: Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands-on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and ...

processing (NLP) techniques, and the optimization of large language models for enterprise deployment. Data Engineering & Cloud Computing: Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands-on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and ...

automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real-time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside ...

implementing modern and scalable data management platforms (including modern data lake and enterprise data warehouse solutions as well as consolidated and modern data pipelines (ETL\ELT) to extract, aggregate and manipulate data from various sources Designing, developing and implementing end-to-end Business Intelligence (BI) solutions with data semantic models ...

Delta Lake. Develop and implement modern Lakehouse architectures, applying Medallion (Bronze, Silver, Gold) design principles to support trusted and reusable data products. Build robust ETL and ELT processes that ingest, transform and curate large, complex and diverse datasets. Drive best practice in data quality, monitoring, alerting and operational support … Databricks, PySpark, Spark SQL and Delta Lake. Experience designing and implementing Lakehouse architectures, including Medallion (Bronze, Silver, Gold) data models. Expertise in developing scalable ETL/ELT pipelines capable of handling large and complex datasets. Understanding of modern cloud data platforms, particularly Azure and/or AWS. Experience implementing data ...

architecture, data governance and reporting capabilities across a complex investment environment. What You'll Do Lead the assessment and modernisation of legacy SQL Server, ETL and reporting workloads into a Databricks-based architecture. Design scalable data models, Delta Lake structures and transformation pipelines supporting real estate investment data. Analyse data … analysis, source-to-target mapping and data quality assessment. Strong understanding of production-grade data platforms, performance optimisation and operational support. Experience migrating SSIS, ETL pipelines, stored procedures and reporting solutions to cloud-based platforms. Exposure to Azure DevOps, Git and CI/CD practices. Experience with Python, PySpark, Power ...

including S3, Redshift, Glue, Lambda, Lake Formation, Athena and EventBridge. Implement Bronze, Silver and Gold data layers using Medallion Architecture principles. Build and maintain ETL/ELT pipelines across batch, streaming and Change Data Capture (CDC) workloads. Develop reusable transformation frameworks, data models and curated datasets using Python, SQL and … Advanced SQL skills and strong Python development experience. Experience using dbt for data transformation and modelling would be highly beneficial. Experience building and optimising ETL/ELT pipelines. Good understanding of data warehousing, dimensional modelling and analytical data structures. Experience with data integration, APIs, messaging and file-based data ingestion. ...

better use of modern Microsoft-based data and integration technologies. Design, develop and maintain automated data integrations between business applications. Build, support and optimise ETL/ELT processes and automated data pipelines. Develop automation solutions using APIs, scheduled processes and event-driven workflows. Monitor, troubleshoot and optimise data automation processes … years’ experience in Data Engineering, Integration Engineering, Automation Engineering or a similar role. Strong SQL Server and T-SQL skills. Experience developing ETL/ELT processes and data pipelines. Experience with APIs, integrations and data exchange technologies. Experience using Microsoft Azure services. Experience with Microsoft Fabric or similar cloud data ...

Factory, including integration with legacy, cloud and on-premises data sources. Engineer reliable data pipelines and models: Design batch, incremental and near-real-time ETL/ELT using SQL, Python and PySpark; apply medallion, dimensional/Kimball, normalised and data-product patterns as appropriate; and use production-grade techniques such …/Production workspace patterns. Advanced SQL, Python and PySpark, with practical experience of Delta/Parquet, medallion architecture and production-grade batch/incremental ETL/ELT. Strong Git and CI/CD experience using Azure DevOps and/or GitHub, including controlled release, testing, deployment, rollback and environment promotion ...

better use of modern Microsoft-based data and integration technologies. Design, develop and maintain automated data integrations between business applications. Build, support and optimise ETL/ELT processes and automated data pipelines. Develop automation solutions using APIs, scheduled processes and event-driven workflows. Monitor, troubleshoot and optimise data automation processes … years’ experience in Data Engineering, Integration Engineering, Automation Engineering or a similar role. Strong SQL Server and T-SQL skills. Experience developing ETL/ELT processes and data pipelines. Experience with APIs, integrations and data exchange technologies. Experience using Microsoft Azure services. Experience with Microsoft Fabric or similar cloud data ...

better use of modern Microsoft-based data and integration technologies. Design, develop and maintain automated data integrations between business applications. Build, support and optimise ETL/ELT processes and automated data pipelines. Develop automation solutions using APIs, scheduled processes and event-driven workflows. Monitor, troubleshoot and optimise data automation processes … years’ experience in Data Engineering, Integration Engineering, Automation Engineering or a similar role. Strong SQL Server and T-SQL skills. Experience developing ETL/ELT processes and data pipelines. Experience with APIs, integrations and data exchange technologies. Experience using Microsoft Azure services. Experience with Microsoft Fabric or similar cloud data ...

better use of modern Microsoft-based data and integration technologies. Design, develop and maintain automated data integrations between business applications. Build, support and optimise ETL/ELT processes and automated data pipelines. Develop automation solutions using APIs, scheduled processes and event-driven workflows. Monitor, troubleshoot and optimise data automation processes … years’ experience in Data Engineering, Integration Engineering, Automation Engineering or a similar role. Strong SQL Server and T-SQL skills. Experience developing ETL/ELT processes and data pipelines. Experience with APIs, integrations and data exchange technologies. Experience using Microsoft Azure services. Experience with Microsoft Fabric or similar cloud data ...

better use of modern Microsoft-based data and integration technologies. Design, develop and maintain automated data integrations between business applications. Build, support and optimise ETL/ELT processes and automated data pipelines. Develop automation solutions using APIs, scheduled processes and event-driven workflows. Monitor, troubleshoot and optimise data automation processes … years’ experience in Data Engineering, Integration Engineering, Automation Engineering or a similar role. Strong SQL Server and T-SQL skills. Experience developing ETL/ELT processes and data pipelines. Experience with APIs, integrations and data exchange technologies. Experience using Microsoft Azure services. Experience with Microsoft Fabric or similar cloud data ...

better use of modern Microsoft-based data and integration technologies. Design, develop and maintain automated data integrations between business applications. Build, support and optimise ETL/ELT processes and automated data pipelines. Develop automation solutions using APIs, scheduled processes and event-driven workflows. Monitor, troubleshoot and optimise data automation processes … years' experience in Data Engineering, Integration Engineering, Automation Engineering or a similar role. Strong SQL Server and T-SQL skills. Experience developing ETL/ELT processes and data pipelines. Experience with APIs, integrations and data exchange technologies. Experience using Microsoft Azure services. Experience with Microsoft Fabric or similar cloud data ...

better use of modern Microsoft-based data and integration technologies. Design, develop and maintain automated data integrations between business applications. Build, support and optimise ETL/ELT processes and automated data pipelines. Develop automation solutions using APIs, scheduled processes and event-driven workflows. Monitor, troubleshoot and optimise data automation processes … years' experience in Data Engineering, Integration Engineering, Automation Engineering or a similar role. Strong SQL Server and T-SQL skills. Experience developing ETL/ELT processes and data pipelines. Experience with APIs, integrations and data exchange technologies. Experience using Microsoft Azure services. Experience with Microsoft Fabric or similar cloud data ...

better use of modern Microsoft-based data and integration technologies. Design, develop and maintain automated data integrations between business applications. Build, support and optimise ETL/ELT processes and automated data pipelines. Develop automation solutions using APIs, scheduled processes and event-driven workflows. Monitor, troubleshoot and optimise data automation processes … years' experience in Data Engineering, Integration Engineering, Automation Engineering or a similar role. Strong SQL Server and T-SQL skills. Experience developing ETL/ELT processes and data pipelines. Experience with APIs, integrations and data exchange technologies. Experience using Microsoft Azure services. Experience with Microsoft Fabric or similar cloud data ...

better use of modern Microsoft-based data and integration technologies. Design, develop and maintain automated data integrations between business applications. Build, support and optimise ETL/ELT processes and automated data pipelines. Develop automation solutions using APIs, scheduled processes and event-driven workflows. Monitor, troubleshoot and optimise data automation processes … years' experience in Data Engineering, Integration Engineering, Automation Engineering or a similar role. Strong SQL Server and T-SQL skills. Experience developing ETL/ELT processes and data pipelines. Experience with APIs, integrations and data exchange technologies. Experience using Microsoft Azure services. Experience with Microsoft Fabric or similar cloud data ...

solutions on the Databricks Lakehouse Platform Strong expertise in Apache Spark, SQL, Python, Delta Lake, and modern data engineering practices Experience building and optimizing Extract, Transform, Load and Extract, Load, Transform data pipelines for scalable analytics and artificial intelligence use cases Proven knowledge of data modeling, data governance, data quality ...

Build and evolve the serving layer - including graph and vector retrieval, GraphRAG, response assembly, and a Model Context Protocol endpoint consumed by downstream agents Extract and promote reusable components into a shared core library, reducing duplication across the platform's repositories Integrate with data sources and services across the firm … tool/function calling, Model Context Protocol), or platforms such as Bedrock or Azure OpenAI Experience with Databricks, MongoDB, or large‐scale extract, transform, and load/data integration workflows Knowledge of data governance, lineage, and entitlements concepts in an enterprise environment ABOUT US J.P. Morgan is a global leader ...

patterns (tool/function calling, Model Context Protocol), or platforms such as Bedrock or Azure OpenAIExperience with Databricks, MongoDB, or large-scale extract, transform, and load/data integration workflowsKnowledge of data governance, lineage, and entitlements concepts in an enterprise environmentJ.P. Morgan is a global leader in financial services, providing ...

Jacobs Engineering Group Inc. in the United Kingdom invites you to join the Data & Digital team as a Data Engineer. You will design, build and maintain cloud-native data pipelines, and collaborate with engineers, analysts ...

processing, business intelligence, and integration with web and financial applications. Design and implement scalable data solutions for finance applications, including optimised data models and ETL (extract, transform, load) pipelines to ensure efficient data processing, storage, and reporting. Testing and Troubleshooting: collaborate with business partners and testers to define, coordinate, and ...

coaching and mentoring others. Strong Microsoft SQL Server experience, including queries, stored procedures, scripts and database objects. Experience creating or supporting data feeds, ETL/ELT processes, integrations or data pipelines. Ability to translate business requirements into technical solutions. Experience using source control tools such as Git. Experience developing ...

scope technologies/products: Google Cloud Platform (GCP) and comparable cloud-based data engineering services dbt Python SQL ETL/ELT tooling and methodologies Data modelling and data product development AI-enabled data development Testing and validation frameworks Master Data Management (MDM), including commercial off-the-shelf and bespoke solutions ...