301 to 325 of 629 ETL Jobs in London

Experience deploying AI agents and designing AI-powered workflows (MCP, Agent APIs, LLM applications, prompt engineering, retrieval/RAG, workflow orchestration). Experience with ETL/ELT workflows, schema mapping, validation scripts, and large-scale migration tooling. Experience partnering with product and engineering teams to influence roadmaps or architecture based ...

calling, context management, evaluation, and guardrails Experience with RESTful API design, development, and integration, including frameworks such as FastAPI Experience with data engineering concepts, ETL and data pipelines, structured and unstructured data, and integration with enterprise data platforms Experience with CI/CD, automated testing, observability, production monitoring, and operational ...

driven design (DDD), API gateways, and CI/CD automation pipelines. Data & Integration Platforms: Familiarity with modern enterprise data architectures (Data Lakes/Mesh, ETL/ELT pipelines, business intelligence tools) and enterprise application integrations (iPaaS, Message Queues). Enterprise Frameworks: Strong practical application of enterprise governance methodologies. Executive Communication ...

OpenData and integration of third‐party reference data Certification from a CRM or MDM software vendor Hands‐on experience with data warehousing concepts, SQL, ETL tools, or web services technologies Exposure to integration frameworks, user authentication methods, or batch data processes Additional European language(s) Perks & Benefits Annual allocations ...

design, and backend engineering fundamentals. Hands-on experience building production systems involving: LLM orchestration or agent frameworks (Pydantic, LangChain, custom orchestration). Data pipelines, ETL, embeddings, or vector search Retrieval-augmented generation (RAG) or model-backed workflows High-performance APIs and distributed services Strong understanding of modern cloud environments ...

Experience working with SQL/Snowflake or other modern data platforms* Strong, modern Python development experience.* Some experience building and maintaining data pipelines, ETL processes, or data-intensive backend services* A collaborative working style and clear communication across technical and non-technical stakeholders.* A keen desire to want to learn ...

deploying machine learning models, or getting involved with client pitches. What you'll be working on Building, optimising, and deploying price optimization machine learning ETL/ELT pipelines and data processes. Improving and adapting our data infrastructure and code base as we scale – including collaboration, security, scalability, efficiency, automation and ...

data modeling, analytics engineering, dashboards, pipelines, governance, and performance optimization. Create documentation, samples, walkthroughs, and adoption assets for workflows across SQL, ELT/ETL, dbt, orchestration, semantic modeling, BI, and analytics application development. Partner closely with product, engineering, and field teams to identify high-value use cases, develop technical assets ...

generation, tool calling, context management, evaluation, and guardrailsExperience with RESTful API design, development, and integration, including frameworks such as FastAPIExperience with data engineering concepts, ETL and data pipelines, structured and unstructured data, and integration with enterprise data platformsExperience with CI/CD, automated testing, observability, production monitoring, and operational readiness ...

Azure/GCP), and secure deployment. Broad experience of business, data, software and technology architecture and the inter‐relationships. Expertise in API‐based integration, ETL, data transformation, and orchestration technologies (NiFi, Kafka, API gateways, Kubernetes). Understanding of data representation formats and transport protocols. Familiarity with information security best practices ...

high calibre teams to exceed their expectations Sales acumen, identifying and managing sales opportunities at client engagements An understanding of database technologies e.g. SQL, ETL, No-SQL, DW, and Big Data technologies e.g. Hadoop, Mahout, Pig, Hive, etc.; An understanding of statistical modelling techniques e.g. Classification and regression techniques, Neural ...

high calibre teams to exceed their expectations Sales acumen, identifying and managing sales opportunities at client engagements An understanding of database technologies e.g. SQL, ETL, No-SQL, DW, and Big Data technologies e.g. Hadoop, Mahout, Pig, Hive, etc. An understanding of statistical modelling techniques e.g. Classification and regression techniques, Neural ...

Architect & Build Scalable Data SolutionsCollaborate closely with senior product stakeholders to understand data needs and architect end-to-end ingestion pipelinesDesign and build robust ETL/ELT processes and data architectures using modern tools and techniquesLead database design, data modelling, and integration strategies to support analytics at scaleDrive Data Integration … best practices – code reviews, testing frameworks, CI/CD, and code maintainabilityExperience deploying applications into production environments, including packaging, monitoring, and release managementAbility to extract insights from complex and disparate data sets and communicate clearly with stakeholdersHands-on experience with cloud platforms such as AWS, Azure, or GCPFamiliarity with traditional ...

Develop and optimise Lakehouse, Warehouse, and OneLake solutions. Implement Medallion Architecture (Bronze, Silver, Gold layers) to support data quality and governance. Create and maintain ETL/ELT processes using Data Factory, Data Pipelines, Notebooks, and Spark. Develop, maintain, and enhance SQL scripts, stored procedures, views, and data models. Monitor and … into technical solutions. Produce technical documentation and knowledge transfer materials. What you will have Technical Skills Strong SQL development skills. Experience designing and implementing ETL/ELT solutions. Knowledge of Lakehouse and Data Warehouse architectures. Experience with Data Pipelines, Dataflows Gen2, and Notebooks. Understanding of data modelling techniques, including star ...

going. Youll work across: Building data pipelines using Microsoft Fabric Fabric Lakehouse, Warehouse and OneLake Developing data models and analytics solutions Power BI development ETL/ELT SQL and SQL Server Azure Data Lake Internal and third-party API integrations Azure DevOps and Git CI/CD and production deployments … longer-term ownership , rather than simply meeting an arbitrary number of years. Youll also need experience across several of the following: SQL Data modelling ETL/ELT development Azure data platforms Azure Data Lake API integrations Git/source control Azure DevOps CI/CD Developing, deploying and supporting production ...

environment, supporting operational, reporting and analytics requirements across the business. You'll work across: Microsoft Fabric, including Lakehouse, Warehouse and OneLake Data pipelines and ETL/ELT Power BI SQL and data modelling Azure Data Lake Internal and third-party API integrations Azure DevOps, Git and CI/CD Production … ownership , rather than using an arbitrary number of years as the measure. You'll also need strong Data Engineering experience across: SQL Data modelling ETL/ELT Azure data platforms API integrations Git/source control CI/CD Production deployment and support Azure Synapse would be useful ...

core systems to provide a single view of the business and its strategic partners. KEY RESPONSIBILITIES Develop, maintain and optimise data pipelines and ETL/ELT processes between source systems and the cloud-based Data Warehouse (Microsoft Fabric) Take ownership of the reliability, monitoring and performance of data pipelines, resolving … upskill the BI team and promote consistent data and BI practices across the organisation ESSENTIAL SKILLS AND EXPERIENCE Strong experience in data engineering, including ETL/ELT, data pipelines and modern cloud data platforms Strong understanding of data warehousing, dimensional modelling, Kimball principles and data architecture Advanced SQL/ ...

needs and understanding how their needs are different to wants and managing clients' stakeholders relationship appropriately Identifying data sources, data extraction, transformation, and loading (ETL/ELT) concepts and methods Designing, evaluating, and implementing on-premise, cloud-based and hybrid data engineering solutions (including providing review and guidance on testing … range of projects, including data analysis, extraction, transformation, and loading, data intelligence, data security and proven experience in their technologies (e.g. Spark, cloud-based ETL services, Python, Kafka, SQL, Airflow) You have experience in assessing the relevant data quality issues based on data sources & uses cases, and can integrate ...

other engineers within the team. What You’ll Do Design, build and maintain scalable data platforms and data pipelines within AWS Develop robust ETL/ELT processes for ingesting, transforming and processing data from multiple sources Design and implement data solutions using AWS services such as S3, Glue, Lambda, Athena … Lambda, Athena, Redshift and EMR, with experience selecting the appropriate services for different requirements Strong Python and SQL skills Experience designing and building scalable ETL/ELT pipelines and data processing workflows Good understanding of data modelling, data lakes, data warehouses and modern data platform architectures Experience with infrastructure ...

where appropriate.**Data Platform and Engineering*** Partner with Data Engineers and platform teams to design secure, resilient data pipelines.* Define patterns for ingestion, transformation, ETL/ELT, metadata and master data management.* Design solutions for structured, semi-structured and unstructured data.* Ensure architectures support performance, scalability, recovery and supportability.**Governance … practices.* Experience integrating Fabric with Microsoft and Azure ecosystems.**Cloud and Data Technologies*** Experience designing Azure-based data platforms.* Strong understanding of warehousing, datalakes, ETL/ELT, integration, analytics and reporting patterns.* Experience with Azure Data Factory, Databricks, Azure SQL, Azure Storage and related services.* Experience with APIs and system ...

Synergy Solutions Limited in Greater London is looking for experienced Data Engineers to join their team immediately for a large-scale Workday HCM implementation. In this hands-on role, you will support data migration, transformation ...

N Consulting Limited is looking for a Data Engineer (Python Enterprise Developer) to work in a hybrid model with 4 days a week in London, Canary Wharf. The ideal candidate will have 8+ years of ...

systems such as Microsoft Office 365, Dynamics 365, SAP Success Factors, Treasury Openlink Findur, CMS, BACs Payment Platforms, Microsoft Power BI, Integration/ETL, Azure Active Directory Single Sign On and other bespoke applicationsExperience in executing business continuity planning and IT DRPCreating solution and technical application architectures, IT standards and ...

power client initiatives. The role requires cloud data expertise (Azure/AWS/GCP), strong SQL/NoSQL, and experience with ELT/ETL tools. You will mentor teams and shape data standards in an agile environment. #J-18808-Ljbffr ...

Strong hands-on Data Engineering experience in modern cloud-based environments. Experience with Snowflake and building scalable data platforms. Expertise in data integration, ETL/ELT pipelines and data warehousing. Good understanding of data governance, security and best practice. Previous experience mentoring, leading or developing team members. Comfortable operating autonomously ...