18 of 18 Data Pipeline Jobs in the City of London

About the Role We are seeking talented and motivated data professionals with experience in Data Engineering, Data Analysis, or Data Science who are looking to further develop their careers towards Data Architecture . This role offers the opportunity to work … large-scale, business-critical data initiatives, helping organisations design, build, and optimise modern data platforms and solutions. You will collaborate with technical teams, business stakeholders, and customers to deliver high-quality data solutions that enable informed decision-making and drive digital transformation. Key Responsibilities ...

Produce detailed, technically credible integration architectures across all integration domains - SAP and ERP connectivity, e-commerce and digital channels, mobile platforms, data pipeline and analytics integrations, and third-party SaaS and partner systems. Lead technical spikes and proof-of-concept work to validate architectural approaches, evaluate tooling … formerly CPI), IDocs, BAPIs, and the challenges of connecting SAP to modern digital and data platforms. Strong background in data pipeline integration - including CDC, event-to-data flows, real-time feeds, and the interface between integration architecture and data platform design. ...

fields of management consulting and investment fund management. Based in Newcastle upon Tyne at their enviable facilities, my client seeks a Data Engineer to join their elite Tyneside team as part of rapid expansion of the business to cope with client demand and continued excellent performance. About … engineering best practices. Architecture : Participate in architecture and technical design discussions. Testing: Write automated unit, integration, and end-to-end tests. Data Pipeline Development : Design and develop sophisticated data pipelines to import data from internal and external sources and seamlessly integrate into data ...

Data Engineer London - Hybrid £65,000 - £75,000 Azure Data/SQL/Financial Services I'm currently working with a growing data and technology consultancy who are looking to bring a Data Engineer into their expanding delivery team. The business works … with a range of organisations across telecommunications, financial services, insurance and healthcare, helping clients develop modern data platforms and turn complex data into valuable business insights. Joining a client-facing consulting team, you'll have the opportunity to work across a variety of data ...

environment. This large-scale initiative will require technical expertise across multiple aspects of product migration, alongside the development and testing of new pipeline technologies through Alpha and Beta phases. You will play a key role in designing and implementing an Alpha deployment of Databricks within the new AWS environment … helping to establish the foundations for modern, scalable data pipeline technology. Key Responsibilities Design and implement an Alpha deployment of Databricks in a new AWS environment. Provide technical input and support across multiple aspects of the product estate migration. Support the migration of the government body ...

recruiting for a Data Developer to join our Group Finance - Technical Analysts team in London, on a 12 month contract basis. Technical Analysts team - London Provide high quality advice and relevant, accurate information to the decision makers in A&O Shearman, ensuring compliance with laws and regulations … delivering our service efficiently. What you will do Microsoft Fabric Data Developer to design, build, and support modern cloud-based data solutions using the Microsoft Fabric platform. The successful candidate will develop scalable data pipelines, data warehouses, lakehouses, and reporting solutions that ...

Data Engineer (Python SQL AWS) London/WFH to £85k Do you have experience of building data pipelines within finance/Fintech environments? You could be progressing your career in a hands-on Data Engineer role at a scaling Investment Research tech company with … great benefits and perks. As a Data Engineer you will be at the intersection of data engineering, database management and platform delivery. You will help build and evolve a modern, scalable AWS cloud based data platform. Your focus will be on designing and maintaining ...

Role: Geospatial Data Engineer Location: Central London - Hybrid (2-3 days per week in the office) Salary: £75,000 - £90,000 An exciting opportunity for an experienced Geospatial Data Engineer to join an innovative technology business developing automated solutions within the transport and mobility sector. This … hands-on role where you'll play a key part in building accurate, reliable transport datasets and developing the data pipelines and spatial models that underpin software solutions. Working closely with the development team, you'll help transform complex and fragmented data into high-quality, structured ...

Azure Data Engineer - 1/2 days onsite 18 month FTC Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse … Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster insights. Key Responsibilities: - Develop and maintain data pipelines using Azure services. - Ingest, transform, and model data from diverse sources. - Optimise data flows ...

Contract - Senior Data Engineer (Snowflake Cortex) Rate: (Apply online only) per day, Outside IR35 Location: London (2 days per week, on-site) Start Date: Monday 9th November 2026 Length: 6 months initially, with a chance of extension. Interview Stages: 1-stage over Teams, with joint company owners … partnered with a rapidly growing HealthTech start-up who's recently received funding. They're on a mission to build a next-gen data platform for processing millions of confidential patient records and clinical documents securely, and at scale. The successful Data Engineer will play ...

capabilities within air-gapped environments Deploy and manage containerised applications using Docker and Kubernetes Build and integrate APIs and microservices Develop and maintain data pipelines and workflow orchestration Configure and integrate workflow tooling such as Jira Work with a range of database, search and storage technologies Troubleshoot … management Previous experience working within air-gapped environments Strong understanding of APIs and microservices Experience with Prefect, Airflow or similar data pipeline/orchestration technologies Experience configuring and integrating workflow tooling such as Jira Experience with database and storage technologies such as: SQL Elasticsearch MongoDB DSE/ ...

Bugs: Track down issues across the whole system-from a button glitch on screen down through the background servers, data pipelines, and logins. Keep Code Clean: Write solid automated tests for your changes and participate in regular team code reviews. Essential Skills Proven Engineering Experience (5+ years ...

Data Scientist (Fixed Term Contract) Contract Details: Contract Type: Fixed Term Contract Contract Length: 12 months Working Pattern: Full Time Daily Rate: 600 to 750 Our client, a leading player in the retail industry, is seeking a talented Data Scientist to join their dynamic team … term contract basis for 12 months. This is an exceptional opportunity to leverage your expertise in machine learning and statistics to drive impactful data science solutions that enhance customer experiences and optimise business operations. Role Overview: As a Data Scientist, you will be at the forefront ...

Azure Data Engineer - 1/2 days onsite 18 month FTC Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse … Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster click apply for full job details ...

KDB+ Data Engineer - Banking and Financial Services Permanent Based in London - hybrid £70K - £80K Urgently hiring for a hands-on KDB+ Data Engineer with 2-3 years experience and strong Python skills for an exciting opportunity within the banking industry. This is a permanent role with … great opportunity for a technically minded engineer looking to build on their KDB+/q and Python experience, working with financial data and high-performance data solutions in a banking environment. Skills and Requirements: * 2-3 years of hands-on KDB+/q experience. * Strong Python ...

KDB+/q and Python Developer with 3-5 years of commercial experience to join a technology team developing and supporting high-performance, data-driven applications. Responsibilities: * Develop and maintain applications using KDB+/q and Python. * Build and optimise data pipelines and time-series data solutions. * Improve query performance, data processing and system efficiency. * Troubleshoot technical issues and support application development. * Collaborate with technical teams to deliver robust, scalable solutions. Skills & Experience: * 3-5 years of hands-on KDB+/q development experience. * Strong Python development skills. * Experience working with large ...

execution of client engagements: scoping, system design, build and rollout. Forward-deployed means exactly that: inside the client's environment, on their real data, within their security model. A working prototype exists within the first days of an engagement; feedback lands every couple of days; a proven … templates and playbooks that make every engagement faster than the last. What You'll Be Doing Building working AI proofs on real client data during Assess engagements - the prototype is the discovery tool, built while the value case is made Delivering client POCs and MVPs: RAG pipelines, agent ...

execution of client engagements: scoping, system design, build and rollout. Forward-deployed means exactly that: inside the client's environment, on their real data, within their security model. A working prototype exists within the first days of an engagement; feedback lands every couple of days; a proven … templates and playbooks that make every engagement faster than the last. What You'll Be Doing Building working AI proofs on real client data during Assess engagements - the prototype is the discovery tool, built while the value case is made Delivering client POCs and MVPs: RAG pipelines, agent ...