26 to 42 of 42 Data Pipeline Jobs in Central London

Responsibilities: Define and enforce Python development best practices, ensuring scalable and maintainable code. Develop secure, efficient Python-based tools and frameworks, including APIs, data pipelines, and client-facing applications. Collaborate with business and technical teams to understand requirements and deliver effective technical solutions. Drive automation and reusable components More ❯

party vendors (enterprise software solutions such Document Management, Time Management, Practice Management, Core business i.e. Microsoft etc) to support their integration and master data management implementations Develop Azure-based integration solutions using Logic Apps, Service Bus, Function Apps, API Management, and Data Factory (ADF). Build … robust data pipelines and ETL solutions that support business processes and reporting needs. Conduct code reviews on other people's solutions Working within a team of architects, data engineers, data analysts and C#/.Net Core developers the Integration Developer/Azure Integration Developer … optimises their technology environment. As such you will bring a mix of skills including: Expertise in Azure Integration Services suite with strong Azure Data Factory ETL Logic Apps, Service Bus, API Management Very strong SQL skills, including database design, stored procedures, and query optimisation Underlying programming expertise in More ❯

create modern systems by using Microsoft Fabric Act as a consultant, understanding the client requirements and deliver the best solutions. Building and optimising data pipelines. Debugging issues Keep costs under control Skills Microsoft Fabric - Lakehouse and warehouse models Azure Tools (Data Factory, Synapse, SQL) Python experience … for programming Databases, SQL and NoSQL (CosmosDB, KQL) Data Modelling: Kimball frameworks and 3NF Nice To Have Databricks Power BI AI/ML Azure Infrastructure DevOps Certifications Microsfot certified: fabric Analytics Engineer Associate DP-203 Azure data Engineering AZ-305 Azure Solutions Architect. If this sounds More ❯

Leading Financial Services client is currently going through a large Data transformation and is looking for Data Solution Manager to join them on this exciting journey. The roles are offering a base between £80,0000 to £85,000pa + a strong benefits package and flexible working. … One day in office in every 3 months in East Sussex As a Data Solution Manager you will report to our Head of Data Delivery and lead a small team of some of the best engineers in the industry to deliver, improve and maintain robust data pipelines within our ambitious data architecture. Requirements: You will have a strong background in data engineering, with experience in managing and mentoring other engineers. You should have significant experience with Snowflake and Microsoft Azure, particularly Azure Data Factory and Azure Dev Ops. More ❯

UK remote (willing to travel to Glasgow office once per quarter) Eden Scott is recruiting a Senior Full Stack Data Engineer for Amici to develop a cutting-edge platform. With significant growth and an ambitious technology roadmap, Amici seeks an engineer skilled in Java, Python, and data … MyAmici platform. Why Join Us? You'll work in an agile, collaborative environment, leveraging modern technology stacks to build and optimize a powerful data platform and search engine. With an opportunity to explore vector search, machine learning, and large-scale data processing using Apache Lucene, Solr … full-time role, remote, with one quarterly visit to their Glasgow office. What You’ll Do: Design, build, and optimize a high-performance data platform and search solution. Develop robust search capabilities using Apache Lucene, Solr, or Elasticsearch . Engineer scalable data pipelines in Java or More ❯

Lead Software Engineer - Cloud & Data Orchestration Hybrid (1-2 days/week in office) | £140k+ Package | Security-Cleared or Security Clearable required Location: London | Sector: Intelligence, Analytics & Secure Data | Process: 3 stages Our client is a mission-driven consultancy delivering high-impact intelligence, research, and technical … re hiring a Lead Software Engineer/Founding Engineer to take the reins of a specialist engineering unit delivering microservice-based cloud and data solutions at scale. This is a hands-on technical leadership role where you'll work closely with the CTO, shape architecture and tooling, and … the future of our engineering capability. What You'll Be Doing Leading a growing team (currently 2 engineers + external partners) across complex data and cloud engineering projects Designing and delivering distributed solutions on an AWS-centric stack, with open-source flexibility Working with Databricks, Apache Iceberg, and More ❯

ll contribute to the ongoing development of a next-generation platform, with a strong focus on high-performance search capabilities and large-scale data processing. This is a fantastic opportunity to work on impactful technology in a forward-thinking, data-driven environment. Your Role As a … Senior Java Developer, you’ll be instrumental in building and evolving a resilient data platform that underpins key SaaS offerings. You’ll work closely with engineers, designers, and product teams to deliver scalable, performant solutions that help end users derive real value from complex data. Key Responsibilities Write … and modern front-end frameworks (React/TypeScript) Develop and fine-tune search functionality using technologies like Lucene, Solr, or OpenSearch Collaborate with Data Engineers to design and deliver data pipelines Leverage cloud platforms (AWS, Azure, or GCP) for scalable and resilient processing Participate in code More ❯

DE/2904/GC_ A leading Quant Fund are looking to build out their Systematic Trading platform, with a focus on the data platform used by Quants and Researchers for their data modelling. You'll be specifically building out their Front Office Data … this role, you'll be: Taking requirements directly from Quants and Traders. Utilising modern technologies to build a platform for modelling. Building out Data Pipelines utilising Python and cloud-based tooling. Optimizing the performance of the data lake. Designing the underlying data infrastructure of More ❯

wed love to hear from you. What Youll Do Design, build, and maintain Python services that power critical financial workflows. Work with modern data processing tools like pandas and polars to transform and analyze large datasets. Build async Python services using asyncio , and develop event-driven systems integrating … speed with long-term maintainability. Work closely with product and business stakeholders to deliver high-impact features. Support and evolve our PostgreSQL -based data storage and querying layers. What Were Looking For 36+ years of professional software development experience, primarily with Python . Solid experience with Pythons standard … library and familiarity with modern idioms (e.g., dataclasses , type annotations , async/await ). Experience with data transformation and analysis libraries like pandas or polars. Comfortable writing unit and integration tests with pytest . Practical experience with PostgreSQL (or another relational database), and understanding of schema design and More ❯

next-generation platform. What You’ll Do: Design, build, and optimise distributed systems for high throughput and low latency. Work with large-scale data pipelines (terabytes to petabytes). Collaborate closely with product and data teams to solve complex engineering challenges. Write clean, maintainable Python code … re Looking For: Strong Python programming skills (5+ years preferred). Deep experience with distributed systems Solid understanding of concurrency, fault tolerance, and data consistency. Comfortable in an autonomous environment. Unfortunately, visa sponsorship is not available for this position. More ❯

next-generation platform. What You’ll Do: Design, build, and optimise distributed systems for high throughput and low latency. Work with large-scale data pipelines (terabytes to petabytes). Collaborate closely with product and data teams to solve complex engineering challenges. Write clean, maintainable Python code … re Looking For: Strong Python programming skills (5+ years preferred). Deep experience with distributed systems Solid understanding of concurrency, fault tolerance, and data consistency. Comfortable in an autonomous environment. Unfortunately, visa sponsorship is not available for this position. More ❯

next-generation platform. What You’ll Do: Design, build, and optimise distributed systems for high throughput and low latency. Work with large-scale data pipelines (terabytes to petabytes). Collaborate closely with product and data teams to solve complex engineering challenges. Write clean, maintainable Python code … re Looking For: Strong Python programming skills (5+ years preferred). Deep experience with distributed systems Solid understanding of concurrency, fault tolerance, and data consistency. Comfortable in an autonomous environment. Unfortunately, visa sponsorship is not available for this position. More ❯

next-generation platform. What You’ll Do: Design, build, and optimise distributed systems for high throughput and low latency. Work with large-scale data pipelines (terabytes to petabytes). Collaborate closely with product and data teams to solve complex engineering challenges. Write clean, maintainable Python code … re Looking For: Strong Python programming skills (5+ years preferred). Deep experience with distributed systems Solid understanding of concurrency, fault tolerance, and data consistency. Comfortable in an autonomous environment. Unfortunately, visa sponsorship is not available for this position. More ❯

next-generation platform. What You’ll Do: Design, build, and optimise distributed systems for high throughput and low latency. Work with large-scale data pipelines (terabytes to petabytes). Collaborate closely with product and data teams to solve complex engineering challenges. Write clean, maintainable Python code … re Looking For: Strong Python programming skills (5+ years preferred). Deep experience with distributed systems Solid understanding of concurrency, fault tolerance, and data consistency. Comfortable in an autonomous environment. Unfortunately, visa sponsorship is not available for this position. More ❯

next-generation platform. What You’ll Do: Design, build, and optimise distributed systems for high throughput and low latency. Work with large-scale data pipelines (terabytes to petabytes). Collaborate closely with product and data teams to solve complex engineering challenges. Write clean, maintainable Python code … re Looking For: Strong Python programming skills (5+ years preferred). Deep experience with distributed systems Solid understanding of concurrency, fault tolerance, and data consistency. Comfortable in an autonomous environment. Unfortunately, visa sponsorship is not available for this position. More ❯

next-generation platform. What You’ll Do: Design, build, and optimise distributed systems for high throughput and low latency. Work with large-scale data pipelines (terabytes to petabytes). Collaborate closely with product and data teams to solve complex engineering challenges. Write clean, maintainable Python code … re Looking For: Strong Python programming skills (5+ years preferred). Deep experience with distributed systems Solid understanding of concurrency, fault tolerance, and data consistency. Comfortable in an autonomous environment. Unfortunately, visa sponsorship is not available for this position. More ❯

next-generation platform. What You’ll Do: Design, build, and optimise distributed systems for high throughput and low latency. Work with large-scale data pipelines (terabytes to petabytes). Collaborate closely with product and data teams to solve complex engineering challenges. Write clean, maintainable Python code … re Looking For: Strong Python programming skills (5+ years preferred). Deep experience with distributed systems Solid understanding of concurrency, fault tolerance, and data consistency. Comfortable in an autonomous environment. Unfortunately, visa sponsorship is not available for this position. More ❯