26 to 50 of 69 Data Pipeline Jobs in Central London

Data Scientist (Python, PySpark, Healthcare Analytics) Contract: Initial 2 Months (Mid-September – Mid-November) Location: Remote (UK) with 1 day per week in London (2–3 days preferred) We are seeking an experienced Data Scientist to join a high-profile digital transformation programme focused on building … innovative products on a large-scale UK healthcare data platform. Working within a multidisciplinary product team, you will design and develop data science solutions that support population health management and analytics. This is an excellent opportunity to contribute to products that help improve healthcare outcomes through ...

Quantexa Data Engineers (Mid-Level through to Lead) £55,000 - £85,000 dependant on experience + bonus + car allowance + benefits Full Time/Permanent Hybrid/London/Birmingham/Manchester/Leeds Background I am looking for Data Engineers at all levels … clients as and when required. The successful candidates must either hold or be eligible for SC clearance. The Role As a Data Engineer/Senior Data Engineer, you will lead/contribute towards the technical development of Quantexa based solutions, bringing deep hands-on experience with ...

Overview I'm partnered with a high-growth Series C fintech that is looking to hire a Head of Data Engineering to lead and scale its data platform as the business continues its rapid growth. Responsibilities You’ll lead a team of data engineers … define the technical roadmap, and work closely with engineering, product and data leadership to build a modern, scalable data platform that supports both analytics and AI initiatives. Qualifications Previous experience leading and growing Data Engineering teams Strong hands‐on background with modern cloud data ...

Senior Data Scientist | Telecoms | London (2 Days) | £78,000-£83,000 DOE + Strong Bonus We are working on a fantastic opportunity with a telecoms powerhouse who is looking to hire a Senior Data Scientist due to organic growth. The Company Created from humble beginnings … worldwide! The Role This will be a hands-on position where you will be responsible for building, validating, optimising, and managing models and data pipelines, working within a Data Science function alongside Data Analysts and Data Engineers. You will work ...

British Airways is seeking a Principal Data Engineer to lead data engineering practices across delivery teams. You will design, build, test, and deploy secure and scalable data pipelines, ensuring availability and performance of data products. You will lead agile ceremonies and coach … engineers while on-call to support live data products. You will also manage senior data engineers, set standards for data processing documentation, and collaborate with stakeholders to drive reliable, scalable data #J-18808-Ljbffr ...

Lead Data Engineer (Permanent, London on-site) A high-growth AI software company is looking for a Lead Data Engineer to own and scale the data foundations behind an AI-driven operations platform used by property teams. This is a hands-on, high-ownership … role where you'll define the data architecture, set engineering standards and build systems that power product analytics and modern AI capabilities. What you'll do Architect and build scalable data pipelines and distributed data systems Design ingestion, transformation and storage patterns for operational ...

Position Overview This is a newly created engineering leadership role at a pivotal moment for Proximie. We're scaling rapidly, our data capabilities are central to our product and commercial strategy, and we need an experienced leader to own this space end to end. You'll unite … Engineering Own the architecture, quality, and scalability of Proximie's data platform. Lead the team building and maintaining ETL/ELT pipelines, data warehousing, and analytics infrastructure. Set engineering standards, tooling decisions, and technical direction across the data stack (Python ...

Snowflake. Responsibilities Use cloud‐native technologies and services to build scalable, reliable, and secure applications. Build, support, and integrate web applications, microservices, and data pipelines with high code quality. Write automated unit, integration, and deployment tests. Use CI/CD tooling (e.g., GitLab Runners) to build and deploy ...

Funds (ETF) sector, is seeking an experienced Lead Python Developer to play a key role in shaping the future of their technology and data platforms. This is a rare opportunity to join a highly respected organisation operating at the intersection of technology, data and financial markets. … delivery of business-critical solutions while working closely with senior stakeholders across the organisation. Key Responsibilities: Leading the design and development of scalable data platforms and applications Building and optimising Python-based solutions and automation tools Developing and maintaining PostgreSQL databases and data models Delivering Azure ...

Senior Data Engineer | London (Camden) | Hybrid (4 days in office) We're partnering with a fast-growing AI technology business that's transforming how businesses make operational decisions through data and machine learning. They're looking for a Senior Data Engineer to take ownership … modern, AWS-native data platform, building scalable pipelines and production-grade ML infrastructure that powers real-time analytics and intelligent decision-making. Within 3/6 months, you will take full ownership of the platform. You'll be responsible for: • Designing and maintaining ETL/ELT pipelines • Deploying ...

Senior Databricks Technical Engineer Up to £111,500 + 10% Bonus | UK Wide Hybrid | SC Clearance Ready to build data platforms that actually make an impact? We're looking for an experienced Senior Databricks Technical Engineer to join a growing enterprise data team where … play a key role in designing, building and evolving modern data platforms. This isn't a role for someone looking to learn Databricks-you'll be the technical expert from day one, helping shape the platform while mentoring other engineers. What you'll be doing Building enterprise-scale ...

domain specialised architecture position focused on Programme Management, PMO systems, Project Controls processes and EPPM technology ecosystems. Working within the Digital and Data Solutions Group under the Programme Controls Technology capability, you will collaborate closely with project management, project controls teams, programme delivery leadership, enterprise architects and technology … partners to define scalable, secure and integrated solutions for: Cost Management, Schedule Management, Risk, Change and Contingency, Performance Reporting, Data Governance and Integrated Analytics. You will act as a technical authority for project controls platforms, ensuring solutions align with enterprise architecture principles, programme delivery strategy and best practice ...

applications without this cannot be considered) Core Engineering: Strong backend development skills (Python, Go, or C++) with solid API design and data pipeline experience AI Tooling: Hands‐on experience integrating LLMs, handling vector databases, and building robust chunking/embedding strategies Secure Architecture: Deploying LLM pipelines ...

architectural leadership by leading through example. Your responsibilities will include: Lead the development and implementation of a modern cloud foundation and data platform that is robust, scalable, fully automated, secure, and can support the growth of the business. Build Scalable Architectures: Leverage modern technologies to design and implement … build secure RESTful and GraphQL APIs, ensuring seamless integration with core banking systems (e.g., Mambu) and external services like Open Banking platforms. Data Engineering and Analytics: Work closely with data teams to define robust data pipelines and scalable cloud-based data platforms ...

Data Scientist (AI & Machine Learning) – Renewable Energy & Emerging Technologies London/Hybrid About the Role We're looking for an AI-focused Data Scientist to join our Engineering & Development team, helping transform how renewable energy projects are identified, evaluated and developed. You'll work … technologies can improve the way renewable energy projects are developed. You'll also have the opportunity to contribute to new technology areas including data centres, onshore wind and future energy infrastructure. The organisation sees AI and advanced analytics as a key enabler of future growth and is looking ...

looking for a hands-on Data Product Manager to own and personally lead the development of our predictive market modelling solutions for the Animal Health division. This is a player-coach role: you will set the product direction for our sales and market models and roll up your … yourself. You’ll be the technical and product owner for forecasting solutions that directly shape commercial decision-making – turning messy internal and external data into models the business trusts and acts on. The role suits someone equally comfortable in a stakeholder workshop and in a notebook, who wants ...

Integration Engineer with active UK SC clearance for a contract position in London. The role focuses on backend development, API design, and data pipelines, with hands-on work integrating LLMs and vector databases in secure, classified environments. You will work on self-hosted, containerised models (Llama, Mistral ...

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments Troubleshoot integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft ...

need proven experience in the following: Hands-on experience with Splunk in a SOC environment Cribl experience for log management and data pipeline optimisation Security monitoring, threat detection and incident response Working within a security operations centre at a mid-senior level SC clearance held or ability ...

patterns. Contribute to technical strategy and architecture decisions, working closely with the Head of Engineering. Maintain secure, performant, and maintainable systems, ensuring reliable data pipelines as we scale. Engage closely with product workflows to ensure systems built solve the right problems. Job Requirements: Experience in software engineering, ideally ...

internal tooling. Provide sound technical recommendations to the Senior Manager, clients, and internal stakeholders, evaluating options and trade-offs. Own technical design decisions, data models, and integration patterns; document and communicate them so others can build against them. Help define technical standards and pragmatic build/buy/… adopt AI-driven solutions effectively and responsibly. Hands-on development (full stack) Write production-quality code across front end, back end, and data layers. This is and remains a genuinely hands-on role. Build and integrate APIs, data pipelines, and tooling that turn actuarial and financial ...

Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data … deployed. Your work will directly influence how we build Astro, Observe and our IDE product, as well as how global organizations orchestrate data pipelines at scale—making them faster, more reliable, and easier to manage. If you’re driven by impact, excited by scale, and ready to work ...

e.g., Python, Python API, Java,SQL ) and engineering frameworks Work with distributed systems and cloud platforms to support scalable, reliable deployments Assist with data preparation, prompt configuration, and model integration for AI-driven solutions Troubleshoot and resolve technical issues during development and deployment Client Delivery Support Work alongside … production, ensuringsolutions are scalable, supportable, and can be transitioned effectively to production engineering teams Skill Requirements Bachelor's degree in Computer Science, Engineering, Data Science, or related field Total 15+ year of Experience in Client Facing - AI Implementation Cloud platforms Application interfacesas Solution Architect. 5+ years of proficient ...

company that’s tackling one of the biggest challenges in energy today. They’re building a new approach to natural exploration, using advanced data, geoscience, and cloud tech to drive smarter decisions. They’re now looking for a Senior Data Platform Engineer to take ownership … their growing platform and help scale it as the business expands globally. What you’ll be doing This Senior Data Platform Engineer role sits at the heart of a multidisciplinary team of scientists, analysts, and engineers. You’ll work closely with them to turn complex workflows into robust ...

innovative geospatial solutions within a risk and analytics environment. This is a hands-on role focused on building production-grade geospatial services, spatial data pipelines and interactive mapping solutions. You'll work closely with architects, product leaders and engineering teams to develop scalable GIS platforms while making … delivery. What You'll Be Doing Designing and developing geospatial services and APIs that underpin business-critical analytics products. Building and maintaining spatial data pipelines for ingesting, transforming and validating large geospatial datasets. Applying advanced GIS expertise across coordinate systems, spatial analysis, topology, cartography and data ...