226 to 250 of 363 Data Pipeline Jobs in Central London

and optimal ‘next task’ Build fully-automated pipelines for dictionary building; including span identification, word sense distribution, and sense granularity decision Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries and train models to determine the difficulty of … words, idioms, phrasal verbs etc. Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather more test results, analyse them, and build prediction models based on these results … Optimise and fine-tune machine learning models for performance, scalability, and accuracy Essential skills 🙏 Strong expertise in NLP Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Strong understanding of neural networks, CNNs, RNNs, LSTMs, and transformers Experience building automated data pipelines Hands-on experience with LLM More ❯

physical trading teams. The role will focus on building and improving a modern metals trading analytics & visualisation platform. You’ll deliver production-grade Python systems, dashboards, automation and data pipelines that provide traders and risk teams with fast, reliable insights to support trading and risk decision-making. 📍 6 month rolling contract (strong likelihood of multi-year renewals) 💸 Rate … services and ETL pipelines for trading analytics. Build and enhance dashboards and visualisations (Grafana or equivalent) for traders and risk teams. Implement analytics, aggregation and automation to improve data quality, latency and reporting. Work closely with traders, risk, and data engineers to translate business requirements into reliable software. Contribute to deployment, CI/CD, containerisation and … services. Help maintain documentation, tests and runbooks for production systems. Technical/professional skills (essential) Strong production Python experience (3+ years at senior level). Proven experience with data engineering/ETL and time-series or market data. Experience building dashboards/visualisations — Grafana highly preferable . Solid SQL skills and working knowledge of databases (Postgres, TimescaleDB or More ❯

physical trading teams. The role will focus on building and improving a modern metals trading analytics & visualisation platform. You’ll deliver production-grade Python systems, dashboards, automation and data pipelines that provide traders and risk teams with fast, reliable insights to support trading and risk decision-making. 📍 6 month rolling contract (strong likelihood of multi-year renewals) 💸 Rate … services and ETL pipelines for trading analytics. Build and enhance dashboards and visualisations (Grafana or equivalent) for traders and risk teams. Implement analytics, aggregation and automation to improve data quality, latency and reporting. Work closely with traders, risk, and data engineers to translate business requirements into reliable software. Contribute to deployment, CI/CD, containerisation and … services. Help maintain documentation, tests and runbooks for production systems. Technical/professional skills (essential) Strong production Python experience (3+ years at senior level). Proven experience with data engineering/ETL and time-series or market data. Experience building dashboards/visualisations — Grafana highly preferable . Solid SQL skills and working knowledge of databases (Postgres, TimescaleDB or More ❯

Head of Data Engineering & Architecture Security Clearance: SC Required | Remote (with occasional travel) | Initial Term: 3 Months Are you a data leader who thrives on turning complex challenges into elegant, scalable solutions? We’re looking for a Head of Data Engineering & Architecture to lead delivery across multiple high-impact programmes for a major public … sector organisation . In this role, you’ll define and execute the data engineering strategy, oversee technical delivery across multiple streams, and drive innovation in data platforms, architecture, and analytics. What You’ll Do Lead the design and delivery of enterprise data platforms, ensuring technical excellence and alignment with business goals Oversee teams across … Data Engineering, Architecture, Analytics, and Science Champion innovation and continuous improvement across all data delivery streams Collaborate with senior stakeholders to deliver impactful, data-driven outcomes Shape the roadmap for scalable, secure, and high-performing data ecosystems Technical Expertise This role extends beyond any single tech stack — you’ll be empowered to More ❯

A fast-growing macro hedge fund is seeking a technically sharp and curious individual to join a high-impact team at the intersection of technology, data, and investment operations. Operating in a fast-paced, high-performance environment, the fund values autonomy, initiative, and smart problem-solving. This is a unique opportunity to work across all areas of the … s technology infrastructure as it scales. About the Role This is a broad, hands-on position where you'll work directly with investment and operational teams to streamline data flows, automate processes, and enhance system efficiency. From day one, you'll be given real ownership of projects that span infrastructure, reporting, and tooling-making a tangible impact on … the fund's performance and scalability. Key Responsibilities Build and maintain robust data pipelines and automations using Python, SQL, and Excel/VBA Integrate external data feeds and APIs into internal systems and databases Develop dashboards and reporting tools to support trading, risk, and operations Manage infrastructure hosted on Microsoft Azure, including VMs and storage Use More ❯

A fast-growing macro hedge fund is seeking a technically sharp and curious individual to join a high-impact team at the intersection of technology, data, and investment operations. Operating in a fast-paced, high-performance environment, the fund values autonomy, initiative, and smart problem-solving. This is a unique opportunity to work across all areas of the … s technology infrastructure as it scales. About the Role This is a broad, hands-on position where you'll work directly with investment and operational teams to streamline data flows, automate processes, and enhance system efficiency. From day one, you'll be given real ownership of projects that span infrastructure, reporting, and tooling-making a tangible impact on … the fund's performance and scalability. Key Responsibilities Build and maintain robust data pipelines and automations using Python, SQL, and Excel/VBA Integrate external data feeds and APIs into internal systems and databases Develop dashboards and reporting tools to support trading, risk, and operations Manage infrastructure hosted on Microsoft Azure, including VMs and storage Use More ❯

client is looking for a seasoned analytics leader to head it's global Product Analytics function. You will define the vision, scale a high-performing team, and ensure data-driven insights drive product strategy and business growth. This role requires a mix of technical depth, leadership excellence, and the ability to turn data into clear, actionable … for senior stakeholders. Key Responsibilities Team Leadership & Growth Lead and expand the Product Analytics team across multiple domains and global locations. Hire, coach, and develop analysts into effective data storytellers who deliver actionable insights. Foster a culture of ownership, collaboration, and high performance. Analytics Strategy & Execution Define and execute the analytics strategy, making data a competitive … advantage. Partner with senior leadership to ensure analytics directly influence business and product direction. Manage project intake, prioritize initiatives, and allocate resources against strategic priorities. Data-Driven Insights & Enablement Define and maintain critical business metrics to track performance and inform decisions. Design and run experiments, build dashboards, and create visualizations that communicate results at scale. Provide technical mentorship More ❯

Senior Data and Analytics Engineer - Front Office/FI London Excellent package plus bonus/benefits Overview You will work directly with the Front Office investment and trading teams to build, enhance, and support data and analytics infrastructure that powers research, trading, and portfolio decision-making. This is a hands-on, high-impact role at the … trading environment). Offer deep expertise in Python, with strong software engineering practices (version control, testing, CI/CD). Have a proven track record of building robust data pipelines in cloud-native environments (preferably AWS). Experience with Docker and container-based deployments. Strong knowledge of Snowflake and NoSQL databases (especially MongoDB). Solid understanding of financial … markets and instruments particularly Fixed Income (or may consider with an exposure to credit, rates, equities, options, etc. Experience with market data providers (Bloomberg, Refinitiv, etc.) would be useful Any familiarity with tools such as Airflow, prefect, or other orchestration frameworks would be advantageous. Experience building internal tools or dashboards using Dash, Streamlit, or similar web-based data More ❯

Senior Data and Analytics Engineer - Front Office/FI London Excellent package plus bonus/benefits Overview You will work directly with the Front Office investment and trading teams to build, enhance, and support data and analytics infrastructure that powers research, trading, and portfolio decision-making. This is a hands-on, high-impact role at the … trading environment). Offer deep expertise in Python, with strong software engineering practices (version control, testing, CI/CD). Have a proven track record of building robust data pipelines in cloud-native environments (preferably AWS). Experience with Docker and container-based deployments. Strong knowledge of Snowflake and NoSQL databases (especially MongoDB). Solid understanding of financial … markets and instruments particularly Fixed Income (or may consider with an exposure to credit, rates, equities, options, etc. Experience with market data providers (Bloomberg, Refinitiv, etc.) would be useful Any familiarity with tools such as Airflow, prefect, or other orchestration frameworks would be advantageous. Experience building internal tools or dashboards using Dash, Streamlit, or similar web-based data More ❯

Role: Business Analyst – Retention Data (EMEA) 📍 Location: Hybrid – London (3 days office/2 days remote) ⏳ Contract Length: 12 months minimum 💰 Day Rate: £260/day (Inside IR35) I’m hiring for a Business Analyst – Retention Data to join a leading global tech company known for empowering businesses with cutting-edge financial tools and services. This … contract (minimum) with hybrid working 3 days per week in the London office, 2 days remote . ** MUST HAVE ** 1: Within your experience and clearly on your CV: Data Insight, what impact did you make. 2: We are looking for someone who can display on their CV that has analysed data they have pulled and can … more than just a reporting role, it’s an opportunity to use your skills in SQL, Python, and BI tools (e.g., Tableau/Qlik) to influence strategy, close data gaps, and directly impact customer outcomes. Key Responsibilities: Build and automate scalable reporting solutions focused on customer retention Create and present dashboards combining internal and external data More ❯

for a driven and curious Graduate AI Engineer to join our hybrid-working team in London . You’ll be part of a collaborative group of engineers and data scientists developing and deploying cutting-edge AI solutions that make a real impact. This is a fantastic opportunity for a recent graduate or early-career professional with up to … one year of experience who’s passionate about machine learning, data, and building intelligent systems that solve real-world problems. In this role, you’ll: 🧠 Design, train, and evaluate machine learning and deep learning models for real-world applications 🛠 Support the development and optimisation of AI pipelines — from data preprocessing to model deployment 📊 Experiment with techniques … across NLP, computer vision, and predictive analytics 🤝 Collaborate with data engineers and software developers to integrate AI solutions into scalable products 💡 Research emerging AI trends and contribute fresh ideas to improve models and workflows What’s in it for you? 📈 Career Growth – Develop your technical expertise through hands-on mentorship and continuous learning opportunities. ⚙ Real-World Impact – Work More ❯

for a driven and curious Graduate AI Engineer to join our hybrid-working team in London . You’ll be part of a collaborative group of engineers and data scientists developing and deploying cutting-edge AI solutions that make a real impact. This is a fantastic opportunity for a recent graduate or early-career professional with up to … one year of experience who’s passionate about machine learning, data, and building intelligent systems that solve real-world problems. In this role, you’ll: 🧠 Design, train, and evaluate machine learning and deep learning models for real-world applications 🛠 Support the development and optimisation of AI pipelines — from data preprocessing to model deployment 📊 Experiment with techniques … across NLP, computer vision, and predictive analytics 🤝 Collaborate with data engineers and software developers to integrate AI solutions into scalable products 💡 Research emerging AI trends and contribute fresh ideas to improve models and workflows What’s in it for you? 📈 Career Growth – Develop your technical expertise through hands-on mentorship and continuous learning opportunities. ⚙ Real-World Impact – Work More ❯

be partnering with a leading force in the UK Government & Defence space to help build a high-impact team delivering one of the most sensitive and strategically important data programmes in the country. We’re seeking SC/DV Cleared Palantir Engineers who are driven by purpose, thrive in secure environments, and want to work on real-world … You’ll be embedded in a fast-paced, mission-led programme where your work directly supports UK Government operations. Day-to-day, you’ll: ⚙️ Build and maintain scalable data pipelines within Palantir Foundry or Gotham 🔄 Ingest, transform, and integrate both structured and unstructured sensitive data sources 🔐 Enable secure access control, data modelling, and operational … interested in engineers who are motivated by impact , not just tech for tech's sake. You should have: ✅ Proven hands-on experience in Palantir Foundry or Gotham – deployment, configuration, pipeline development ✅ Strong background in data engineering , analytics , or data architecture ✅ Coding experience in Python, SQL , or similar ✅ Experience delivering in secure , high-stakes, or classified More ❯

be partnering with a leading force in the UK Government & Defence space to help build a high-impact team delivering one of the most sensitive and strategically important data programmes in the country. We’re seeking SC/DV Cleared Palantir Engineers who are driven by purpose, thrive in secure environments, and want to work on real-world … You’ll be embedded in a fast-paced, mission-led programme where your work directly supports UK Government operations. Day-to-day, you’ll: ⚙️ Build and maintain scalable data pipelines within Palantir Foundry or Gotham 🔄 Ingest, transform, and integrate both structured and unstructured sensitive data sources 🔐 Enable secure access control, data modelling, and operational … interested in engineers who are motivated by impact , not just tech for tech's sake. You should have: ✅ Proven hands-on experience in Palantir Foundry or Gotham – deployment, configuration, pipeline development ✅ Strong background in data engineering , analytics , or data architecture ✅ Coding experience in Python, SQL , or similar ✅ Experience delivering in secure , high-stakes, or classified More ❯

Miryco Consultants are working on behalf of a market leading investment manager to hire a Data & AI Risk Analyst to join their second line Technology Risk team. This is a fantastic opportunity for a risk professional early in their career to specialise in a highly topical area, whilst gaining wider experience of working in a high-performance culture. … Responsibilities: Support the review and monitoring of risks related to data platforms, cloud environments, and emerging AI technologies. Assist in analysing technology incidents, change activities, and control testing to identify potential risk exposures. Contribute to the development of risk reporting, dashboards, and governance materials. Help assess how AI, automation, and data tools are being used across … the business from a risk perspective. Work with senior risk managers and engineers to promote strong data governance and AI control practices. Stay up to date with developments in AI, data protection, and tech regulation to help shape risk oversight. Experience & Skills: Early career professional or recent graduate with experience or academic background in data More ❯

Apply advanced analytical techniques, such as machine learning, natural language processing, computer vision, and deep learning, to extract insights and generate solutions from structured and unstructured data. Build data pipelines, models, and AI applications using cloud platforms and frameworks such as Azure AI/ML Studio, AWS Bedrock, GCP Vertex, Spark, TensorFlow, PyTorch, etc. Build and deploy production … grade fine-tuned LLMs and complex RAG architectures. Create and manage the complex and robust prompts across the GenAI solutions. Communicate effectively with stakeholders and colleagues, using data visualisation, storytelling, and presentation skills. Ensure the ethical use of AI and adherence to data privacy regulations. Essential Skills and Experience Experienced in data science, machine … learning and AI and delivering AI-driven solutions using a variety of tools and techniques Proficient in programming languages such as Python and familiar with data science, AI libraries and frameworks. Expert in implementing Agentic AI solutions , MCP protocols and integrating with GenAI based applications. Experience in working with cloud platforms and services, such as Azure, AWS and More ❯

Apply advanced analytical techniques, such as machine learning, natural language processing, computer vision, and deep learning, to extract insights and generate solutions from structured and unstructured data. Build data pipelines, models, and AI applications using cloud platforms and frameworks such as Azure AI/ML Studio, AWS Bedrock, GCP Vertex, Spark, TensorFlow, PyTorch, etc. Build and deploy production … grade fine-tuned LLMs and complex RAG architectures. Create and manage the complex and robust prompts across the GenAI solutions. Communicate effectively with stakeholders and colleagues, using data visualisation, storytelling, and presentation skills. Ensure the ethical use of AI and adherence to data privacy regulations. Essential Skills and Experience Experienced in data science, machine … learning and AI and delivering AI-driven solutions using a variety of tools and techniques Proficient in programming languages such as Python and familiar with data science, AI libraries and frameworks. Expert in implementing Agentic AI solutions , MCP protocols and integrating with GenAI based applications. Experience in working with cloud platforms and services, such as Azure, AWS and More ❯

with an organisation that’s passionate about your learning journey and committed to your professional career and personal development. Lead Technology Integration Workstream Drive the financial planning and data integration workstream within a broader transformation or modernization program. Align integration strategy with enterprise financial systems, ensuring data accuracy and consistency across planning, reporting, and forecasting platforms. … maintain a detailed roadmap covering milestones, dependencies, and risk mitigation plans. Oversee day-to-day execution, ensuring timely delivery and adherence to scope, quality, and compliance standards. Drive Data Integration, Migration, and Validation Lead the design and execution of data migration, validation, and reconciliation processes to support accurate financial and operational reporting. Collaborate with data and technology teams to ensure robust, secure data pipelines between core systems (e.g., ERP, EPM, data warehouse). Cross-Functional Coordination Serve as the bridge between Finance, Operations, Technology, and Data teams to ensure alignment on priorities, requirements, and timelines. Communicate effectively with stakeholders at all levels, translating technical concepts into actionable More ❯

with an organisation that’s passionate about your learning journey and committed to your professional career and personal development. Lead Technology Integration Workstream Drive the financial planning and data integration workstream within a broader transformation or modernization program. Align integration strategy with enterprise financial systems, ensuring data accuracy and consistency across planning, reporting, and forecasting platforms. … maintain a detailed roadmap covering milestones, dependencies, and risk mitigation plans. Oversee day-to-day execution, ensuring timely delivery and adherence to scope, quality, and compliance standards. Drive Data Integration, Migration, and Validation Lead the design and execution of data migration, validation, and reconciliation processes to support accurate financial and operational reporting. Collaborate with data and technology teams to ensure robust, secure data pipelines between core systems (e.g., ERP, EPM, data warehouse). Cross-Functional Coordination Serve as the bridge between Finance, Operations, Technology, and Data teams to ensure alignment on priorities, requirements, and timelines. Communicate effectively with stakeholders at all levels, translating technical concepts into actionable More ❯

This team leverages technical expertise in actuarial modelling, statistical analysis, and risk management solutions to support a high-impact team of 90+ underwriters. You will build and maintain data pipelines and data models to elevate the Analytics team and help answer the most difficult business challenges. Key requirements Experience in the London or Lloyd's insurance … markets is essential Have an Advanced degree in Statistics, Computer Science, Mathematics or a related field or relevant industry industry experience Have knowledge of programming and data manipulation skills such as SQL and Python, and version control (Github) is essential Experience building multi-step ETL jobs/data pipelines and working with job scheduling systems is … a plus Demonstrated ability to thrive with minimal oversight and process. You connect the dots across business needs and independently drive projects forward Have strong data visualization skills and experience with Power BI is a bonus Have experience with cloud technologies, preferably Microsoft Azure More ❯

unlock the value of technology and build a more sustainable, more inclusive world. Your Role We are looking for a skilled Spark/Scala Developer to join our data engineering team. The ideal candidate will have hands-on experience in designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala. You will … work closely with data scientists, analysts, and engineers to build efficient data solutions and enable data-driven decision-making. Key Responsibilities: Develop, optimize, and maintain data pipelines and ETL processes using Apache Spark and Scala. Design scalable and robust data processing solutions for batch and real-time data. Collaborate with … cross-functional teams to gather requirements and translate them into technical specifications. Perform data ingestion, transformation, and cleansing from various structured and unstructured sources. Monitor and troubleshoot Spark jobs, ensuring high performance and reliability. Write clean, maintainable, and well-documented code. Participate in code reviews, design discussions, and agile ceremonies. Implement data quality and governance best More ❯

unlock the value of technology and build a more sustainable, more inclusive world. Your Role We are looking for a skilled Spark/Scala Developer to join our data engineering team. The ideal candidate will have hands-on experience in designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala. You will … work closely with data scientists, analysts, and engineers to build efficient data solutions and enable data-driven decision-making. Key Responsibilities: Develop, optimize, and maintain data pipelines and ETL processes using Apache Spark and Scala. Design scalable and robust data processing solutions for batch and real-time data. Collaborate with … cross-functional teams to gather requirements and translate them into technical specifications. Perform data ingestion, transformation, and cleansing from various structured and unstructured sources. Monitor and troubleshoot Spark jobs, ensuring high performance and reliability. Write clean, maintainable, and well-documented code. Participate in code reviews, design discussions, and agile ceremonies. Implement data quality and governance best More ❯

opportunity to take on a high-impact, hands-on leadership role within a scaling global SaaS company that’s using AI to reinvent how internal business systems and data work together. As a Staff Software Engineer (AI/ML) , you’ll be the technical lead for a newly formed AI Engineering function , designing and delivering the internal AI … and data infrastructure that supports smarter decision-making across the organisation. You’ll build and scale AI-powered backend systems that connect enterprise data platforms (CRM, analytics, and communication tools) with large language models — creating intelligent tools and insights that enhance the way teams operate. This is a role with real influence: you’ll own the … adopted across the company. What You’ll Do Lead the design, architecture, and implementation of internal AI/ML systems for business intelligence. Build robust APIs, microservices, and data pipelines to power intelligent, data-driven tools. Develop retrieval-augmented generation (RAG) systems using vector databases for contextual AI. Set the technical direction for backend and AI More ❯

opportunity to take on a high-impact, hands-on leadership role within a scaling global SaaS company that’s using AI to reinvent how internal business systems and data work together. As a Staff Software Engineer (AI/ML) , you’ll be the technical lead for a newly formed AI Engineering function , designing and delivering the internal AI … and data infrastructure that supports smarter decision-making across the organisation. You’ll build and scale AI-powered backend systems that connect enterprise data platforms (CRM, analytics, and communication tools) with large language models — creating intelligent tools and insights that enhance the way teams operate. This is a role with real influence: you’ll own the … adopted across the company. What You’ll Do Lead the design, architecture, and implementation of internal AI/ML systems for business intelligence. Build robust APIs, microservices, and data pipelines to power intelligent, data-driven tools. Develop retrieval-augmented generation (RAG) systems using vector databases for contextual AI. Set the technical direction for backend and AI More ❯

Up to £125,000 base + bonus & benefits A leading global consulting and analytics firm is seeking a Databricks Architect to drive architecture and delivery of large-scale data solutions for their commercial insurance clients. This is a senior role, shaping data strategy and modernising platforms that underpin underwriting, claims, and pricing. Key Responsibilities Lead end … to-end architecture and solution design across Databricks and Azure cloud ecosystems. Build scalable lakehouse architectures, advanced analytics, and AI/ML data pipelines. Work closely with insurance stakeholders to translate business needs into technical solutions. Ensure best practices in data governance, security, and regulatory compliance. Provide technical leadership to engineering teams and contribute to architecture … standards. Skills & Experience Proven experience as a Data/Solution Architect with strong expertise in Databricks (Delta Lake, MLflow, Spark) . Deep understanding of commercial insurance processes (underwriting, claims, personal/specialty lines). Strong background in Azure (Synapse, Data Factory, Fabric) or similar cloud data platforms. Knowledge of data governance, integration More ❯