101 to 125 of 167 Data Pipeline Jobs in Central London

assistants - Summarization tools Apply prompt engineering, Retrieval-Augmented Generation (RAG), and context-aware pipelines to enhance model accuracy and relevance. Integrate AI models with enterprise systems, APIs, and data stores using Python, Java, or Node.js. Collaborate with architects to define scalable, secure, and cost-efficient AI service architectures. Implement AI/ML pipelines for training, validation, and deployment … model compression, quantization, and API optimization. Ensure compliance with AI ethics, security, and governance standards. Prepare and curate training datasets (structured/unstructured text, images, code). Apply data preprocessing, tokenization, and embedding generation techniques. Work with vector databases (e.g., Pinecone, Weaviate, FAISS, Chroma) for semantic search and retrieval. Partner with business stakeholders to identify and shape impactful … with cloud platforms (AWS, GCP, Azure) and AI/ML services. Knowledge of MLOps tools and practices (e.g., MLflow, Kubeflow, Vertex AI, Azure ML). Strong understanding of data engineering, data pipelines, and ETL workflows. Excellent problem-solving, communication, and stakeholder engagement skills. Bachelor's or Master's degree in Computer Science, AI/ML, Data More ❯

Job Description: Locality Expert Employment Type: Full-time Work Type: Remote Duration: 6 months Location: London Role Objective: The team works on keeping Maps Data current and reflective of real-world changes. They work on issues submitted by end users of Maps or test the location results of user queries submitted via Web Search or Maps interface. The … Mapping Maintenance Expert will be responsible for improving & maintenance of city/country transit data and providing country specific expertise. The Maintenance Expert will be responsible for developing and maintaining transit data pipelines and establishing the ground truth for the countries they would be responsible for maintenance. Role & Responsibilities as a Maintenance Expert: ❏ Communicating with City … Experts & other stakeholder teams and achieving the project objectives. ❏ Identify transit user expectations, broken critical user journeys, data gaps and provide insights to the product. ❏ Validate quality of new and updated data in the data management platform. ❏ Make necessary edits for all transit data types. ❏ Flag issues to Program Managers to communicate More ❯

A growing global macro hedge fund is seeking a Technology Associate/Data Engineer to join its lean, high-impact technology team in London. The firm combines an entrepreneurial culture with institutional backing and is known for empowering talented individuals to take ownership, innovate, and shape its future. This is a hands-on engineering role at the intersection … of technology, data, and business operations . You’ll work directly with teams across Trading, Risk, Operations, Finance, and Compliance to build tools, automate processes, and enhance the firm’s data and reporting infrastructure. The successful candidate will be someone who combines strong technical skills with curiosity, pragmatism, and drive — someone who takes pride in engineering … fundamentals, thrives in a small team, and wants to see the commercial impact of their work. Key Responsibilities Develop, maintain, and enhance data pipelines and ETL processes using Python and SQL. Manage and integrate API connections and FTP data feeds into internal systems. Build and support dashboards and reports to provide visibility across trading and operations. More ❯

A growing global macro hedge fund is seeking a Technology Associate/Data Engineer to join its lean, high-impact technology team in London. The firm combines an entrepreneurial culture with institutional backing and is known for empowering talented individuals to take ownership, innovate, and shape its future. This is a hands-on engineering role at the intersection … of technology, data, and business operations . You’ll work directly with teams across Trading, Risk, Operations, Finance, and Compliance to build tools, automate processes, and enhance the firm’s data and reporting infrastructure. The successful candidate will be someone who combines strong technical skills with curiosity, pragmatism, and drive — someone who takes pride in engineering … fundamentals, thrives in a small team, and wants to see the commercial impact of their work. Key Responsibilities Develop, maintain, and enhance data pipelines and ETL processes using Python and SQL. Manage and integrate API connections and FTP data feeds into internal systems. Build and support dashboards and reports to provide visibility across trading and operations. More ❯

where execution speed and technical depth matter. What You’ll Do Design and implement large-scale agentic AI systems and intelligent orchestration layers. Work across the stack, from data pipelines to model deployment and real-time inference. Build tools and infrastructure that empower ML teams to deploy and iterate faster. Collaborate directly with founders on architecture, strategy, and More ❯

where execution speed and technical depth matter. What You’ll Do Design and implement large-scale agentic AI systems and intelligent orchestration layers. Work across the stack, from data pipelines to model deployment and real-time inference. Build tools and infrastructure that empower ML teams to deploy and iterate faster. Collaborate directly with founders on architecture, strategy, and More ❯

and optimal ‘next task’ Build fully-automated pipelines for dictionary building; including span identification, word sense distribution, and sense granularity decision Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries and train models to determine the difficulty of … words, idioms, phrasal verbs etc. Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather more test results, analyse them, and build prediction models based on these results … Optimise and fine-tune machine learning models for performance, scalability, and accuracy Essential skills 🙏 Strong expertise in NLP Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Strong understanding of neural networks, CNNs, RNNs, LSTMs, and transformers Experience building automated data pipelines Hands-on experience with LLM More ❯

and optimal ‘next task’ Build fully-automated pipelines for dictionary building; including span identification, word sense distribution, and sense granularity decision Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries and train models to determine the difficulty of … words, idioms, phrasal verbs etc. Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather more test results, analyse them, and build prediction models based on these results … Optimise and fine-tune machine learning models for performance, scalability, and accuracy Essential skills 🙏 Strong expertise in NLP Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Strong understanding of neural networks, CNNs, RNNs, LSTMs, and transformers Experience building automated data pipelines Hands-on experience with LLM More ❯

client is looking for a seasoned analytics leader to head it's global Product Analytics function. You will define the vision, scale a high-performing team, and ensure data-driven insights drive product strategy and business growth. This role requires a mix of technical depth, leadership excellence, and the ability to turn data into clear, actionable … for senior stakeholders. Key Responsibilities Team Leadership & Growth Lead and expand the Product Analytics team across multiple domains and global locations. Hire, coach, and develop analysts into effective data storytellers who deliver actionable insights. Foster a culture of ownership, collaboration, and high performance. Analytics Strategy & Execution Define and execute the analytics strategy, making data a competitive … advantage. Partner with senior leadership to ensure analytics directly influence business and product direction. Manage project intake, prioritize initiatives, and allocate resources against strategic priorities. Data-Driven Insights & Enablement Define and maintain critical business metrics to track performance and inform decisions. Design and run experiments, build dashboards, and create visualizations that communicate results at scale. Provide technical mentorship More ❯

Role: Business Analyst – Retention Data (EMEA) 📍 Location: Hybrid – London (3 days office/2 days remote) ⏳ Contract Length: 12 months minimum 💰 Day Rate: £260/day (Inside IR35) I’m hiring for a Business Analyst – Retention Data to join a leading global tech company known for empowering businesses with cutting-edge financial tools and services. This … contract (minimum) with hybrid working 3 days per week in the London office, 2 days remote . ** MUST HAVE ** 1: Within your experience and clearly on your CV: Data Insight, what impact did you make. 2: We are looking for someone who can display on their CV that has analysed data they have pulled and can … more than just a reporting role, it’s an opportunity to use your skills in SQL, Python, and BI tools (e.g., Tableau/Qlik) to influence strategy, close data gaps, and directly impact customer outcomes. Key Responsibilities: Build and automate scalable reporting solutions focused on customer retention Create and present dashboards combining internal and external data More ❯

for a driven and curious Graduate AI Engineer to join our hybrid-working team in London . You’ll be part of a collaborative group of engineers and data scientists developing and deploying cutting-edge AI solutions that make a real impact. This is a fantastic opportunity for a recent graduate or early-career professional with up to … one year of experience who’s passionate about machine learning, data, and building intelligent systems that solve real-world problems. In this role, you’ll: 🧠 Design, train, and evaluate machine learning and deep learning models for real-world applications 🛠 Support the development and optimisation of AI pipelines — from data preprocessing to model deployment 📊 Experiment with techniques … across NLP, computer vision, and predictive analytics 🤝 Collaborate with data engineers and software developers to integrate AI solutions into scalable products 💡 Research emerging AI trends and contribute fresh ideas to improve models and workflows What’s in it for you? 📈 Career Growth – Develop your technical expertise through hands-on mentorship and continuous learning opportunities. ⚙ Real-World Impact – Work More ❯

for a driven and curious Graduate AI Engineer to join our hybrid-working team in London . You’ll be part of a collaborative group of engineers and data scientists developing and deploying cutting-edge AI solutions that make a real impact. This is a fantastic opportunity for a recent graduate or early-career professional with up to … one year of experience who’s passionate about machine learning, data, and building intelligent systems that solve real-world problems. In this role, you’ll: 🧠 Design, train, and evaluate machine learning and deep learning models for real-world applications 🛠 Support the development and optimisation of AI pipelines — from data preprocessing to model deployment 📊 Experiment with techniques … across NLP, computer vision, and predictive analytics 🤝 Collaborate with data engineers and software developers to integrate AI solutions into scalable products 💡 Research emerging AI trends and contribute fresh ideas to improve models and workflows What’s in it for you? 📈 Career Growth – Develop your technical expertise through hands-on mentorship and continuous learning opportunities. ⚙ Real-World Impact – Work More ❯

Miryco Consultants are working on behalf of a market leading investment manager to hire a Data & AI Risk Analyst to join their second line Technology Risk team. This is a fantastic opportunity for a risk professional early in their career to specialise in a highly topical area, whilst gaining wider experience of working in a high-performance culture. … Responsibilities: Support the review and monitoring of risks related to data platforms, cloud environments, and emerging AI technologies. Assist in analysing technology incidents, change activities, and control testing to identify potential risk exposures. Contribute to the development of risk reporting, dashboards, and governance materials. Help assess how AI, automation, and data tools are being used across … the business from a risk perspective. Work with senior risk managers and engineers to promote strong data governance and AI control practices. Stay up to date with developments in AI, data protection, and tech regulation to help shape risk oversight. Experience & Skills: Early career professional or recent graduate with experience or academic background in data More ❯

with an organisation that’s passionate about your learning journey and committed to your professional career and personal development. Lead Technology Integration Workstream Drive the financial planning and data integration workstream within a broader transformation or modernization program. Align integration strategy with enterprise financial systems, ensuring data accuracy and consistency across planning, reporting, and forecasting platforms. … maintain a detailed roadmap covering milestones, dependencies, and risk mitigation plans. Oversee day-to-day execution, ensuring timely delivery and adherence to scope, quality, and compliance standards. Drive Data Integration, Migration, and Validation Lead the design and execution of data migration, validation, and reconciliation processes to support accurate financial and operational reporting. Collaborate with data and technology teams to ensure robust, secure data pipelines between core systems (e.g., ERP, EPM, data warehouse). Cross-Functional Coordination Serve as the bridge between Finance, Operations, Technology, and Data teams to ensure alignment on priorities, requirements, and timelines. Communicate effectively with stakeholders at all levels, translating technical concepts into actionable More ❯

with an organisation that’s passionate about your learning journey and committed to your professional career and personal development. Lead Technology Integration Workstream Drive the financial planning and data integration workstream within a broader transformation or modernization program. Align integration strategy with enterprise financial systems, ensuring data accuracy and consistency across planning, reporting, and forecasting platforms. … maintain a detailed roadmap covering milestones, dependencies, and risk mitigation plans. Oversee day-to-day execution, ensuring timely delivery and adherence to scope, quality, and compliance standards. Drive Data Integration, Migration, and Validation Lead the design and execution of data migration, validation, and reconciliation processes to support accurate financial and operational reporting. Collaborate with data and technology teams to ensure robust, secure data pipelines between core systems (e.g., ERP, EPM, data warehouse). Cross-Functional Coordination Serve as the bridge between Finance, Operations, Technology, and Data teams to ensure alignment on priorities, requirements, and timelines. Communicate effectively with stakeholders at all levels, translating technical concepts into actionable More ❯

This team leverages technical expertise in actuarial modelling, statistical analysis, and risk management solutions to support a high-impact team of 90+ underwriters. You will build and maintain data pipelines and data models to elevate the Analytics team and help answer the most difficult business challenges. Key requirements Experience in the London or Lloyd's insurance … markets is essential Have an Advanced degree in Statistics, Computer Science, Mathematics or a related field or relevant industry industry experience Have knowledge of programming and data manipulation skills such as SQL and Python, and version control (Github) is essential Experience building multi-step ETL jobs/data pipelines and working with job scheduling systems is … a plus Demonstrated ability to thrive with minimal oversight and process. You connect the dots across business needs and independently drive projects forward Have strong data visualization skills and experience with Power BI is a bonus Have experience with cloud technologies, preferably Microsoft Azure More ❯

unlock the value of technology and build a more sustainable, more inclusive world. Your Role We are looking for a skilled Spark/Scala Developer to join our data engineering team. The ideal candidate will have hands-on experience in designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala. You will … work closely with data scientists, analysts, and engineers to build efficient data solutions and enable data-driven decision-making. Key Responsibilities: Develop, optimize, and maintain data pipelines and ETL processes using Apache Spark and Scala. Design scalable and robust data processing solutions for batch and real-time data. Collaborate with … cross-functional teams to gather requirements and translate them into technical specifications. Perform data ingestion, transformation, and cleansing from various structured and unstructured sources. Monitor and troubleshoot Spark jobs, ensuring high performance and reliability. Write clean, maintainable, and well-documented code. Participate in code reviews, design discussions, and agile ceremonies. Implement data quality and governance best More ❯

unlock the value of technology and build a more sustainable, more inclusive world. Your Role We are looking for a skilled Spark/Scala Developer to join our data engineering team. The ideal candidate will have hands-on experience in designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala. You will … work closely with data scientists, analysts, and engineers to build efficient data solutions and enable data-driven decision-making. Key Responsibilities: Develop, optimize, and maintain data pipelines and ETL processes using Apache Spark and Scala. Design scalable and robust data processing solutions for batch and real-time data. Collaborate with … cross-functional teams to gather requirements and translate them into technical specifications. Perform data ingestion, transformation, and cleansing from various structured and unstructured sources. Monitor and troubleshoot Spark jobs, ensuring high performance and reliability. Write clean, maintainable, and well-documented code. Participate in code reviews, design discussions, and agile ceremonies. Implement data quality and governance best More ❯

opportunity to take on a high-impact, hands-on leadership role within a scaling global SaaS company that’s using AI to reinvent how internal business systems and data work together. As a Staff Software Engineer (AI/ML) , you’ll be the technical lead for a newly formed AI Engineering function , designing and delivering the internal AI … and data infrastructure that supports smarter decision-making across the organisation. You’ll build and scale AI-powered backend systems that connect enterprise data platforms (CRM, analytics, and communication tools) with large language models — creating intelligent tools and insights that enhance the way teams operate. This is a role with real influence: you’ll own the … adopted across the company. What You’ll Do Lead the design, architecture, and implementation of internal AI/ML systems for business intelligence. Build robust APIs, microservices, and data pipelines to power intelligent, data-driven tools. Develop retrieval-augmented generation (RAG) systems using vector databases for contextual AI. Set the technical direction for backend and AI More ❯

opportunity to take on a high-impact, hands-on leadership role within a scaling global SaaS company that’s using AI to reinvent how internal business systems and data work together. As a Staff Software Engineer (AI/ML) , you’ll be the technical lead for a newly formed AI Engineering function , designing and delivering the internal AI … and data infrastructure that supports smarter decision-making across the organisation. You’ll build and scale AI-powered backend systems that connect enterprise data platforms (CRM, analytics, and communication tools) with large language models — creating intelligent tools and insights that enhance the way teams operate. This is a role with real influence: you’ll own the … adopted across the company. What You’ll Do Lead the design, architecture, and implementation of internal AI/ML systems for business intelligence. Build robust APIs, microservices, and data pipelines to power intelligent, data-driven tools. Develop retrieval-augmented generation (RAG) systems using vector databases for contextual AI. Set the technical direction for backend and AI More ❯

enterprise-scale systems. Role & Responsibilities: Lead the design and delivery of enterprise applications and reporting systems Develop tools for dashboards, analytics, and operational monitoring Build and maintain APIs, data pipelines, and automation for business processes Implement scalable solutions to improve operational efficiency and data quality Enhance and integrate commercial off-the-shelf (COTS) platforms where required … automation, and Agile delivery Knowledge of compliance, regulatory reporting, and enterprise operational processes Proven experience delivering complex software solutions Strong leadership and stakeholder management skills Bonus: Python, Azure Data Factory/Databricks, data analysis, and COTS platforms Package: £85,000 15% non-contributory pension Hybrid working (3 days per week) Performance-based bonus scheme Comprehensive benefits More ❯

a Technical Business Analyst with deep knowledge of insurance pricing and underwriting systems to bridge the gap between actuarial, product and engineering teams. You’ll gather requirements, design data flows, and help implement pricing models, APIs and analytical capabilities that drive better underwriting decisions. Key Responsibilities: Define and document requirements for pricing system integrations, model deployment and API … workflows. Translate pricing models (Excel/Python/R) into technical specifications for developers and data engineers. Collaborate with underwriters and actuaries to improve model governance, version control and reporting. Support UAT, model validation and release testing. Deliver insights and metrics around model performance, quote success and underwriting efficiency. Partner with insurers and MGAs to streamline pricing and … a Business Analyst or Technical Analyst role within insurance, reinsurance or InsurTech. Experience with pricing or rating systems, underwriting workflows or model integration projects. Strong understanding of insurance data structures, rating factors and model governance. Skilled in SQL and BI tools (Power BI, Tableau, Looker). Comfortable working with APIs, data pipelines and collaborating with developers. More ❯

a Technical Business Analyst with deep knowledge of insurance pricing and underwriting systems to bridge the gap between actuarial, product and engineering teams. You’ll gather requirements, design data flows, and help implement pricing models, APIs and analytical capabilities that drive better underwriting decisions. Key Responsibilities: Define and document requirements for pricing system integrations, model deployment and API … workflows. Translate pricing models (Excel/Python/R) into technical specifications for developers and data engineers. Collaborate with underwriters and actuaries to improve model governance, version control and reporting. Support UAT, model validation and release testing. Deliver insights and metrics around model performance, quote success and underwriting efficiency. Partner with insurers and MGAs to streamline pricing and … a Business Analyst or Technical Analyst role within insurance, reinsurance or InsurTech. Experience with pricing or rating systems, underwriting workflows or model integration projects. Strong understanding of insurance data structures, rating factors and model governance. Skilled in SQL and BI tools (Power BI, Tableau, Looker). Comfortable working with APIs, data pipelines and collaborating with developers. More ❯

Hiring: Data Engineer | Mission-Driven Fintech | Remote (UK based) 🚀 Propel are proud to be partnering with a rapidly scaling global fintech that’s transforming financial access for immigrants and international communities across the world. 📈 As their lending business continues to grow, they're looking for a Data Engineer to help scale the data infrastructure … that powers smarter, fairer credit decisions. 🧠 If you're passionate about building robust data pipelines, enabling real-time underwriting, and turning complex datasets into production-ready insights — this is your chance to work at the heart of a mission-driven business. ✅ What you'll bring: - 4+ years as a Data Engineer (ideally in fintech/lending … Strong SQL, Python, Snowflake, dbt, Dagster - Experience with credit bureau data, open banking APIs - A love for clean, scalable data systems in fast-moving environments Sound like you or someone you know? 📩 Drop me a message or apply directly – I’d love to tell you more More ❯

Senior Data Engineer (GenAI) - Leading Tech Company | London (Hybrid) Hybrid: 1 day in the office/4 days WFH Permanent role only Represented by Robert Half Limited Please note: No visa sponsorship on offer, No B2B,B2C, Fully remote workers or contractors on offer. The Opportunity We're looking for a Senior Data Engineer with hands … on GenAI experience to join a forward-thinking technology business that's building data-driven solutions with real-world impact. This is a highly visible, senior-level role where you'll take ownership of data pipelines, architecture, and GenAI operational frameworks - helping shape the next generation of AI-driven products and analytics. If you enjoy combining … engineering rigor with AI innovation, this role gives you the platform, freedom, and backing to make it happen. Key Responsibilities Design, build, and maintain scalable data pipelines across modern cloud platforms Drive the implementation of GenAI frameworks, including model deployment, monitoring, and lifecycle management ('GenAI Ops') Develop robust ETL/ELT workflows and optimise performance within Snowflake Collaborate More ❯